Can a paladin use his detect evil ability without arousing suspicion among those around him or do people watching him know he is trying to use a spell like ability?
If it is like a monster's spell-like ability then it is the same as casting a spell except that is has no components (and thus hard to notice except for the moment of silence and look of concentration).