They know their magic can charm/hold a humanoid.
It is not, however, a humanoid-detector. That's not part of either spell. Indeed, there are even explicit powers mentioned in the game to detect/sense a type of creature.
If you cast a spell on an invalid target, generally you waste the spell.