The only limitations are those placed by practicality, particularly for those vampires hiding amongst society.
The vampire knows that some people will resist his 'charms'. If a target resists and manages to flee, that target could warn others.
Once the 'charm' wears off, the target can report the vampire, so the vampire must have a plan to either renew the charm or to destroy the target before the expiration of the effect.
It is not very hard for characters with a sense motive skill to notice the domination over a period of time, so having multiple victims floating around out there is likely to cause problems.
In the end, it is more of a stop-gap ability: the vampire will use it to temporarily control a victim until they can fully deal with the target.