Sure, upon reflection, that's correct. But since the trigger can be, as you said, whistling, blinking, whatever - it doesn't change my answer at all.
The bigger point is, since a magic action still has to be used to cast the spell, further holding it to then trigger as a reaction doesn't make...