Swift and Immediate action spells don't provoke AoOs. AoOs don't rely on components (like verbal, somatic etc.), but on actions used to cast the spell. So your V only spell would still provoke if it's a standard or full-round action to use.
Similarly, a component-less spell (Silent-metamagicked Suggestion cast by a Sorcerer with the Eschew Materials feat, for example) would still provoke an AoO if it takes more than a swift action to cast. This also goes for Spell-like Abilities.