Let's see if we can make a logic that fits the game rules...
I've always seen vocal components of a wizard or sorcerer was a smattering of the language of creation itself. It is, at best, a pale version of the vocalizations spoken by the gods at the beginning of everything, the difference between a studio version of a song and an a capella version as done by American Idol contestant William Hung. But still, it carries enough power just in the speaking that minor effects can be generated by their use.
When generated, these sounds "coax" the universe into behaving differently. Just as in physics, energy added to an atom can cause it to change state, or even change composition, when these words are uttered, the universe changes shape, or state, in a small way.
When a wizard prepares spells, he is preparing a vocalization that was designed to have a pause in its utterance; the very act of pausing "hangs" the change on the wizard's very energy of his soul. It is all potential, no magic yet, and cannot be negated. However, when it is "unhung" by completion, it takes a very small toll on the caster, one that disorganizes him and makes him less able to hold a spell. However, with experience, he can learn to keep mental and spiritual "order" enough to hang and cast more than one spell. Even unconsciousness cannot separate the spell potential from the wizard; death, however, and the flight of his soul from its body will cause all "hung" spells to go back to their lowest state of existance with nary a ripple.
In some cases, however, verbalization isn't enough. If it is combined with gestures meant to reinforce or concentrate the power, and symapthetic materials to guide the power to its intended state of being, then magic happens.
In some cases, casters have come up with alternative verbalizations, ones that negate any need for gestures or symapthic components. The alternatives strain the potential of the wizard's soul much more strongly than just the regular magic would, and cause his loss of spell potential much more readily. These "metaverbalizations", or their corresponding "metagestures" can alter this language of creation, but as before, putting more strain on the wizard's ability to hold this energy together, and lessen the amount his soul can "hang."
Sound good enough for government work, as the saying goes?