If I do remember well, a touch spell on hold fizzles when you try to cast another spell or pretty much loses your concentration.
EDIT: What Empirate, the ninja, said.
On a side note; familiars can hold touch spells separatedly, what is a very useful resource.