It (really) means: "No walking around, holding the charge, for days on end."
RAW purists can certainly argue differently, but that's the intent. If you find yourself in a grapple with an undischarged touch spell, you make your touch attack (at -4, of course) like you would with any other weapon.