If it's a daily, I'd go with cancelling their spell on a hit, giving a penalty on a miss. If it's a per-encounter, giving them a penalty on a hit seems about right. Especially since subtracting your primary spellcasting stat is likely to amount to -4 or -5, and that's fairly serious.