The magic system is fine as it is, leave it alone! If you force your "house rules" upon your players then they will not like it, just remember to tell the player that plays a spellcaster beforehand. However, I am pretty sure that you will find people that like that idea ;)