Honestly, arcane casters being unable to cast in armor always bothered me.
If spellcasting in armor, at all, isn't beyond the pale (and the cleric, druid, paladin, bard, etc. say that it isn't), then why is arcane casting in armor so hideously unbalanced that it needs all these special rules...