No. Just all spellcasters and all psionic users will suffer an encumbrance and/or armor penalty just like arcane users. In this situation, magic is magic is magic.
I see arcane spell failure for all. If the cleric is smart, he'll try to get a feat that will grant him a sacred AC bonus equal to his AC, by expending a turn undead check.