I really don't grok the idea of priests running around in armour all day, so how about this for when PCs attack:
Lair Action
As a lair action, members of the clergy not wearing armour or carrying a shield gain a bonus to AC equal to their Proficiency bonus.
What do you think? Too powerful?