I would prefer for AC to also be affected (simply "-1 penalty to any D20 test you make, or is made against you") and a hard limit on 1 exhaustion level recovered via long rest and 1 via other means per day (suggest limit spells to Hero's Feast, Heal, Regenerate, Life Transference) unless via...