It is a bit silly that a lesser restoration that can cure blindness, deafness, and paralysation can't restore any exhaustion levels.
Also a short rest should recover a level, maybe limit it to once per day from short rests so you can't spam them.
I think I will do something like this.
Once per day you can recover a level of exhaustion after taking a short rest if you have adequate food and drink.
Lesser Restoration will recover 1 level of exhaustion, and Restoration will recover all of them.
If you had read the Wheel of Time series, the 5e way of doing exhaustion fits pretty well (up until you get magic that removes it).