One bandaid solution for this is using XP as a balancing tool ...
I think 4e did this, but am not sure:
The more encounters your have between long rests the more you get (like in multipliers).
So, to put that into 5e as a quick and dirty solution is, when ever you take a long rest, all XP you...