I'd be fine with casters capping out at 3 spells total (1 highest, 2 next highest level), with partial recovery 1-2 times a day. As is, it's simply too much. The game has completely devolved into all casters, all the time.
Casters power needs to be dropped dramatically, as it has been made...