Unless you run a party of warlocks, I think you'll probably find that this limit happens anyway. As everyone else runs out of spells, arcane recovery, sorcery points, hit dice, etc., even if the warlock still feels like she's going strong, she will end up outvoted.