I believe it is the division of short rest based classes, and long rest based classes, that is broken balance wise, as opposed to the warlock specifically, although the warlock is the classic short rest class.
I disagree about if you can take a 1 hour rest, you can take 8 hours, we often don't...