Sure, you as a DM can absolutely can choose to reject mechanics intended to reflect physical laws which you find 'unrelatable' while accepting magic as 'just fine'.ah yes; because dragon.
See, I don't disagree with you - in a world where magic exist, everything can happen. But I dislike your argument, in all due respect, because it assumes that the existence of magic necessarily negates physical laws, or at least, the internal D&D physical logic, like falling damage. Magic is by definition something that breaks or affects the "mundane" physical laws. If I knew more about magic myself, I could judge how the cleric and the warlock's mechanics convey a believable portrait of magic. But I don't. I do however know about falling.
Suspension of disbelief is much easier when we can imagine something that isn't real, and more difficult when it contradicts something we experience, or have experience of. Clearly this does not bother you, which is cool, but one can accept magic and yet reject mechanics they don't find relatable, and that should be cool too. One does not necessarily implies the other.
At that point though, it is a 'you as the DM' problem, not a player problem. And it is a DM problem because it is an explicit nerf to the classes without access to magic bulshittery.