It's an age-old argument.
For me, the dealbreaker is things like Cure Wounds. If hit points were just your stamina, luck, position or something like that instead of wounds, there wouldn't be all these spells that interact with HP like if they were wounds.
But some games do approach HPs that...