Indeed Wall of force is a complete designer choice and can be make with hit points.There is another solution.
Allow the "normal" guy to have super strength and attempt to break the barrier. Just like they can do the wall of stone.
There is no reason that Wall of Force has to be completely unbreakable
With a complete game revision, I think that we can completely dissolve all magic into balanced game effects.