Alt-alternative
As an alternate to OP's alternative: Why not have wounds represent real damage as you propose, but limit the number of total wounds to the Con mod - damage above the total Con score inflicts a wound; dropping to zero or below inflicts a wound. When equal or exceeding their Con...
I want a really scary combat caster type, and I thought it would be memorable (and a little hilarious) if the magic hating barbarians that form the adventuring party track down the evil wizard who destroyed their town and had to fight a dark jedi. Obviously some things would have to be changed...