The only problem with ability damage was the math. It would be simplified by having the penalty come off all related rolls and when the penalty equalled the stat it was relate to you suffered the consiquences, death, immoblization, whatever.
-4 STR would mean -4 to STR rolls, if you had STR...