I think it should be doable, with a good dose of passive features from class/background.
Like, instead of str, fighter can have more powerful/meaningful fighting styles, a feature adding a flat bonus to athletic skill check, a flat bonus to carrying weight, etc.
Monks, would start with a...