You could have untrained be x steps below the associated attribute; for example, perhaps it's two steps down; d4 uses d4-2 for untrained; d6 d4-1, d8 uses d4, d10 uses d6, et cetera. However, that's a pretty big staight power-up, so three or more steps might be better, with a minimum of d4-2.