I like this idea. Make them very tough early, but the impact lessens with time.
Maybe something like. Thick Skinned: Your Hit Points increase by an amount equal to your Constitution score. If your Constitution later increases, so does the bonus provided by Thick Skinned.
You'd probably start...