Presumably, you'd still have light, medium, and heavy armor and they'd provide the benefits/restrictions you've already detailed in your original post.
Simple or martial proficiency would result in a difference in armor class. Consider your original proposal to be the benefits of martial armor...