Love the idea of making them Con based. Makes thematic sense, and it reduces the ungodly amount of cha casters.
Then, you can have specific sorcerer subclasses using charisma (or wis, or int, or strength!) for subclass features, just so the sorcerer does not become a single ability class.
I...