Is the ability to charm, persuade, impress and appeal to people who the characters meet no longer associated with Charisma? If not, then the Charisma Ability is bluntly not Charisma anymore.
Sure, but lets 180 this. The naive social climber who is an attractive, short willowy elf who is described as "conventionally beautiful" (and other... less appropriate terms) is apparently supposed to intimidate the tar out of people - far more than the big ugly guy with a huge sword.
The grand secret is that D&D isn't a particularly good system for social stats. In fact the entirety of every social stat in every other system has boiled down to one number. Usually it's 3-6.
Dun stare too hard at the base six stats.