Honestly I think it would be situational. For instance if the target is a zombie or something that would have very low charisma. The additional damage would be minimal. Also in part the DM would make the charisma attribute of some enemy NPC and few would have a high charisma while being evil...
