If you are physically attractive, having your charisma drop may mean that your body language and mannerisms change so as to diminish your appeal. Now you slouch, you have a vacant or hostile stare most of the time, your eyes and hair seem to be duller and you don't notice your personal hygiene as much, because you don't care now.