As a DM, you could really turn this around on an adventurer who abuses it.
I see cults formed around a wholly and unabashedly incorrect impression of this player character. I see fan clubs and people on street seeking him as a known face. "My friend says she just loves you!" I see rivals...