Depending on the situation starting a fight is fine. It's not going to automatically draw in enemies so that you can automatically attack them all. It will be dependent on the audience, the location, what's going on.
If it's just a wisdom save I could walk into a lady's knitting club and goad them into attacking with their knitting needles. Not going to happen. Go to a grand ball of foppish, non-combatent nobles and they're not going to attack. Perhaps slip poison into my drink they're giving me as a "peace" offering, but risk getting their outfits dirty? Nah. They have people for dealing with ruffians. For that matter if I start a fight with the wrong person they may just disintegrate my PC and call the servants to sweep up the pile of dust afterwards.
Start a brawl in a seedy tavern? Sure. But it's not going to be automatic, it depends on the situation.