That's not the issue though.
The issue is that the words are being appropriated and then applied to pretty negative elements.
@Doug McCrae in this post (adding link so people can see for themselves)
Mana, Shamans, and the Cultural Misappropriation behind Fantasy Terms illustrates nicely that the only Monsters with Shaman's are primitives, savage and evil. I mean, why shouldn't elves have shaman? Wouldn't a shamanistic tradition fit best with elves? But, elves have clerics. And they certainly aren't depicted as primitive. So, obviously they can't have shamans because shamans only belong to evil, savage, primitives.
See how it becomes a problem?
Or, instead, people are capable of recognizing bigotry and racism, even if it's not specifically directed at them and have realized that the bigots and racists of the world depend on the silence of the majority in order to spread their brand of hatred. That regardless of who you are, what color you are, where you come from, when you see racism and bigotry, you call it out and bring it into the light where it squirms and dies.
OTOH, aren't you judging people by the color of their skin by claiming that they aren't allowed to call out bigotry that isn't directed at them? You don't know. Maybe their mother or father is a BIPOC, but, you can't tell by looking at them. Or their wives/husbands, children, friends, neighbours, are all people who ARE affected by racism and they're rather tired of being told that they have to sit off to the side and aren't allowed to have an opinion just because of the color of their skin.