A paradigmatic example of what I've been saying this entire time that some people don't seem to understand.
I'd say that some understand, but don't follow your point. They agree with the idea that some degree of cultural appropriation is OK, with varying criteria of acceptability. Some that have been explained here are :
a) you do it respectfully (no ascribing of bad qualities to something that is sacred in a culture and vice versa)
b) you can somehow claim this culture as your own (broadly, US writers claim Medieval European folklore)
c) the culture is extinct (which is also problematic when some current culture considers to be heirs of the extinct culture...)
d) the culture is not prejudiced against or is doing well enough.
There are also those who have no problem with cultural appropriation, claiming that cultures are humanity's shared heritage, and those that would say that absolutely no reference are tolerable. It's a spectrum of opinions, none of which is intrinsicly true or false. "I feel that using this word is wrong" is much like "I feel that pinapple pizza is wrong": you can't "prove" it or rationalize it.