In the context of Robear, probably not. But I can't agree as a generalized principle that we need concern ourselves with only physical harm.
Well as you note, there's other kinds of harm. But there's also people being so thin skinned they think everything is an offense.
Apparently during Shriver's speech, one audience member turned to their parent and said (it was quoted in a follow up retort by Shriver) "Mama, I can't listen to this."
When a person can't even listen to a person with an opposing viewpoint who isn't insulting races, genders, or whatever some other protected group I can't think of, then I think the problem is the listener, not the speaker.
This is the crux of the absurdum argument, where someone takes it to the extreme and says "I want to avoid this extreme, so I won't budge"
The problem is apparently we really do have actual examples of extremism on this cultural appropriation thing. So we've gone from telling white folks "hey, don't say the N word or dress up in blackface" which seemed like a good idea to stop doing to apparently actual schools forbidding dressing up for Halloween. Actual authors chastising other others for writing fiction with characters that aren't the author. Models being scolded for wearing fashions (that they didn't design) incorporating elements from other cultures. Foods being disallowed to be served to certain races (like sushi).
There's being polite and choosing more diplomatic words and being respectful. Then there's being expected to know every sensitive topic and no-go territory so you don't violate a Safe Zone or commit a Micro Agression like wearing a Police Lives Matter shirt in the grocery story in front of a black cashier (true story, I had to explain on our neighborhood forum how a BLM person might take offense to that). People do NOT know everything that is offensive to everybody else.
So where we are headed is no role play, no fiction, no comedy, no fashion, no music. No culture. Because all of these things violate somebody's absolute right to no be exposed to something that offends them or incorporates culture or ideas that are the creator's own.
Unfortunately, there really are people who are trying to guide us toward this absurdity. Rather than sucking up that they might be exposed to something, and have to tolerate it. Because Tolerance is another one of those skills we were supposed to have, along with Consideration. It takes both, not all of one and none of the other.