Like I said, the issue for me is when you whitewash real world settings, not when you have faux-[time/place] settings which don't have the same deep and horrific societal issues.
Like, if your characters are in a Victorian-ish, vibes-wise/aesthetics-wise but entirely fictional society/setting...