When I was a teenager, I would get ridiculed and then punched for playing the game. However, that's unlikely to happen anymore, so it's no longer a factor.
Now I've never had any sort of RPG blowback at work, but then I usually talk hockey or movies or music or whatever common ground there may...