Look: of course TTRPGs are a hobby, and there are more important things in life than our hobbies. But that doesn't mean that our hobbies aren't important, or that we can't have serious discussions about them. In my experience, the terms "elfgame" or "game where we pretend to be elves" are mostly used to shut down a lane of discussion by trying to convince people that it's not a big deal. The problem is that what you consider unimportant may very well differ from others. I see it as a cheap rhetorical move most of the time, designed as a tactic to demean one's opponents.