That's a valid point. I think it varies group by group. If, for example, your gaming group is primarily composed of friends then that's less of a concern. You'll hang out and game with a wider variety of stuff, probably. As long as your get to hang most people are cool.
If your primary group...