I think it shouldn't be viewed as a stigma, and if it is, then it is the viewer who is lacking, not the gamer.
I'm not 30. I don't have any fantasy/rpg/game-con type shirts. I am married, and don't have facial hair, and I don't live in my parents basement.
I also don't mind anyone else who...