The problem is that for some women, it has mattered because they haven't been able to be taken seriously either at a game table or by the marketers of a gaming company because of their sex. My wife ran seminars a few years ago about women in gaming (open to both men and women) where people talked about their experiences. And there are significant numbers of women gamers who have had issues come up because of their sex.
If that has not been your experience, count your lucky stars. But that's the way discrimination sometimes works. Some people experience it regularly, some occasionally, some not at all. And the people who do experience it often have trouble convincing the people who don't experience it that it is a real and valid problem.