No, it would not concern me. Honestly, I fail to see the logic behind the objections towards taking this approach, especially if you are taking this approach to explain or reinforce existing social or biological facts that exist in your world. If the vast majority of the armed forces in your world are male, why not represent the reason behind that with mechanics to support it?
It is a fantasy world, and Humans are just as much of a part of that fantasy world as any other race, or at least they should be. As such, if you do decide that gender differences exist, I highly recommend that you base those differences on the culture and biology of the Humans in your world, and not use real world comparisons as such comparisons do not mesh well with the D&D world in general. Many rules do not, in any way, accurately reflect real world physics, physical capabilities, mental capacity, or environmental conditions in any way.
As such, if you decide to make women weaker, and men more foolish/less commanding and forceful, that should be accurately represented in your game world. I would expect that with such statistic modifiers, men would generally be the physical laborers, soldiers, and thugs/enforcers of the world. Women, with the statistic bonuses, or at least lack of penalty to Wisdom and, more importantly, Charisma, would occupy most of the positions of leadership and administration. It would be an interesting society to model.
Of course, other mechanical sets are available depending on the society you wish to best model. The important thing to keep in mind while building your world with mechanical benefits to represent the simulation you wish to have, is that intrinsic abilities and advantages would shape the entirety of a races developing societies, economies, and so forth. A mechanical benefit indicates a natural advantage (and I personally recommend following the credo of no penalties, only benefits) that would color and alter the roles the different genders had, and have, not only in the current society, but in the beginning of that society as well.
You would probably want to decide the culture and biology of the other humanoid species when doing this, which would give you an impetus to further develop and detail those societies in your world. Since their biology would be truly alien, you would have a real opportunity to differentiate them from their Human counterparts, and make them more than "Humans with pointy ears and stature differentiation".
Essentially, most races that exist in the D&D settings are portrayed or run as Humans, with a different social structure or set of values, but lacking in any truly alien or unique qualities to truly separate them from Humanity. The closest any race has ever come to such representation is the Elves, with different eating, sleeping, and reproductive habits, yet the impact of those differences is virtually never represented in the culture, attitudes, and nature of the Elves themselves.
Also, I would agree with earlier posters that you should not use odd statistic modifiers, as that is simply inefficient design. I actually think doing this could lead to great world building opportunity, as you could truly change the way races and genders are represented mechanically to reflect the realities of your world. Of course, it's up to you whether or not the effort would be worth the time.
