It's not offensive to me, personally, but it is just plain wrong.
First of all, to get the offensive bits out of the way you will have to face the fact that gender differences of any numerical sort in an RPG are a big no-no in our society. Maybe we're a bit touchier about it than we should be but you will never be received positively if you do such a thing or even suggest there's a difference aside from cosmetics in gender selection in a character.
Secondly, I find the stats you chose to be...unfitting at best. If I were going to stat Male and Female Humans differently in D&D that's not the way I'd do it.
Firstly, why do females get +1 Wisdom, +1 Charisma? +2 Wisdom seems much more fitting, and +1 Charisma? Charisma is force of personality and personal magnetism, alot of people when joking about stats for female chars mention charisma or high charisma, but the stat is not 'omfg boobies' or even looks, and it's especially not 'women are pretty, therefor they can intimidate and cast Sorceror spells better and make better paladins and diplomats'. Doesn't quite groove.
Your other problem is you're assuming that the Male is the neutral archetype, and Females are deviating from it by giving them gender distinctions in attributes where the males have none. That's just silly if you're a simulationist, it is the opposite. Women are more common, and the female body is the template that the male body devises from.
If you were even going to consider this, you'd need an even distribution between genders, of an even number of points...
Now, I would personally not adopt such a thing into my games, but if I /were/ to do it, it'd look like this:
Female Human
+2 Dex
+2 Con
+2 Wis
Male Human:
+2 Str
+2 Int
+2 Cha
My simulationist reasoning behind this:
Females are more flexible, their bodies are lighter, and they tend to have better co-ordination with their hands. (Most things effected by Dex thus make sense to be a bit better with a female.) Females are more resistant to pain and trauma physical or otherwise despite other factors, and they tend to live longer as well. Females are also generally more socially alert, able to judge character and situations better, and have more practical and inter-personal knowledge.
Males are stronger, they have more muscle mass, about 1/3 more in the upper body but less in the lower and are generally more developed. Males are generally better at math and abstract reasoning, logic and strategy of a wholly mechanical bent. Lastly, Males tend to be more physically intimidating, as well as have a stronger presence and are more able to get their way by pushing with aggressive diplomacy and active means, rather than understanding. Both men and women would often rally behind a strong leader figure who feels like a father.
Only a few of these are biological, more than half are cultural, but D&D is based on the modern western cultural ideal, so there you go.
There are no penalties. Instead, each sex has a higher range in 3 attributes than the other, and can get a 20.
As offensive as those are, they're the least offensive way to do it if you want to do something like that.