I agree, but in the grand scheme of things having the lower touch AC, much fewer hit points, lower saving throws, and almost no skill points (probably 1 per level) should equal it out. He's more suseptable to spells, can take less damage, and gets hit more.
Being two levels behind can suck. A first level half-ogre with 10s for stats (before ajusting) would have 2 feats, 12 hit points, have an 11 AC, have a +0 will save, 4 skill points, a + 4 to hit, and do 2d6+4 damage with a two handed sword.
A 3rd level human fighter would have 5 feats, 27 hit points, have a 10 AC, a +1 will save, 18 skill points, a +3 to hit and do 2d6 damage with a two handed sword.
The half-ogre does a little more damage, 1 better AC, and has +1 better attack, but has less than half the hit points, a lower will save (and other saves), and 14 less skill points. Of course there's darkvision but that doesn't usually matter too much in combat.
It seems pretty equal in the end.