I think its a mistake to assume that the Battlerager isnt going to be wearing scale and using a heavy shield, just like other fighters. Looking at my own game, im just trying to balance a +1 to hit versus temp hp every round in many fights. The scalemail + shield battlerager is just as hard to hit as any other Con-based fighter build.
You can even go with plate and shield. Since you qualify for it anyway, why not. That's what I did with the Dwarf I tested out. With Plate, Toughness, and Dwarf Stoneblood, your enemies had better bring ATGM's.