Solving this problem is actually fairly easy--just lower the hardness of armor. Armor isn't exactly as good as a block of the metal, anyway--it has rivets, straps, and open spaces that can be moved out of the way.
And, of course, the goblins et al can still disarm, grapple, and sneak attack...