IF (and that's a big if) you think they are that powerful, the only reason to ban them is if you want M.A.D. to come in to play or limit character classes. Without them, Assault Swordmages, Tempest Fighters, etc. all take major hits at low levels. It's almost like banning those classes because you feel mechanically their (and as defenders the party's) survivability suffers. Also, you're dictating that a character have not just a weak, but a pathetic NAD to target. Also, it basically dictates what weapons they can take. For example, suddenly that fighter has to:
a) pick a strength primary race (or dwarf), preferably a Warforged or Goliath (oh, wait, some ban Warforged too, and Genasi)
b) spend the 16 in strength pre-racial (or don't plan on hitting nearly as much as any other character because...)
c) pick a hammer or axe (because you need to spend points on Dex for blade feats)
d) Take one of the weapon talent builds (the others won't let you hit enough)
..... you get the picture.
Again, they don't get extra surges, so the bump isn't major. The Wardens, Shielding Swordmages, etc. all still have far more HP in reality