Ya, every hinderance would apply, Madness, Overchanneling, and the like. I just think that the sorcerer is quite bland.
Now to the balance factor, the Wilder may get a d6 HD, 4+INT skill pts, and light armor, but he also (if male) incures the madness, overchanneling, and lowered selection of...