Bah, ignore them.
Drop the Wizard levels, take a Cleric with the domains of Knowledge and Madness, and then pick up Alienist @ level 6. :D See if you can talk your DM into letting you use the 3.0 Madness domain, instead of the overnerfed 3.5 version. If he's leery about the DC addition, just...