If you're going that route, be sure to be a cloistered cleric from Unearthed Arcana. The extra skill points, added domain & spells, and lore ability are worth the loss of a few hit points, points of BAB and weapon/armor proficiencies.
Besides, as a cleric/wizard, you're strength lies in your...