I would not discard a wizard from such a game.
Instead I would go with a Tiefling wizard (higher dex), eventually trained in stealth (though they will already have a decent stealth score as it is). Feats: Hellfire Blood, Leather Armor, Improved Init, Skill Training: Stealth. I'd probably choose Scorching Burst and Illusory Ambush for at-wills, Burning Hands for encounter, and Flaming Sphere for Daily. You will have a good AC, good damage output, and good selection of stealthy options.
A wizard's cantrips can be very powerful tools for a stealthy campaign. It's useful to be able to at-will: whisper in someone's ear, telekinetically move 20# of stuff, create an image of anything they want to show the party, light up a foes area while keeping your own area in the dark, create a distraction through ghost sound, turn a hand-held object invisible, and many other cantrip-generated tricks.
No other class can utilize that wealth of stealthy tools at-will. Leaving the wizard out for that kind of game would be a mistake.