Another thing to consider is whether the Drow racial abilities are worth giving up 2 levels. IMHO, they aren't. If you've got a burning desire to play a Drow, that's one thing; otherwise, I'd suggest that you choose a different race.
Yes, the +2 to Dex, Int, and Cha are nice, and the SR is somewhat useful, but you will be giving up 2 levels in your chosen class (which hurts even more if you decide to stick with Wizard).
You will also need to spend a feat on Daylight Adaptation. Otherwise, you are blinded for 1 round every time you are exposed to bright light, and you suffer a -1 penalty to attacks, checks, and save while operating in bright light.
Drow can be played effectively at higher levels, when the 2 lost levels don't affect you that much. But at lower levels, which you are at right now, being only a 1st level character while your buddies are all 3rd will greatly decrease your usefulness and survivability. Your HPs will be dangerously low, with only a d6+Con while your friends all have 3HD worth. 3d8+Conx3, 3d10+conx3, and 3d4+Conx3 for the Cleric, Paladin, and Psion, respectively. The -2 to Con will make this even worse.
Let's take a look at a common CR 3 creature, such as a Gelatinous Cube. You and your buddies come across one while in a dungeon. You close to melee. On its turn, it slams you and hits. 1d6+4+1d6 damage. If you are extremely lucky and have a decent Con, you might have 1 or 2 HP left. If you are unlucky, you are dead. *Poof* One hit.
Just something to think about...