The -2 to con is significant problem for elven casters but it's hardly insurmountable
Assuming an Elite array the Elven Wizard will likely have a -1HP/level, a slightly worse Fort Save, a slightly better Reflex save, a slightly better AC, a slightly better chance to hit with ranged attacks...