INT isn't just damage and AC though - its also to hit with your spells and your save DCs. You're a wizard first, so I don't think that you can really afford to not max that. And DEX is definitely more important than toughness: AC, initiative, dex save, to-hit with your weapon, and weapon damage.