I think that you can probably survive without a leader, though I would strongly consider playing either a paladin, a warlord, or a STR cleric if I were you (that's either a healing defender, or a leader with some melee ability) instead of the swordmage.
My concern isn't with viability, but I...