I really like this idea as well. I have one issue though: with a starting 10 wisdom score, and foregoing the wisdom save in favor of the constitution save, you're likely to fail many wisdom saving throws, which really is a killer.
If you just go wizard (bladesinger) mono-class, with...