I wouldn't be getting Armor of Shadows until 5th level of Warlock, because I'm not sacrificing Agonizing blast, and the Tome is part of the point of the build.
I know you're iffy on how many wizard levels I should take (which I am honestly debating), but when would I take that first level of...