At the level I would have been fighting Ogres, the character would have had a base AC of 15 (Studded leather and Dex 17) and with Bladesong the AC would have reached +3 (Int 17)
So the Ogre would have been hitting on rolls from 12 and up.
From the numbers I am looking at on FantasyGrounds a purple worm has +14 to hit so it hits AC 27 on a 13 or better
So, by my calculations the Ogre can only hit on criticals, the Purple Worm has a 40% chance to hit AC 27 (Which is the Shielded AC), the same as the Storm Giant, the Ice devil has a 19% change and the Iron Golem a 35% chance, a +2 to the Bladesinger's int would drop all of these chances by 5%
Against Bladesong (AC 22) the chances are; Purple Worm or Storm Giant (65%) so for about a third of the hits shield will be useful, the rest get through.
My point is that hits will get through and that is it a nontrivial cost. You have a base of 4 slots, I would hesitate to use second level slots and then you are blowing a lot of your Arcane Recovery into shield. A lot depends on the number of combat rounds per working day.
I think that is where a lot of the experience differs. It is not just the number of combats per long rest but the rounds in combat. or the number of rounds before an opportunity of a short rest.