I agree with that. Magic does a lot for you, and easily too. That is part of why less magic can be fun, it makes things harder.
When you have Fly, Invisibility and Knock you can completely bypass what could have been a session of planning and infiltrating a location.
I'm not saying its worse...