So far, my main concern is that you can't cast stuff like silent image in combat any more. Sure, illusions and such are hard to adjudicate, meaning that the effectiveness is very hard to judge objectively, but you lose some flexibility.
I can see it pretty easy to create new Wizard spells of...