Agreed, the high levels are far less predictable and require good improvisational skills, particularly for a group with magic users. At low levels, most classes rely on their at-will abilities, so it is easier to plan encounters ahead of time. But by the time even 4th and 5th level spells come...