So, admittedly putting words in your mouth, this strikes me as an argument for introducing "threats from beyond" at higher levels. When the PCs are 1st-10th level (arbitrary threshold), there is an equilibrium among the NPCs of the world. The pirates, thieves guild, wizards' guild, rampaging...