The downside of this is when you get a quest, and go outside the city with your party, you don't have 2 billion other people running around competing with you for the same quest. Once you are outside the cities, you are in a world to yourself. The cities are the only true community spaces.
