Absolutely this. I'll only add that the wilderness doesn't start at the edge of town. 'Monsters' have learned that hanging around settlements for any length of time is a Bad Idea. So occasional raids, yes. A tribe of Gnolls camped a few miles away from town, no. Oh, and roads are usually safe...