While in history villagers that did not have adequate Protection may have feared roving groups of armed men the way I see most D&D worlds I’ve Played in or run bands of mercenaries or adventurers aren’t what towns are worried about. It’s dragons, giants, goblins etc.
The towns have guards to...