If my PC is in charge, why the hell should he be leaving to deal with Adventures/outside threats? He can't be away when he has duties.
But you see it in fiction. Case in point: Star Trek. Rather than the Captain sending out an exploration team, the most important people on the ship go on every single away mission.

(Dungeons & Dragons)
Rulebook featuring "high magic" options, including a host of new spells.