Exactly. As your party gets higher level, their ability to dictate the pace of the adventure improves.
My group would laugh at the idea of random encounters at night, wind walk miles away, throw up a Magnificent Mansion, cover it up with a non detection spell, and rest when they feel like it...