I actually use downtime, retroactively, so that players get to use it "behind the screen" in a way that kinda fits the narrative--I also allow this, IF they have allies, cohorts, or followers that may help them to actually occur somehow. Importantly, we do keep the game going with some "jumps"...