Where you in a small party of 4 or five, cut off from all communication of thing went wrong and subject to attack from monsters that would rat your face. Somehow I could imagine that, that would somewhat stressful.Why? There are people all over who live off-grid and have a lot more stamina than I do. I used to do 10 day backpacking trips with no stamina loss as a young adult. Living in the wilderness is not, by itself, particularly taxing if you have experience doing so. And an adventuring party in a fantasy settings probably does, or can learn it quickly if needed.
That is fair enough, I just have a dislike of rules that just hang there, like the exhaustion rules, with little actual application.That is the opposite of what I want.
The reason people like fast travel is to avoid the annoying, stressful parts. DMs like forcing it because they think it's dramatic.