Yes, weather, forced march and diseases are the main source of Exhaustion. I just don't get it why you're taking like it's something super rare to occur. In my current SKT campaign, Exhaustion is always a real threat, except during sessions when the party is hanging out in a civilized area.