Exactly, in part because most of the time horses or other animals were used to carry stuff (or pull stuff) rather than riding.
Having animals also reduced actual travel time, because they needed to be rested, fed, and watered, and resting often meant relieving them of their burden as well...