As I mentioned before, it could be used to level up low level NPCs so they can adventure comfortably with the party.
Also other down-time options are do things like: make magic items, run a business (and hopefully make money, gain reknown, gain inspiration, etc.
You could say the same thing...