For fly, swim and climb movements there are differences depending on race, class, subclass, feats, magic items
For example a 3rd level Rogue Thief can climb at their normal character speed - instead of half (they also get to add their Dex mod to their high jump). The Athlete feat also provides...