Vehicle speeds are an abstraction that's carried over from edition to edition meant to give a value that takes various factors into consideration over a long-enough period of time. It's so that you can check a map and see that it's a 100 mile journey from Port A to Port D, and not have to worry about figuring out how much time was spend in dead winds, docking at other ports for cargo (most captains aren't making special trips just for you), sheltering from storms, evading dangers, etc..
For large ships, if you want to reflect a perfect voyage with good winds and no other stops, you could probably multiply the speeds by 4 or 5 to get actual 'best case' scenarios.
Rowboats seem ok, to me. Those things are slow as hell for one person to propel for very long.