The restriction is simple, the DM sets the target number based on how difficult he feels the test in question should be.
Swimming: Trivial: No check normally required
Swimming in Plate: Nearly Impossible*: DC 30
*This is over-generous, but you know it's a fantasy game.