You're half right. Spelljammers can only reach spelljamming speed when they're in an area that doesn't have an object's gravity field slowing them down. The most obvious place for this is wildspace, but you could have it in places like the Astral, Ethereal, possibly the Elemental Plane of Air, etc. There's no reason it can't fly at tactical (normal) speeds anywhere though, even other planes.
For a nice example of a spelljammer being used (if only briefly) on the Outer Planes, check out the novel Tymora's Luck. That said, it is pretty much the only example of a "traditional" spelljammer (as opposed to a Voidjammer or an astral ship), other than the bit from In the Cage, outside of the Prime.