The planets of Realmspace, Greyspace, and Krynnspace in 2e Speljammer are also material, existing in a vacuum.
But other things, like ships and dragons, also carry an Earth-normal gravity plane and an atmosphere envelope. That‘s the Spelljammer “fantasy physics.”
That can still be the case in...