Not really. In RPG terms, "cosmology" is "how the universe is ordered."
So, in D&D, that includes what a world is like, what all the various other planes are like, how they inter-relate, their interconections, and so on. It often includes some elements of how magic works, how gods operate...