As its name suggests, the Astral Sea physically manifests itself as a great sea of shimmering starlight and ethereal mists surrounding the material plane, with other "sub-planes" existing as "islands" (usually a lot bigger inside than out) floating in the Astral, alongside other various planar detritus. Originally, it wasn't going to look like this, but when the Great Lattice of Heaven was shattered, everything was broken, leaving it in its current oceanic state. It is a realm of thought as much as physicality and home to the Gods and their Astral Dominions as well as other entities. There is no passing of time within the Astral Sea and movement is dependent on the power of though. Likewise gravity doesn't truely exist, only Astral Dominions and the world pulling one towards it, resulting in flying ships and other magical phenomenon.
Astral Dominions
Adrift the Astral Sea lay among other places of interest the many domains of the Valdovan Gods. To the onlookers of the world they make up the constellations of the night sky. Between the vast and near endless expanse however lie smaller domains and remnants of past creations home to strange creatures.