Interesting point about the pressure dictating the design. I'm going to have to think about that for a bit. The pyramid design is based on gravity as the primary pressure. The pressure in this case would be from all sides. Spherical would be a good one. hmm.
Upcoming outburst of potential semi-useful information:
Also a D20 shaped or honeycomb patterned walls would work well, there's a company near me that I went to that as part of an engineering class that makes blocks of stuff that has hexes that go through a block of foam or aluminum, making it extremely resilient to pressure from that area, it is mainly used in cars, airplanes and boats but still very light and there are versions of it that are very water-resistant and won't wear down like steel will as described in the second paragraph in
this article. their website is
here if you want to look at some examples. For example aluminum, stainless steel, etc. maybe technological advances that would occur in that time would allow a larger grid that could be used for windows. Of course if you want to just have normal walls and windows, that works too, maybe the walls have the honeycomb inside of them or something like that.
I'm just spouting out ideas of how to make it work possibly IRL if you were to try it, you can do what you want in your game, as it does not have to adhere to reality, but these, I suspect would appear somewhere.