If I appeared to be making a fuss, I badly miscommunicated. I have no problem with the DM determining what happens in the PCs absence or the state of things upon the PCs' arrival.
I agree completely. It's a choice and it's agency. In D&D games that I run and play, the consequences of that...