That’s one way of playing, and I guess that might be an interesting way to play. I’ve played and enjoyed board games that operate on similar principles.
However, as a general rule I don’t want to play and procedurally generated adventure. We play with a DM because that way we always win that random bet and get an interesting and fun encounter. The DM doesn’t waste our time with repeated chaff encounters and doesn’t wipe us out with unlucky ambushes piled on to already tough fights.
Rolling a dice as an means of inspiration because the DM wants a prompt is one thing. Being enslaved to the dice because they are somehow a check on DM tyranny and purer than a DM deciding what the next encounter is, is alien to me.
We trust our DMs will keep the game fun and when I’m DM my players trust me. I don’t think I’d want to play it any other way.