I haven't run it or played it that way, but I imagine it would be just fine. But you'd be missing part of the magic. I think it would play about the same as any regular dungeon crawl module.
For best effect, I'd run a group of NPC adventurers behind the curtain, and have them communicate with the stones with the PC group.