the following occurs after each press:
Red: the die all slide along the surface of the dais counterclockwise, retaining the pentagon formation. they stop in the below position.
...
Blue: the two die nearest the blue gem both tip and roll, now showing the "2" face.
...
Yellow: the die nearest and the two die furthest from the yellow gem all rotate and tip, now showing the number higher than they had just shown:
Once I figured out that the numbers can change, I would probably leave the room to search the rest of the dungeon for clues to what the correct number sequence is. You really haven't even it made it clear to players that this is supposed to be a puzzle, except for the fact that you told us outright in the first post.
If leaving isn't an option, the puzzle becomes a bit of a button mashing exercize. Since we have no clues as to what the number sequence is supposed to read, I would basically just start fooling around with number combinations. All 1s, all 2s, all 3s, 11223, 33221, etc, etc. I'd make the wizard in the party roll an intelligence check to do the sequencing, rather than walking through each individual button press.