I bring one of Paladins dice bags that holds 4+ sets. I pull out the dice I need for my character's abilities and put the rest back in the bag and place it off the table. If I DM, I have 2-3 full sets out. Where we game now, we are tight on space so extra dice just get in the way.