Letting one player annoy the rest of the group is a surefire way to ensure the group implodes. The other players already, seemingly, resent the dice-rolling player, soon they will resent you for not doing what a DM is supposed to do and stop annoying behaviour. Tell die-rolling man it isn't...