Didn't happen often, but if it got out of hand, a monster with lots of hit dice would mysteriously show up. That quieted things quickly. (:
Of course, the annoying parties are the ones when one guy makes a suicidal move and the others, in the spirit of group harmony, do likewise. But that's...