Some games do well with smaller groups, especially the more social based games. My L5R group ran best with only 3 players, and the addition of the 4th began to push one of the players to the side. Other games do well with 4-6 players, such as D&D. I've ran some huge games (13+ players), but those are best as one-shot games with limited scope.