We have 5 players, and have been a stable gaming group (or at least core 4 people) for about 7-8 years now (yikes, hadn't realized it was that long).
If one person misses, we game on. If two people miss, it's a gut call, but usually we'll either do a one shot, board game, or cards.
If three...