Whereas I have no problem with most players like that. Sure, if you had a table of nothing but passive players it might be a problem. I've never actually seen that happen, but it's probably happened to someone, somewhere.
I've had many passive players over the years and I've rarely found any of them to suck the energy away. They don't tend to drive the game much, if at all, but they're happy to participate, cheer on the party, and follow along with whatever cockamamie scheme the more active players have devised. There's nothing wrong with that. In fact, to some extent you need that. Too many strong egos at the table can grind the game to a halt while they debate their next course of action (sometimes for hours).
I can only think of one time when a passive player actually caused a problem at the table, and it was because that player wasn't so much interested in playing as hooking up with another player. That, I'll admit, can be an issue: when you're at the table for reasons other than to have fun gaming.
Overall, however, I have nothing against passive players. IMO, it takes all kinds of different personality types and gaming styles to make up the ideal group.