Man, I feel for you. I have a similar issue myself. I've got 8 players right now. 8!
It's hard balancing encounters too, because upping the CR isn't always possible, and just increasing the opponents isn't always easy either, depending on the adventure site, especially if you're dealing with...