Generally, the followers are off camera, or back at the home base, or someplace safe.
If they insist on bringing the followers with, a fireball or two will clear the field back down to a manageable size. And also give them minuses to their leadership score (caused the death of followers), so...