Wait, so ray of stupidity/idiocy (2nd level arcane) will drop the entire swarm in one shot, sans save? What?
Is it like Ray of Enfeeblement, except for Int? Does it have the limit of not dropping Int below 1? If it's a mind-affecting spell it'll work on the swarm, but I don't know what its effects are.