Swarms don't need to see their target to attack it. Swarm damage is automatic and not subject to concealment or cover.
Upoin re-reading the MMI swarm entries, I modify my statement to say that upon further reading the swarm info, most swarms would attack an invisible target. Thanks for the clarification.
The entry for most of the swarms read, in part, "...Swarm seeks to surround and attack any living prey it encounters...", if the swarm has a method to destinquish that the object it cannot see is in fact living prey, as opposed to a rock, a pool of water, a tree stump, etc.
-A Rat Swarm with Scent would be able to identify a living target it could not see.
-A Bat swarm with Blindsense would attack an invisible creature, however Bat swarms only attack warm blooded targets as per the text.
-A Spider Swarm with Tremorsense would detect any invisible target that is moving, but not one staying still. I'd imagine a target that succums to nausea would move.
...so the only exception would be an invisible target, not nausiated, subject to a spider swarm.