You've never lost track of someone in a crowd? Narratively you are in a fight so it's not like you are just looking right at the elf. One moment he's there the next moment you lost track of him as your eyes drifted to another enemy, some motion you picked up out of the corner of your eyes etc...