Oh, right, got it.
I do think making the attacker specify a square is a good way around the problem, but it's tricky for the GM to run it fairly when you know where everyone actually is:
"When you attack a target that you can't see, you have disadvantage on the attack roll. This is true...