Wouldn't they both have disadvantage until one person hides (making no sound or sneaking in the dark) as an action. That person will then gain advantage, canceling out his disadvantage, whilst the other would still have a disadvantage.
Makes sense to me.