Apply the existing rules. Constant disadvantage for perception is a thing right? It would be worse if you are on unfamiliar ground. I know not to walk “back there” but an intruder does not.
Also, what about a mixed party? If you walk ahead, alone to get the benefit of dark vision…cost...