I'd definitely make him (and the party) pay for it. They'll be taking 3-4 times as long to run through a dungeon. I'd have monsters start mustering their forces and assaulting the party in waves.
Basically, yeah, if you let the player get away with this cheesy metagaming tactic, then it'll...