This could work, but you'd have to use a fair amount of traps and puzzles or other interesting pseudo-encounters.
You could use varied, highly-detailed rooms/tunnels, perhaps with frequent secret doors, to make up for the lack of encounters as well. PCs can spend alot of time in huge rooms...