Probably not too valuable, but I thought I should add how I handle Passive Perception:
Initially I considered handling it like how JC suggests, but I realized that even without Expertise, you end up inflating the DCs just to keep things you don't want your players to automatically know hidden...