Something we once tested in our games: when you used a skill passively, we considered you took a ten, just like AC.
You only rolled when you actively used the skill.
So if anyone wanted to hide from you, he rolled his hide check against your spot modifier + 10. Same with Listen, sense motive...