I meant to write about that but forgot. With my +5 example a -2 penalty is about right. But if the stealther is +7 versus the opponent, it doesn't balance out. However, you might find it's close enough.
If you want to use passive checks to save time, then it would be quite impractical to...