My group runs Perception by the book and it's never been a problem. There's always at least 1 PC without darkvision, so the party always has a light source. Even in a recent campaign when we had everyone with it, we still kept using a light source normally.
Technically the bolded part isn't RAW, but a carryover from 4E. It is Jeremy Crawfords' interpretation, but the books never actually detail how to use Passive Checks.
I use the Mike Mearls method, where the DM rolls against the Passive Score, using 1d20+DC-11 when no modifier is given. It avoids the problem of comparing static scores against each other (meaning the DM determines success/failure during the adventure writing stage) and prevents characters with high Passive scores from automatically succeeding every time (even though they will succeed most of the time).