Agreed -- I think.
I've pretty much come to the conclusion that Passive Perception for secret doors, traps, etc. is a just plain stupid idea -- if you want such things to have any variance, whatsoever. It's a good solution for things like stealth, where only one side actually is intentionally acting. Lying works similarly with passive Insight. Even then, it doesn't address a case like where a guard has reason to be intentionally searching, but rolls a 1, so gets a worse result than if he'd been just playing on his phone. In that case, the idea that the PP is the "floor" still sounds bad, but may be the least bad option -- the PP determines whether surprise occurs, but a successful intentional check could allow the guard to turn the situation around and trick the sneak, or otherwise be more prepared than just "not surprised".
For situations where the character needs to be intentional about an action, like searching for a secret door (unless you're an AD&D elf*), passive checks don't apply because the character isn't being passive. I don't understand the argument about repetitive searches down a hallway and the like. What I've done since 1E is to just roll one check per area (however you want to define that). That doesn't mean a check for every 5' section. It means you're just rolling the one relevant check. If there are more than one thing to find in an area, then you just need to know whether the character is working left-to-right or the other way around. The roll is for the first "thing". If they find it and want to keep searching, roll again. Actually, I grab a couple dice and just know what order they apply: red, purple, orange is my current standard and I don't ever remember needing more than two, let alone more than three. I also make the characters actually say what they're willing to move/touch, with the understanding that there is the potential for contact poison, tripwires, magic sigils, etc. If they want to ransack the room, then all secrets and traps are on the table. Passive Perception just doesn't provide enough benefit to justify using it for intentional activities.
* If you want to emulate the AD&D elf, I'd say add a racial ability that they can find secret doors using PP. I'd do it at disadvantage, but YMMV.