I've been tempted recently, with the megadungeon the group is currently working through, to remove passives entirely, or to change how passives work.
In the former idea, the PCs don't notice anything if they're not going, "I'm going to check that!" Tough cookies if they should have, and trigger...