In D&D 5e games advantage is a killer of horror because it gives confidence and reduces risk. The solution to that is to start with disadvantageous circumstances and make the party work just to get back to normal.
Don’t take away their ability to do things, make it so their ability to do things...