I think if you are running an old-schol/sandbox enough game (like PCs are regularly up against challenges that should get them killed by any sane measure, period) I can see it.
Like my level 1 thief is trying to kill a stone giant. The giant is standing on a field of loose cantaloupes cleverly released by the thief: disadavantage.
Then the thief manages to get the giant drunk: double disadvantage.
The thief is still very likely a smear if the giant hits, but suddenly it's plausible, reasonable, exciting, and promotes clever gameplay.
I wouldn't give double advantage/disadvantage just for piling on spells, though, it has to be a use of the environment that can't just be done at will.
So you favor Rogues over spell casters?
