You could merely have a minor advantage or disadvantage, so you roll a d6 for example, a 50/50% chance to gain half again as much (dis)advantage. Say you have advantage against Phantasm, your Will save is 6 and you roll a 6, you now have +3 on that save, but if you rolled a 3 you merely don't...