Don't let players game advantage and disadvantage too much. Forget about the RAW statement that numbers don't count (i.e., advantage from one factor cancels disadvantage from 15 factors). In your role as DM, look at the situation as a whole and decide whether someone has a significant advantage...