I was just discussing this with a friend and I think the real issue is that we don't enforce the negatives of dim light (and to a lesser extent monochrome vision) enough. Especially when dungeon crawling, disadvantage on those attacks and perception checks, and enemies having concealment can be very bad.