That would work as a way of speeding up encounters, from my personal experience I have ran a campaign where everyone does double damage which makes minions a threat etc and it significantly reduced encounter lengths. My team survived the double damaged encounters, so I would be surprised if your group had a massive problem. Obviously it is different from what I did but generally:
very short combat encounters
players healing is much more important
solo bosses are fun again
minions actually get scary as opposed to trash that players are pleased to see.
As a whole, I would reccomend doing something to increase damage, as if you are DMing it can get really dull sitting their waiting for some brute to eventually die.
Cute-Hydra