Regardless of gender, proving harassment should be done by law, not public opinion and justifiable outrage. It is wrong to blame and do to women, but it is just as wrong to blame and do to men. Everyone deserves a chance to defend themselves and we should not make such things into modern day witch (or warlock) hunts. I know victims as well, on both sides, and "getting some pushback" is never a good thing.
Just something to think about.
Here's the thing. By the very nature of such things, sexual harassment is very hard to prove. It usually happens when the perpetrator and victim are alone, which means it turns into a he-said-she-said thing. And that means there's reasonable doubt, which in turn means it's almost impossible to convict someone of it.
But I'm not a court of law. I can still believe in one of the parties over the other without overwhelming proof. I can definitely do that when there are multiple accusations. And I can then choose not to associate with the alleged perpetrator, or in some cases not spend money on things he has been involved in.