If you claim not to fudge, and you do fudge, you're cheating.
If you never make that claim, it's less clear but I tend towards "let the dice fall where they may". If you know what outcome you want, don't roll for it.
If the party's imbalanced, find a way to deal with that that doesn't involve...