No matter how small, fudging can disrupt immersion. You should only do it without the players' knowledge, if you feel it's called for. That said, there are naturally some things which call for it, and in a general sense it is not cheating. What's so bad about it is the disruption to immersion, not so much any question of fairness.