You should always have confidence in yourself as a DM, to fudge anything, for whatever reason. Just so long as you are still fair to all of the players, and trying to run the game. It's a question of whether you think the game would benefit, and just that.