Well, I notice the game starting to suck, look around for a way to stop the suck without fudging, and if the game continues to suck and I can't find a way to make it stop, I fudge.
That handles... 90% of the cases where I fudge? And I don't even fudge that often, so exceptions to this are...