I've backtracked on occasion for one or two things. I've misheard a player when I asked for a Fort save before, and hit him with poison effects only to discover later (from all the players, not just him), that he said 17, not 7 on the Fort save.
We didn't change the combat at all, so didn't backtrack that much and he was still Str drained for that effectively, but there was no lasting effects of poison as a result.
Other than that sort of thing, I don't really backtrack. I'll allow a player to backtrack within his turn (so long as no dice have been rolled etc) but that's about it. Generally I think it's ok if we're talking about a mistake (such as the See Invisibility situation above) and it's that quick.
If you're three combats later then clearly it's inappropriate