Well, then by definition, the GM hasn't gone too far.
Your point is valid, as the arbitrator of the rules, the GM's ability to cheat is severely curtailed. But we're talking about dice rolls, and it's possible that there may be some groups out there where the GM has agreed not to fudge them...