All this talk of probability of critical fumbles is off topic. Yes, a great swordsman who fails 5% of the time wouldn't be a great swordsman.
But you need to look at it a different way. In combat many things are going on (rarely a one on one affair), it isn't just that the swordsman screwed...