You're not wrong, and I've occasionally done this in the past, but in the moment, I don't always realize that this is when I should fudge a result. I also roll openly, so it's pretty obvious to my players if I were to fudge.
Anyways, it's a learning moment. Slightly new system (ToV), slightly...