Yes, this is a very encounter dependent ability. It won't do as much as the Barbarian's range against focus fire or the Rogue's uncanny dodge against a single large attack. If, on the other hand, you're getting attacked once or twice per round for a small to moderate amount of damage, its likely...