No. It can be fair even if chance are not 50 - 50.
When you talk about a fair coin, yes.
When I talk about playing fair, I can play chess against someone 200 points higher and still win fairly, although my chances are lower. In DnD I want to just take away his queen, if he looks away.