While I agree with this premise, they also don't know the guard's bonus. On top of that, if you wanted to roll without players eyeing the die, just roll close to you. I mean, are your players actively trying to look at your rolls?
Again, I agree with the premise. Some dice rolls are better...