I actually play a lot of humans normally, so I'm not sure it would bother me, per say, but at the same time it seems like you'd need a reason for this restriction in the first place, and that could sway my answer. Without that knowledge, I can't definitively say yes or no.
On another note...