The only downside I've ever encountered with "table roles" (like Notetaker) has to do with rewards. Namely, if the GM gives rewards for those behaviors, and only one (or a few) players actively engage in them, they'll get more rewards than the other players.
Other than that, and barring the...