I hadn't given this topic much thought because I gauge options based on the campaign, group, or game I am planning to run. And I never consider options from sourcebooks as wholesale. For example, I don't always use optional rules in the PHB, like feats or multiclassing.
Or, if I want to run a game in a setting where arcane magic is forbidden or feared, I might not allow certain classes for players.
Conversely, a player might want to use a subset of options from different sources that I don't own but would make an interesting idea for their character, I may allow it if it is appropriate and in-line with the parameters of the particular game we are playing.
So the idea of allowing Books A, C, and X just seems like strokes much too broad for me.