I have trouble taking seriously those who think that they get to tell me that my fun isn't good enough, for those people that aren't happy enough just doing what they want to do, but also want to make sure I am not doing what I want to do. That's petty and vindictive. That's somewhat human nature, but I think I'm optimistic about that, too: I don't think a significant number of D&D players will resent other people doing what they want, as long as they get to do what they want.
Sadly, there is no shortage of people playing D&D who evidence petty, vindictive, and just plain irrational personality traits--indeed, they often exhibit obstinate pride in them. We are talking about a game that is a magnet for the maladjusted. You don't have to look far to find DM's who don't care about other players' enjoyment nearly as much as they care about maintaining the integrity and sense of control they have over their world. They regard players who want freedom and options as if they were petulant, spoiled children.
How many threads now do we see in this forum where people proudly state that they want monsters to be "refanged" while players should be loaded down with restrictions? Look at this very thread, where the OP begrudges other character generation options besides random rolls.
Go look in the "Cast Raise Dead on a Game Element" thread. There was more than one voice advocating bringing racial class restrictions back. And why is it important for halflings to be stuck as thieves all the time? Well, as Lanefan put it:
Lanefan said:
If Hobbits in a given game in theory cannot be Wizards yet a Hobbit Wizard somehow gets played, the players see a Hobbit Wizard and may well turn around and want one of their own. Sure, 99.999% of the world's Hobbits can't tell a spellbook from a spatula, but if the .001% is all the players ever see in the party then that racial flavour - that Hobbits don't do magic - is largely lost.
He got a couple pips of XP for that rationale. In a completely straight-faced manner, the idea of two players wanting to play a halfling wizard is presented as a serious issue because it thretens "racial flavor". What do you think: in all likelihood, do the players in his campaign obsess over racial flavor to the extent they happily sacrifice freedom of race/class choice? Ultimately, who benefits from race/class restrictions?
I also think it's possible to have more than one cohesive structure for the game. You don't need ever-existing published lines for everything, but if what you do is re-release the AD&D 1e rules with a new cover and some new organization and verbiage, then production is cheap, the market exists, you can do a smallish print run, and call it good. You can then generate extra material for the rules modules that are selling particularly well, if you'd like to capitalize on their success, while letting the less-popular ones be more reactive.
When I played 2e, I was very interested in trying out the Player's Options supplements (Combat & Tactics and Skills & Powers), but I never found a campaign that allowed them. DM's provided various rationales, but at the end of the day, it was perceived as goodies that ramped up player power, and that was just plain unfair to the DM and his menagrie.
When I played 3e, I almost never got to play a prestige class. Had they been in the PHB, I could have played one because they would have been accepted--if only begrudgingly--as a core part of the game. But being an option, DM's shut them down because they wanted players to pick a fixed, unchanging pool of options.
Heck, in most games, I couldn't use point-buy or average out hit dice, so why should I hope for DM's to start singing kumbaya in 5e? It seems that once given a core set of rules, a lot of DM's will decide to fence that off make it all that's accessible. Many DM's assume that any options outside of core lead to power creep and excessive complexity.
Like most gamers, I don't have the luxury of getting the gaming group of my dreams. I don't want more cool, nifty rules that I don't actually get to use because they're sealed off the main junction. D&D, don't break my heart anymore.