Because it's a finite market, and the market isn't "D20/D&D", it's "roleplaying games."
So if you glut the market, some segments are gonna suffer. The D20 boom was an interesting time, with major booksellers actually stocking companies like Green Ronin, Mongoose, and Guardians of Order...