I remember when the refrain used to be "adventures don't sell, because only DMs buy them." Now we've apparently come around to "player options don't sell." Soon the circle will be complete!
All joking aside though, ever since the Hasbro era of D&D began (i.e. 1999), the idea that any iteration of D&D hasn't "maintained profitability" has gone out the window, because Hasbro's target has never been simply taking in more money than they spent. Rather, it's about ROI (return on investment). D&D has always been profitable in the Hasbro era, but it's rarely been profitable enough for its corporate overlords.
I'm not a business executive, but I'm given to understand (mostly from a Gen Con seminar I was at several years ago, where James Lowder spoke about this topic) that corporations of Hasbro's size don't judge ventures by whether or not they turn a profit, but whether they turn enough of a profit to be worth their time. If they're only earning (my random example, here) $10 for every $1 they spend, then whereas you or I would think of that as wildly successful, they think of it as a failed investment, because that $1 could be earning them $100 somewhere else. That's part of the reason why they eventually shuttered the novels division of WotC, which was earning more money than it spent at the time it was closed down.
As for whether or not there's a segment of TTRPG players who will consistently buy crunch-filled supplements, we already know that there are, and that it's sustainable: that's how Paizo stays in business. If they've been able to keep themselves going for well over a decade (sitting as the #2 RPG company in the business for almost that entire time by most accounts) using that model, then it's clearly not unsustainable or lacking in profitability.
Really, Paizo has overturned a lot of "conventional wisdom" in the RPG space. They have multiple lines of prefab adventures, proving that adventures sell. They put out consistent crunch-heavy books, proving that there's a market for them. And they kept 3.5 alive (counting PF1 as a form of 3.5) for over a decade after WotC moved on from it, proving that there was a significant portion of the player base who liked that system and didn't want to let it go.
WotC's leaving 3.5 behind wasn't due to any issues with the system, or with players deciding they were tired of the game. It was because they (WotC/Hasbro) wanted it to make more money than it was making, the same way that 5E is now being called "undermonetized" despite its success.
To summarize, it's not about profitability; it's about profit maximization.
Companies are not, in the long term, going to publish because of love of the game. They may say that but unless you're a boutique privately owned organization it's just not going to happen. Let's put it another way. If you can put $1,000 in a bank and earn 2% interest or put it into a hedge fund and make 8% where are most people going to invest their money? Assuming that you believe the latter is a safe investment you're going to put that grand into a hedge fund.
So no, I don't begrudge companies setting profit expectations. It's just reality. Very few people will willingly lose money (or make significantly less return on their money) in the long run unless they are incredibly passionate about what they're spending money on. Companies are not charities.
Oh, and unless you've had a peak at the books, do you have any source for the profitability of 3E? Did they continue to sell core product and was new product actually profitable?
P.S. I'd love it if some billionaire bought out D&D and made it their passion project and didn't care about making a dime (or even 2-3 dimes) on sales. Especially if they paid me a bazillion dollars to be a consultant. But if wishes were horses we'd be hip deep in horse pucky.