Actually, the issue is in regard to the resources elves have.
If a society has metal, someone needs to spend their time in the pitch darkness covered with soot and swinging a pick in order to mine that metal...
No, not really. The famous Japanese katana's for example were forged from a black iron rich sand. You just dig shovels full of it up. There are likewise plenty of surface mining techniques whenever you have seems of ore near the surface. And even to the extent that you wish to have elven miners in traditional horizontal shaft mining, I'm not sure why this creates a particularly big intellectual problem. After all, a race with the favored class of wizard has effective technology levels far higher than medieval humans, particularly in D&D where things like endless burning magical torches are a thing.
someone needs to stand next to a roaring forge that can heat that metal to a boiling point and someone needs to pound that metal into shape.
Sure. And? I'm not really understanding the problem you have with this.
If every single last elf without exception is trained to use swords... guess what? CLEARLY they have tons of metal to put towards that end.
This implies that any elves are trained to use swords, and I'm not sure that is established. Humans are trained to use swords. We have no evidence that elves have to be trained to use swords. It could be that they are born with the basic intuition necessary to use swords and bows.
Those big flawlessly white ivory towers they live in must be made from stone. And not just any stone, they have been picky about their stone. This means there must be a quarry site, there must be workers with picks and other tools cutting the stone from the quarry site, there must be large numbers of workers dragging that stone from the quarry site all the way up that mountain or into the depths of that forest over rough terrain in order to build these things.
Again, assuming that they do live in big ivory towers - which I for one have not asserted, and in fact asserted that compared to humans most elves lived in poverty - then yes the stone needs to be quarried (although, I guess it isn't inconceivable that they could use something like Wall of Stone and Stone Shape to do the work). But what is your objection to elves engaging in labor?
I could keep asking the same questions about the rest of your objections.
And that goes for the clothing they wear too. For the elves to constantly have the finest in silk clothing despite living in conditions where it would get soiled constantly... you know how much work is involved in making silk in traditional ways? And to cloth their entire population with fresh clothing and cleaning it constantly is tons of hard work.
Again, I have no idea where you get the idea that elves are normally clothed in silk. For the record, my elves are normally clothed in material spun from their own hair, but I guess that's beside the point. Why would elves not enjoy spinning cloth?
Every single elf without exception is a wizard or bard or ranger or craftsman? Every. single. one?!!
In order for ANYONE to have that sort of position, to especially have their position dressed and surrounded in the kind of finery they get, it takes 7-9 other people doing the actual filthy, hard, rough, taxing, back-breaking labor in order to build where they live, feed them, cloth them, provide them with their tools, transport all this stuff and generally allow them to live without any distractions from their "enlightened" pursuits that ensure they do not have to do an honest days work in their entire immortal sleepless lives.
Wait? What? You've got a race of immortal, intelligent, magical, beings that don't need much sleep, have night vision and reputations for being extremely skilled craftsman capable of creating goods that endure without the mark of time, and you think that they need a bunch of slave labor to cover their basic necessities like food and clothing? I would presume most elves most of the time are laboring in various crafts. Shaker villages didn't need slave labor to create extraordinarily crafted beautiful goods of every sort, and those were populated by mere humans. Cistercian monks invented all sorts of labor saving devices and produced a great surplus of goods for not only their own use but for sell, and did so with no more than clean wind and water power - ushering into the first industrial revolution in the west. And now you are saying that magical elves can't do at least as well?
Someone must be doing this. And by your own very admission-- it is not a single member of their race.
I would presume "craftsman" are engaged in craft. What are you going on about?
2) MUCH MORE DAMNING, they have such extraordinarily powerful magics that they can, with a wave of the hand, eliminate all need for the common class all together... and sinisterly enough, keep this secret to themselves. They have spells that, if used, can provide all the food, shelter, clothing, etc. that a people could ever desire and if they simply shared those spells with the dwarfs, humans, halflings, dragonborn, orcs, hobgoblins, etc...
Wait, what? That's ridiculous. That's like suggesting that since we humans have innate and unintuitive understanding of language, that we are to be damned for not sharing it with horses. It's quite possible that a race would have skills built into their very nature - like say very long life - that simply couldn't be passed on no matter how hard you tried. And even if this wasn't the case, you've neglected the very obvious possibility that the elves did in fact share much of their knowledge of technology and magic with younger races like humans, goblins, and dwarves, only to see those races misuse the technology to create weapons, rape the environment, and engage in continual wars with each other (and the elves), rather than caring for and feeding their own people.
Either way, elves must fundamentally be evil beings if every single one of them can live like nobility when we know for a fact that for anyone to live like nobility, so many more must live like commoners and they are unwilling to provide any sensible explanation as to where their commoners are.
Where is this weird rage against elves coming from?