Right offhand, I think you play the classes that don't have magic in them. That's because TSR in the 1990's published a series of "Historical Reference" books that were about playing D&D in various time periods, from Bronze-Age antiquity until circa 1650.
They included three options for magic level: a fantasy-history where D&D classes worked as usual in a magical version of the past and the setting was just a bit of historic flavor on a normal D&D game, a low-magic game where magic was rare and special and spellcasters and magic items were unique. . .and a "Historic" setting where there was absolutely no PC magic and what little there was were very, very rare NPC's and even "routine" magic items were of artifact-scale rarity.
So, you can't say it's never been done before as an official D&D setting or option, since it was an option presented for historic settings.
Admittedly it was a bit of a stretch, and the historic games that I ran used the middle option for low magic instead of no-magic, but it has been done before.