I totally agree. D&D has this sort of assumed and implied milieu of Dwarves, Elves, Humans and Halflings that all look and behave a certain way. The actual Default setting of D&D has changed multiple times over editions (Example: Greyhawk for 3rd) but the implied setting remains largely the same. Matt Colville called it "Fantasyland" once and I kind of like that.I personally think there is a difference between an "implied setting" and a "default setting.. . ' (Etc)
The Default is when they say "This RPG takes place in this world." The Forgotten Realms kind of counts but its mentions are actually pretty scarce in the Player's Handbook (I'm not counting adventures) and I think mostly serves as something to base the implied assumptions off of.
I like both personally. I like that D&D is flexible with a somewhat generic baseline and more varied settings to choose from and that is a draw for me. I wouldn't want D&D to get too bogged down in specifics. But on the other hand I'd be lying if I said I didn't buy The One Ring, Warhammer Fantasy Roleplay or Edge of the Empire because of the default setting. I'm also pretty fine with Pathfinder's Golarion, since it seems to fit nearly the same assumed milieu as Greyhawk and The Realms.
Edit: Some stuff is even carried over, like the religions of Dwarves and Elves being the same naughty word in Faerun and Greyhawk.