I've had different experiences in different campaigns - I remember one 3.5e PBEM where my 5th level Fighter in non-magical studded leather, power-attacking with a mundane greatsword, was the most powerful PC in the group. But I've also played a 5th level Fighter in a Midnight 3e/d20 game where the Channeler (spellcaster) PC totally, totally dominated all the non-casters, and just laughed at me.
The only time I ever felt over shadowed was in a game that the DM was trying to run as low magic. So none of us had any magic items to speak of. It started breaking down at higher levels because the druid and paladin were able to use spells that buffed them and gave them magic weapons where the mundane characters did not. The DM didn't adjust the CR to reflect that no one mundane had an AC over 18.
This showed to me if you want a low magic game you have to limit the magic users in some way.
I have played a high level monk who ate enemy magic users for breakfast. I have played a 15 level fighter who critted on a 15 had a +4 to confirm the crit and just plowed through the bad guys. It was great. I never felt that the wizard was better than me or outshone me. Yeah the wizard could wield fearsome powers if he was prepared. But he didn't have the AC or the hit points to get up in the face of the BBEG.
I also knew that I was one of the reason the wizard and the other squishy PCs were alive. Part of playing the fighter it to play the meat shield and body guard of the weaker characters. If that bugs you don't play a fighter.