Honestly I think what you are describing is pretty much a DND version of a Special Forces strike team, and it would be very effective. Rogues are one of the most versatile classes, expertise is just crazy good, and I'm sure this party would work. Each of them could get out of combat if they wanted, Dex based means they are good at range as well as Close Combat. With stealth they will often get to choose when/where the fights occur if the players are even a bit cautious. And for once, the sneaky scouting rogue wouldn't likely be the only guy scouting ahead with his butt on the line.
I'd give at least one of them a decent WIS and the Observant Feat. That is a great feat, almost broken. I'd also give at least one, more if you can spare the feats, the Healer Feat. Not a ton of healing, but a decent amount and can do it once per short rest for each party member. Sometimes it comes down to a player just needing to take one more hit, but even then can be stabilized with 1hp and back in action shortly after things get under control. Since every party member can disengage as a bonus action those in trouble have a far better than average chance of getting out of it. Also, Dash as a bonus action you're group will have a huge tactical advantage if they have room to run around.
This idea would be effective. Biggest problem you'll have it PC's that think roleplaying is the same thing as whatever is on your stat sheet. If everyone is a rogue, there will be a good deal of overlap in abilities, and some players will feel like they aren't special. Essentially, ask your players what they do to make their guy a tavern brawler. If they answer "I'd need to get the Tavern Brawler feat" they probably wouldn't like this type of party. If they answer, "I tell the DM I'm going to a tavern, then I'm going to punch someone in the face", then they would probably do well in this type of party.