I've tried that with Chrome, and it doesn't work well. It may show up twice in the volume control, but muting one doesn't necessarily mute just that one tab.
However, you could use two browsers (like IE and Chrome, or Firefox and Opera), one for work stuff and one for non-work stuff and mute...