Have a quiet word to the GM, phonecall or email out of game and tell him to pick on the other layabouts.
Its pretty common and youre not the only one who's been through it in roleplaying history, Ive had it, one of my good friends who I introduced to DnD has this problem as well. Lots of bodies...