If the rest of the group can't sit still for a day, and insist that the DM let's them carrying on play, that's just douchebaggery on the part of the players. And the DM who allows it is equally a douche.
What kind of player says, "Well, you guys are doing something for a day, so, I'M going to go off and adventure?" and the DM goes along with this?
Like I said, if a player or players pulled this on me, you can guarantee that I'm going to force the DM to play my elf being awake almost all night, in real time. Doesn't matter if I'm standing still and not saying a word. You can't fast forward my role play.
GImme a break.