The hermit doesn't stop in his walking, taking the group further from the road. The goblin appears somewhat dazed by the whole experience, perhaps even a bit sleepy and doesn't really respond to the barbed comment.
To Muzdim he says, "Greed. Well, it's an honest motivation at least, if not...