Yeah, I think that if the DM did want justification for why people were not interested in the fruit (again, I find it unusual to care about that, but nevermind), then a player could cite the "wave of exhaustion" being perceptible on Brick's face and posture or something. Then it would be up to...