These types of question are always hard to answer. There is your side, his side, and of course, the truth. That said, we only have your side of the story to go off of. Fair enough.
If I was the DM, and I had a bar filled with 'tall folk' that were prejudiced against the 'wee folk' - I would...