At first I was of the same opinion as the other posters who have replied to this thread. However, on reflection on the matter, I'm not so sure.
There are so many factors that go into situations like this and, ultimately, we are only seeing one point of view.
The last session I was in, for instance, I bitched a little about how I couldn't use spells from Masters of the Wild, however I was only kidding around. It is, however, entirely possible that the DM took it seriously and felt like I was being an ass.
I also know of one person who, when he DM's, makes arbitrary and unfair judgements that are always to the detriment of my character. He's my best friend so I guess that could possibly mean he feels some underlying hostility... hmm... anyway, the point is, is that I won't game with him as DM because of this even though he thinks he's entirely fair and reasonable.
I'm not saying you're lying or that you were a total butthead and he's completely right, but is it possible that he had some justification for his actions?
If not, then I agree, kick him out. It's can be a very tough thing to do but sometimes you have to be strong and just say... no.