For some, finding a new game is simple. It might be from that standpoint that they suggest walking out. If finding a new game is hard, then that option is of course not very tempting.
I suggest being frank, and explaining to the DM that you feel uncomfortable playing with him, and list reasons...