According to my Wikipedia-fu, its due to Feng Shui and Wu Xing.
The South, in these ancient Chinese systems, is associated with the element Fire. Other associations include the planet Mars, over-excitement, bitter taste, sheep/goats, and the middle finger.
How's that? ;)