I always thought it was because they were a negative image of elves.
You know, like when you take a picture, reverse the colors (like in a photograph negative or nowadays, a paint program) and skin turns an inky black-purple, and hair usually becomes white.
Obviously they aren't perfect...