As I see it, the concept of race was invented specifically for the purpose of racism.
Western philosophy established that "all men are equal", but they still wanted to benefit from slavery. To have it both ways, they created the loophole that "only white men are actually men". To pseudo-scientifically justify why only they themselves are equal. There is no discussion of race without racism.
If we want to talk about cultural differences between different groups of people, we have to talk about cultures. Not races.