If the concern is about innocent people suffering, then why not just enslave races that are inherently evil like orcs, goblinoids, gnolls, etc? If it's already okay to break into their homes, slaughter them en masse, and steal their valuables... then what exactly is the problem with enslaving...