You could try not expanding your kingdom into ancestral orc lands in the first place.Alternatively, you can give them into foster families like and tech them "proper" behavior, similar to what was tried with indigenous children up to a few decades ago.
The orc baby dilemma doesn't really have a satisfying solution, each way of handling it can be questioned.