iron shackles, spear points at the back, large and ferocious guard animals, some overseers, ... I could make that work. As for infrastructure, I would think the orcs managed to take over a human/dwarven/elven settlement with the necessary buildings and nearby resources at hand.
I agree, raids...