One problem I see is the question of how they handle orcs. In many adventures and games orcs and goblins serve similar roles.
Maybe they could have worked as giant kins. I think in 4e orcish was a dialect of the giant language.
Maybe this way, powerful built could have been justified.