On the topic of Large goliaths....is there any real benefit to being Large in 5e? We've got increased carrying capacity and lifting heavy stuff, and the mixed benefit/penalty of a larger footprint in combat, letting you block more space but be surrounded and attacked by more people in melee. Outside of that, there's nothing intrinsic to being big that's actually helpful. The Enlarge/Reduce spell gives us +1d4 weapon damage and advantage on strength checks, but there's no real reason to assume any such benefit carries over to PC that are always big, and maybe a vague idea that they should have some kind of reach, but nothing in the rules that makes that intrinsically so.
From an adventure design perspective, all that being Large lets you circumvent is maybe lifting something that's too heavy for a medium PC? That just doesn't feel like it's going to come up enough, and it's easy to design around if it does. You might run into penalties for squeezing in combat in some places, but squeezing will explicitly allow a Large creature to fit anywhere a Medium one can walk normally. I suppose some adventures might have exceptionally small holes that a medium creature needs to squeeze through, but again, that feels easy to work around.
The impact feels frankly just quite small mechanically, and when it does come up, it's mostly a detriment to the PC. I think we're firmly in an aesthetic choice territory, given how size works in 5e, not a design or balance concern.