Yeah, and mentioned in the new books, too. The players book for Faerûn does establish that Goliaths are literally all over the place, though on the margins of major civilization. There really isn't any limit on it, and unlike say 3E there are no demographics for Baldur's Gate suggesting there...