I disagree, as I think your definition of "world-building" is far too narrow. To me, world-building is an umbrella term that embraces multitudes, any building or creation of elements of a fictional world is potentially "world-building", whether that's architecture, language, history, geography...