Yes, it can be developed as the game progresses, nothing in that fact makes worldbuilding 'bad'.
Yes, it can undermine a game, just as any other factor, poorly chosen and run by the GM or players can undermine a game. Likewise, it can greatly enrich a game in a way not other factor can, because...