Yep. At low to mid levels, the PCs shouldn't be encountering any named NPCs other than as roleplaying props. Elminster isn't going to bother to go run off to save a town from 2 giants. He's too busy dealing with Zhentil Keep or Thay.
It doesnt need to be Elminster.
If it is a town detailed in a FR product there are almost certainly several named lvl 10+ characters living in or near it or otherwise have an interest in saving the town.
Why do they need the PCs to fight off 2 giants?