Worrying about balance is overrated.
Make an NPC. If the party decides to attack said NPC for whatever reason, then the NPC might die, might be a good fight, or might kill a PC or two. All valid options. But worrying about trying to hit the "might be a good fight" bullseye every single time...