Not necessarily. There are options. You can run some off. You can charm some or otherwise wise turn them against the others. You can fight them indirectly. Whatever.Yes. But the context was combat encounters needed to gain enough XP to reach the second level so that entails fighting them.
Personally, though, I think you are making too much of the difficulty. I have seen first level parties take on harder adventures.