Townsfolk will obviously flee and immediately call for help upon seeing the PCs, but could there be a revenge incentive for them to uncover who set them up without having them to return to that town? That might be a way for the adventure to continue, even if they have to deal with occasional...