Well, as you mentioned, perhaps one (or 2) of the enemies joined the bandits and that tipped enough of the power in their favour.
Perhaps they ran afoul of a group of Boggard's that I hear are rumoured to be in the area, the Staglord, kobolds, or even the dreaded Taztlewyrm. Oh, and mites...