My advice would be that they see things that no one else can. Hostile forces that attack or threaten them but that no one else can see, other than the party, shadows or wraiths. Perhaps the dark magic infects NpCs - otherwise friendly folks that turn on the party and then don’t remember or don’t...