As the ruin has numerous collapsed (and, presumably, weakened) passages, you could have the party encounter the anti-paladin across one of the collapsed passages, too far to jump, but still able to communicate. Or if they encounter gnolls, some run away, the party pursues, the passage collapses...