That's possible. They've really got to sell it, though. Running off outright, yeah, probably. The Paladin would issue a challenge to another enemy, then. Swallowing an invisibility potion in mid-combat or slipping around a corner? Sorry buddy, I'm on to you.