I'm not completely convinced Xazivort is even of lord status. He could be just as easily be a glabrezu or something. His whole thing is that he was imprisoned by clerics of Pholtus and then he escapes and possesses a paladin - from the meager abilities he manifests in the adventure, there's no reason he has to be a unique being.