Even if you are a Palidin, you can still confront him, and you should even if nobody else backs you up. A Palidin has the the backing of his faith. Drive him out of the party by confronting him, and if everybody take his side then retire the palidin, as one would refuse to adventure with this...