No need to apologize -- emotional responses from the characters against each other are fine, as long as we as players know we're all on the same side.
Hmmm... Do you want to swap him out for someone else, buck up and make something out of him, or leave him behind and back out of this game? I'm fine with any of them. (Though I liked having a character with a relationship to the most 'important' NPCs...)
Same thing went with Lionel.