That's the thing, I have only done it twice, and it was uisng there characters. When they missed a session. I just seem to roll really high when behind a PC's character sheet.
When I use my personal NPc's, I keep them out of fight entirely, unless I know they will need it. And even then it is a lower level NPC then the group.