I don't think it works - ability damage and hit point damage are usually counted as separate. This is basically the Sneak Attack + ability damage question in a different guise.
It'd be totally insane if it did work like that. You made me have a :jawdrop: moment.
-blarg