In general, I would say, yes, using player banter against PCs is a dick move. For this not to be a dick move, you would have to justify it. (Specific beats general, after all.)
Certainly, I would not use knowing how many spell slots a character has left or exactly how many hp against them...