I do this with some frequency, for better or worse. Since I never roll for HP for monsters, instead using the average in their stat block, I justify it to myself as, "well, that orc had a few more hit points than normal," or, "that evil elf was kind of a wuss, relatively speaking." All possible...