They are annoying for their ability to permanently turn a PC into a water-bound creature, but it can be reversed with a Heal scroll.
There are some other CR 7 monsters that have more-or-less equally annoying abilities:
Black Pudding (might destroy weapons and armor)
Medusa (might permanently petrify a PC)
Nymph (might permanently blind a PC)
Red Slaad (implants an egg that hatches out a week later, Aliens-style, killing the PC)
Succubus (Energy Drain that may result in permanent level-loss
Yuan-Ti Abomination (Baleful Polymorph PC into a snake permanently)
I shy away from wanting to throw them at PCs in my games, too. I don't want to speak for you, but I think many people, myself included, are more afraid of monsters that might change a character in some way than ones that just kill a character. For example, most players just laugh if you throw a quantity of Kobolds with crossbows at them with sufficient numbers to make an EL 7. (I think that's about 48?) There's a good chance for a string of criticals in there and that would level a party pretty well.