I've had similar experiences with sprite familiars - absolutely devastating when they connect but frustratingly fragile in combat. The poison arrow strategy is brilliant, especially combined with higher-grade poisons, though I found keeping mine at extreme range helped with survivability...