The problem with running Fly on a Warlock is that it's a concentration spell, and you fall if your concentration breaks. If you had maxed Con and Con save proficiency, I could see taking it, but since you don't, and since nobody in your party has access to Feather Fall to save you if you fall, I...