To use a 4e term, I'd vote that flying shouldn't be allowed until paragon tier (level 11+). Before that, levitation and magically enhanced jumping should fill adventurer's needs, without allowing them to circumvent interesting problems.
But really, with 5e we don't know what the level range...