Players will ALWAYS surprise you at how well they do.
Plus, Fly-By attack is not the same as Spring Attack - the critter STILL provokes an AoO - if you can reach it.
Of course, it is also limited by its low mobility, too. It does have low mobility. right? Improved Speed does not up a ability...