I would allow it, but that is because I am a lienient DM, especially when it comes to cool effects like this...
By the rules, I'm really not sure. To do a Ride-By Attack, you have to do a Charge Attack. Which basically means your mount has to do a Charge Attack. But I don't see why your Charge Attack couldn't be Ride-By whereas your mounts could be Fly-By.