Size is actually immaterial here weight is.
Spell description says
What is the flyer's max load limit? (based on strength).
What does the barbarian weigh (including all of his gear)?
I have a strong feeling that the flyer's carrying capacity (PHB pg 161) has been exceeded here.
The OP stated that the barbarian gave the fighter a medium load.