NPCs
Hmm... NPCs.
Well, firstly, there's the arena master(s). They sort out all the matches and 'referee' them. They might be high-level mages, or just businessmen out for a laugh.
Next, other gladiators. If they are free to roam around, they might ambush the PCs, trying to weaken them before...