Summoning a CR 6 monster isn't the same as fighting a straight up CR 6 monster - you kill the caster, disrupt the concentration spell or dispel the creature and it's gone.
Actually, you disrupt concentration and the creature stays and becomes hostile to the caster.