Yes, that's my inclination too. Fight through the fort to reach the dragon, and then see it leaving.
When I get there, I'll probably make it so that Auril's worshippers are influencing Xardarok--they pointed him towards the tainted chardalyn in the first place, like with the berserkers, and now...