So the way I am looking at the history the Arkosian Empire worshipped Dragons and eventually fell, but were not Dragonborn, but "saw" themselves as such, sort of like Targaryens I guess.
Then the Bael Turath were human as well, but a "Holy" empire that got slowly corrupted and turned to evil...