As far as I understand primordials, they would be happy to 'restart' the world, just without sentience this time. Anybody who wants to get rid of all sentience in the world (not only you or me, or even all humans, but idea of intelligent being at all), counts as 'more than evil' in my book.
So, for me, primordials and their servants, probably also Far Realm = CE. Anybody else, just plain E (including evil gods, demon lords, chromatic dragons, charismatic dragons, charm dragons and strange dragons). Chaos = destroy the world. Destroy the world counts as evil in the view of most people - but there is a lot of other, 'lesser' evils which doesn't involve wholesome genocide of all sentient beings.