And I know plenty of people like this in real life (people who are arbitrarily violent, and fuelled by hatred) and they dont walk around randomly murdering kids, burning down taverns and similar.
Think of a violent street criminal, or an outlaw motorcycle gang member.
While CE certainly encompasses extreme cases like the Joker, or Darth Vader, or full on murderous psychopaths of the highest order, it also encompasses anyone who is fine with harming people (assault; even murder, slavery, torture etc) and who lives outside the law.
It's the latter (people who are just fine with harming others, and are also living outside the law, or with a disrespect for society, order and tradition) that compromise the majority of CE people, with 'Jokers' and 'Vaders' being the extreme outlier.
Isn't chaos more than just being outside the law and not respecting society, order and tradition, isn't it actively working against it and for it's destruction? And not only society at large's rules but the gang's and whatever code street criminals have as well?
How does NE not describe the gang or street criminals you mention? And doesn't Vader value the hierarchy? That also doesn't feel CE to me.