How many ranks of Perform do you have? Are you buying these as cross-class skills, or did you spend a feat on Cosmopolitan (or something along those lines) to get Perform as a class skill?
Since your character is musically inclined, you might consider the Virtuoso from Song & Silence. It requires 10 ranks in Perform and 6 ranks in Diplomacy or Intimidate, as well as the ability to cast 0-level arcane spells (so you'll need to take at least 1 level of Illusionist). This probably isn't a viable choice if Perform is still a cross-class skill, since it would require you to be at least 17th level before you could start taking levels in Virtuoso...
The Virtuoso grants many bard-like abilities, such as Bardic Music and various music and performance-based abilities, without the "non-lawful" restriction. Plus, it grants full spellcasting progression, so you can continue progressing in your Paladin or Illusionist spellcasting ability.