If this is on a point buy you might want to drop the initial dex by 2 to add 2 extra points to cha, int, and wis. Will save +1, damage +1, extra skill points, and a swashbuckler just shouldn't have a charisma of 8. This doesn't hurt your ac, you lose 1 to your attack, which doesn't hurt that...