Craven gets him an extra 6 damage on SA, but it does have a cost in the form of lower saves vs fear, so you might be able to use that against him here and there.
Daring Outlaw is one of the ways to make swashbuckler actually be a worthwhile class past 3 levels. Going past that it really is...