What's all this talk of rogues, clerics and barbarians? When Strength is a dump stat the only option is monk. 32 point buy go!
6
20
8
8
18
8
That's like 21 AC with the dodge feat!! You'll be unstoppable!
Sure the duelist isn't any good but neither is going straight swashbuckler. I'd wager a 7/10 swashbuckler/duelist is stronger than just a 17 swashbuckler, especially if you can convince the dm to let some of those bonuses stack.