Noldor Elf said:With Mind over Body feat (Int instead of Con for hit points) you're going to get enough hit points to stand in melee.
As a note, Mind over Body lets you use your Int modifier instead of your Con modifier for hit points at first level only
------------------
I would go rogue/duelist, and concentrate on the skills that use your charisma.
Dapper and dashing, using Expertise, Improved Disarm, and the other "intelligent" fighter feats, your character would be rather potent -- and make a good fighter once you get going.