It sort of feels that, thematically, paladin smites shouldn't work with pact of the blade. You only gain the new attack stat by invoking the power of some unearthly being while you only get to smite by invoking your devotion to a different being. It kind of feels like they should be either / or...