It breaks nothing to allow those weapons to be used as Pact weapons, just not letting the Warlock perma-vanish an Artifact is the intent of the rule methinks.
It doesn't though. Once the warlock dies the bond is broken and the pesky artifact is lying at the dead warlock's feat. So it takes it out for a while (a long while if it's an elf) but it's not lost.