That's about as equal of fighting positions as starting a race with him on the starting line and you at the finish line.
No its not 'unfair. We have both combatants in range of each other, with weapons ready, trained with those weapons and in appropriate fighting positions.
I know where my money is going on who wins, who backs down, and who dies.
Swordsman can't block or dodge my shot. His 'insta kill/ stop' vital areas (heart, spine and brain) are there for me to destroy with extreme prejudice.
A swordsman on the other hand has to deal with an opponent that can fight back. Who will grab his blade, block it with his arms, step inside the weapon and fight for his life (recieving multiple horrific defensive wounds in the process) before he can get a killing blow in (generally a thrust to the vitals).
Most edged weapon victims who die bleed out several minutes after the encounter, and suffer multiple (dozens in some cases) defensive wounds before a killing blow can be delivered.
Firearms just require a competent shooter to hit a vital organ. Presuming the shooter is trained, there is little the target can do to stop or delay it happening other than hope they miss.
You are seriously underestimating the lethality of firearms. They make it easy to hurl metal through someones head or heart in a way a swordsman could only dream of.