I'd base it on the the weapon. For something that was shorter, like a carbine (for the Freeport stuff, the Harpy and Medusa), the lesser penalty. For a longarm (like the Gorgon), the greater. I might go the other way on the Medusa, though.
Having just watched Sharpe's Rifles, I'm still...