How much of a damage increase depends on what you're comparing it to. Going from a d6 (short sword) to a d12 (waraxe), for example, is hardly insignificant. It also helps for flavor purposes and, for some weapons, allows certain enchantments otherwise unattainable (not entirely sure about that...