But what you are missing is any character, PC or NPC, can already use any weapon.
Yes commoners can use light crossbows, and daggers and heavy crossbows, and longbows and swords, but they should not use all of those equally to a soldier who has been trained to use them ... i.e. they should not...