RAW, it's not too much of a problem if you understand how the rules about interacting with objects work. See, dropping a weapon is free, and picking it up off the ground can be combined with your action. What happens if you pay close attention and make your players play it by the book is that...