Well, drawing and changing weapons IS a mess. I mean, have you tried it? It isn't as easy as you might think and is meant to encourage PCs to be ready if a scene looks potentially dangerous.Something a friend of mine pointed out was weapons juggling. Right now, to draw and change weapons quickly is a bit of a mess. You get one free "handle an object" each turn, but if you're a dual wielder or a sword + shield guy, or a someone who has to juggle a weapon, shield, and a focus, the RAW rules are obnoxious any time you don't start the combat with things readied in both hands, or need to change them out.
Switch hitters and anyone thinking to use thrown weapons has to deal with this issue as well. I'm not sure what the answer is, but it's being added to potential house rules for a patch.
Personally, I have never had too much issue with it, with the greatest exception being thrown weapons, which IMO drawing it should be part of the attack, just as drawing an arrow from a quiver is.
Now, you can drop an item without any cost at all. So, drop your current weapon, free interaction to draw a new one, and attack.