Drawing a weapon is part of attacking, so if you really want to get picky, you can drop as a free action and draw AND attack as your action, but really, minor stuff like this is what 5e is trying to get away from.
Let go of the rules and just play, Man.