You don't remember Gandalf fighting with a sword in one hand an a staff in the other? Under 5E rules the staff could be a Focus so he could use it to cast spells that require Material and Somatic components, but he would have to drop it or the sword to cast a spell that only requires Somatic...