I don't think switching hands would be a free action.
PH 267, Minor Action "...pulling an item from a pouch or a sheath, ...picking up an item
in your space or in an unoccupied square within reach."
PH 267, Free Action "...dropping a held item, letting go of a grabbed enemy."
I would argue...