Yes, you must remove your shoes. Additionally, you may
only have hands free when you stop moving (you must then
"retreive an item" to use or cast a spell, etc.)
One standard action to remove boots and leave them where
they lie or a FRA to stow them.
Not my rule (not the DM) - But then, I wear...