If you're wielding a two-handed weapon, it should only be a free action to let go with one hand long enough to cast a spell, and a free action to grab it back. Remember, it takes two hands to swing the weapon, not to hold it.
I'm preparing a possible Runesmith build and had this same...