No feat tax. Withdrawing or stowing a weapon is a 'free' action. But with the feat it's not needed, but you gain the ability to cast as opportunity attack and advantage to concentration. Casting isn't necessary to make an eldritch actually super good at combat, but it offers him the versatility...