Keep in mind, most helms are probably less well fitting than a modern baseball helmet. You put a full helm on an elvish mage who's never been trained in how to move/fight in armor, he'd probably be kinda awkward. Maybe he wouldn't know that you wore a padded cap under it so it slides around? Or...