I would think the wizard would have problems when he put it on, like finding himself naked in another dimension. Or if someone cast dimension gate nearby, he may find to have gotten "under the wizards robe" so to speak.
Remember a portal works both ways...
-Angel Tears