There's a good chance that if the wizard casts Detect Magic on you (spellcraft modifier of +7 at 1st level, success on a 9 or higher, assuming no other bonuses are in play), he knows that it's an illusion spell emanating from your head. In other words, that the hat you are wearing is disguising...