Then you've mostly answered your own question, haven't you? If you're using polymorphic magic to make the familiar's physical stats irrelevant, then the only things that remain of importance are skill ranks, mental stats, and special abilities - with the skill ranks becoming progressively less...