"This spell functions like polymorph, except that it changes one object or creature into another." Thus, as polymorph has limitations, and polymorph any object doesn't say anything about not having them, so does polymorph any object.
An object is... an object. A house is not an object, as it...