Because it is attached to the space, not bonded with it. Just because something is attached to something, doesn't mean that the something it is attached to is a location in the physical space. I think the spell even speaks to this by saying 'as if affixed at the upper end'. So, sure, it can pull...