This is another possible solution to the Fermi Paradox.
We assume we are intelligent. We guess that, if interstellar travel is possible, we are really just a little way from it, and that that whoever reaches the stars will be very much like we are. Like, in a century or two, we'll have it. So we are smart enough to be interesting to visit.
But what if that's wrong? What if the level of intelligence required to travel the starts is as far beyond our own as ours is beyond that of, say, individual ants?
Then, "Why don't they visit here?" becomes very much like, "Why don't you visit anthills?"