I haven't found it to be a real problem. It does mean that you'll have less roadside encounters when going to a familiar locale - but think of it this way. For the bad guys, that's a good thing! Even as we speak, bandits are praying for their adventuring group nemeses to get teleport, because then the bandits will be able to prey on the highways unopposed. . .
It could be worse. In my campaign world, teleporting from the deep underdark is usually impossible. Last week my 19th lvl group got around this quite elegantly; they returned to the surface by
gating to an outer plane and then
gating back to the surface. Sneaky logistics!