Originally, the idea was more for flavor than powergaming. Obviously, the more I thought about it, the more useful it seemed to be.
I have an idea. I usually don't like implementing mechanics that slow the game down, but how about each time you teleport, there is a chance of suffering...