I'm using IE 6, as well, so it's not that.
Eric's most likely correct, it's probably a routing issue. Your physical location isn't as relevant as you might think. If you both are connecting to MCI's backbone, for example, and I'm going over the MAE-EAST, it doesn't really matter if what are physical locations are...it depends on the route travelled.