It's a little known fact that phylacteries are attached to the lich/dracolich by a very long strings. However, although long, such strings are finite in length, so they can't be hidden very far away. ;-)
All kidding aside, there could be some sort of distance-related motivation for keeping it...