Well, according to my grandmother's genealogy research, the oldest ancestors in any kind of records, were Irish nobles who settled in western and southern Scotland during the Dal Riata era. And later fought the Romans and lost, so they sailed to Norway to recoup their forces, rest and plan for future attacks against Rome. While they were in Norway, an envoy from Hungary of Attila came and offered rank and title to those who joined their effort. Some of the family went, and today their are descendants in Hungary still. All that traveling occurred sometime in the fourth century, a half millennia or so before the height of the middle ages.
Then there's both pilgrimages to the Holy Land, and the Crusades, priests sent to serve in distant monastaries, not to mention sailors aboard merchant ships across that entire span of time. Not every person of the medieval period was a peasant farmer.