Haha, accents... At least its your mother tongue! English is only my second language, and I only started regularly watching TV shows (back than thanks to Torrent) in English when I was an adult. Doctor Who can be a real challenge, since most TV I watch is still American. But I am kinda getting the hang on it. Sometimes i give up and turn on subtitles, though. (But I think less often for British shows than for shows that use heavy US-specific accents, like on Preacher.)
As awesome as some of the "old" Doctors where, they do show their age in the way they tell stories. Some of their "seasons" have stories that today would be told in a single episode. It is fascinating how things changed. I wonder if storytelling has really improved, or if it's just that we all grew up so intimately familiar with modern TV and movie rules, standards and tropes that we just can be shown the same stories at a faster pace without losing any meaning. And if someone outside this "TV culture" would watch a modern movie or TV show, he'd be overwhelmed.