When I read this my initial thought was that it wasn't the Nazgul, but Sauron himself that he was in contact with via the Palantir, but wanted to be sure, I read Saruman's history. It was Sauron. The most interesting part of that history, though, wasn't the confirmation about who he was in...