A new player needs the PHB and a group. A new DM needs the core 3 and a group. Or any new player can pick up the Essentials handbooks and slide onto an Encounters table. *No* new player needs the errata, or even to know what the bloody word means.
How quickly the game has gone from "not enough options! this sucks!" to "too many options! woe! how is a new player *ever* to cope?"
Can I get an amen! This was a bit towards the end of 2E but really hit stride with 3E. As a starting player, find a group, decide what kind of character you'd like to play and get that "PHB". One book contains enough classes and goodies to keep you occupied for a good long time. It's that "gotta have 'em all" mentality that causes the confusion.