See, I'm the complete opposite. The 'core' of the game is pretending to be a crazy adventurer and going on crazy adventures with some friends. Whatever rules are used to facilitate that are secondary. If I need to learn something new, great, that's just an added pleasure. New information entertains me more than whatever sense of 'mastery' I might get from using a familiar set of rules. I'm much less interested in succeeding than I am in experiencing something new.
What I love about D&D, and RPG's in general, is that they're never the same game twice...
Therefore, I voted for the first option. Remove anything you like, so long as we all can make something interesting out of what's left.