I agree with all of that.
Also, the last part of what you said there is why there are "rules-light" games that, to me, are more complex than some heavier games. Not everything needs a rule, but a game that is supposed to be about doing X thing should give me at least some idea about how to handle doing X thing. If I essentially need to create my own game to be able to handle a core aspect of playing a game, that ends up being extra complexity.
Heck, I'm even okay with (and have learned to prefer) the 'ruling not rules' mentality, but I feel that, to make a ruling, I still need to have some idea about what to base a ruling on. I don't need things completely spelled out, but at least give me some idea of what language the words I'm trying to spell are in.