You know, if it was clear that the modifier wasn't representative of skill, perhaps even going so far as to primarily explain modifiers as a function of luck, I imagine this would be an easier sell. If you demote character skill to color explicitly, the underlying change in system is much clearer.