I don't think expertise ruins the game precisely, but I do think it's throws a mighty big wrench into third pillar play. Expertise in Deception, for example, can be really difficult to deal with as a DM in an intrigue game. Not always, but often enough that I feel like it's an issue. I would also prefer a "yes and.." approach to additional success to just stacking mods to the sky.