That... I don't like.
Because those things give us a mechanical basis to have different kinds of characters who are better or worse at different things than their compatriots. Take, for example, avoiding damage by dodging rather than relying on heavy armor to resist incoming damage or parrying attacks that come at you. Even using magic to protect yourself from people attacking you.
With strength, dexterity, constitution, and casting attributes we can make those different descriptions have a mechanical weight in the game which can help to reinforce the identity of the characters. Legolas dodges, Gimli resists, Aragorn parries, Gandalf uses magic. Y'know?
... yeah. I felt kinda dirty using LotR as my example, but it's one everyone knows...
As a designer I want more levers to play with, to base mechanics off of, to make things more interesting. And while it is a tightrope walk between too few and too many, I think attributes being removed would absolutely be too few.