Because such a score is so debilitating. You are unable to function in society with a 6 INT let alone be an adventurer. Your fellow adventurers would rob you blind and you'd never know. You'd rarely be able to discern even who the bad guys are if facing a mix of foes and allies.
Maybe strength or constitution but you are still very debilitated. You could get by with a super bad Charisma but your group would realistically drop you from the party pretty quick.
I agree with others this is an overly taxing concept of INT 6.
Although antiquated and flawed, such an INT could represent someone with as low as I.Q. 70 (but probably a bit higher), just above the threshold of what was considered disabled. There are many people who function in society with such conditions.
In 5E terms, the -2 penalty associated with scores of 6 or 7 are immediately offset by proficiency in a task, putting such an individal on par with another with scores 10 or 11 but without proficiency.
STR 6 can carry 30 lbs without issue (which many people can do, even my parents in their 80's), even with the variant options.
DEX 6 person would range from very clumsy to poor eyesight or whatever. Again, many individuals function fine with such a score.
CON 6 is only really an issue due to its tie to HP. But really, even that is not impossible to play with. A fighter with CON 6 has basically the same hp as a wizard with CON 10. A ranged fighter with decent AC would play fine IMO. Also, the
tough feat can offset the HP loss.
WIS 6 is slow to pick up cue and lacks sense and understanding of the world around them. LOL I know a LOT of people like that!

CHA 6 could range from poor social graces or lack of confidence or such. Again, plenty of people like that in the RPGing world...
Even a score below 6 is not by any means a death sentence to a PC and does emphasize the difference between themselves and an 18 score person.
I will grant you a combination of 6's in scores would make things very difficult, especially if another score is not exceedingly high to allow the PC a focus area. It isn't impossible to make such a character work, but you will more heavily rely on the support of the team--but is that really a bad thing in a team game?
That would be at 8. At 6, they are literally in a special school in today's world. They would be the sort of person sold as a slave in the middle ages. And one super high score and one super low score is incredibly rare in reality.
No, an 8 score is just below average, well above the realm of any sort of mental impairment. You're no Einstein, of course, but you would rarely, if ever, have difficulty living day-to-day.
Even if an INT 6 was the "village blockhead" or something, they would not be "sold as a slave in the middle ages." You're basically Forrest Gump IIRC or possibly a bit smarter. Due to INT scores being discrete, an INT 6 could represent an IQ 80 even.
Rolling 3d6 you would have to roll a 3 to be within the bottom 1st-percentile. In IQ scores, this is around a 60 and finally at the point you're considering an INT 6 in your more extreme statements.
You
really are taking that a bit too far IMO. But, I don't intend to convince you, simply inform you that most people IMO will disagree with your assessment.
Finally, Intelligence comprises such a large range of factors (which is why IQ is not a reliable metric!) that someone with an INT 6 might have a very poor memory, forgetting things easily, but be relatively average in other factors of Intelligence, so the score "as a whole" averages to INT 6.