Also, just to note...
Many of the ways we hypothesize about this amount to, "We didn't make an artificial intelligence, we made an artificial stupidity."
There is nothing wrong with that, but it is unsubtle, and if we are not careful stretches credulity. A machine that can prioritize and adapt to make complex supply chains work, and learn new science and engineering to make robots with capabilities never created by man, and possibly be atactical genius, should not have an issue with throttling back paper clip production. It gets a little obvious when the machine can learn and rewrite it's own code/behavior, except for this one little bit that is the one bit required for conflict in the narrative.
The archetypal solution to a problem of artificial stupidity is to trap it in its own overly-simplistic logic, Captain Kirk style.
Many of the ways we hypothesize about this amount to, "We didn't make an artificial intelligence, we made an artificial stupidity."
There is nothing wrong with that, but it is unsubtle, and if we are not careful stretches credulity. A machine that can prioritize and adapt to make complex supply chains work, and learn new science and engineering to make robots with capabilities never created by man, and possibly be atactical genius, should not have an issue with throttling back paper clip production. It gets a little obvious when the machine can learn and rewrite it's own code/behavior, except for this one little bit that is the one bit required for conflict in the narrative.
The archetypal solution to a problem of artificial stupidity is to trap it in its own overly-simplistic logic, Captain Kirk style.