Also, just to note...
Many of the ways we hypothesize about this amount to, "We didn't make an artificial intelligence, we made an artificial stupidity."
There is nothing wrong with that, but it is unsubtle, and if we are not careful stretches credulity. A machine that can prioritize and adapt...