Reply to thread

Message

<blockquote data-quote="Gorgon Zee" data-source="post: 9281157" data-attributes="member: 75787">So, I work as an AI and ML architect for a health care company, and get to review a lot of government and regulatory documents over AI. One of the strong principles we adhere to is that nothing goes directly from an AI to a consumer (patient, clinician, etc.) Everything must be seen, usually edited, and then committed to by a person with authority to do so. One commentator suggested that you think of an AI as an enthusiastic but somewhat naive intern who occasionally shows up drunk. It’s a developing field right now, and using RAG and few-shot examples is pretty effective for improving AI in terms of hallucination, but the bottom line is that the core technology is essentially choosing a random string of words with probability proportional to how likely you are to see bits of that sequence somewhere on the internet. AIs have no concept of truth or falsehood. Their goal is simply to be plausible. Most often the truth is pretty plausible, so you get the truth, but truth is an only a side effect of plausibility, and so not to be depended on.</blockquote>

[QUOTE="Gorgon Zee, post: 9281157, member: 75787"] So, I work as an AI and ML architect for a health care company, and get to review a lot of government and regulatory documents over AI. One of the strong principles we adhere to is that nothing goes directly from an AI to a consumer (patient, clinician, etc.) Everything must be seen, usually edited, and then committed to by a person with authority to do so. One commentator suggested that you think of an AI as an enthusiastic but somewhat naive intern who occasionally shows up drunk. It’s a developing field right now, and using RAG and few-shot examples is pretty effective for improving AI in terms of hallucination, but the bottom line is that the core technology is essentially choosing a random string of words with probability proportional to how likely you are to see bits of that sequence somewhere on the internet. AIs have no concept of truth or falsehood. Their goal is simply to be plausible. Most often the truth is pretty plausible, so you get the truth, but truth is an only a side effect of plausibility, and so not to be depended on. [/QUOTE]

Verification