Upgrade your account to a Community Supporter account and remove most of the site ads.

Reply to thread

Message: <blockquote data-quote="Jfdlsjfd" data-source="post: 9699685" data-attributes="member: 42856">Yeah. We're seeing reports of hallucinations. Noone, as far as I know, deny that they exist (though there is no proof they are actually involved in the specific case mentionned in this thread) and there is no reason to suppose they don't happen when asking about law. But, the question that must be answered to determine if this tool is useful, is "how often are there hallucinations, and do they hamper any productivity increase for a specific task".That they get reported is logical, the same as plane crashes are overreported compared to plane landing successfully. There is also a risk that un undertermined number of hallucinations are happening and are not noticed.Evaluation of the tool involves:<ul> <li data-xf-list-type="ul">Assessing the frequency of hallucinations (if it is wrong X% of the time, it's not useful, with X varying across use cases),</li> <li data-xf-list-type="ul">Assessing the facility to weed out hallucinations (if the AI is tasked to provide evidence of each claim, it should lower them substantially, if they are obvious, it's easy to identify them, if the AI workflow that involves running another AI to detect them and it can do that 100% of the time, then hallucination are not a problem... if they happen often in a way that it is difficult to dect them, it's not a useful tool,</li> <li data-xf-list-type="ul">Assessing the consequence on the use case (I had an AI hallucinate my sorcerer with glowing green eyes in the AI image thread, and it gave glowing green eyes to the dragon instead... that's not bothering me too much as I like the end result anyway... while an hallucination for an AI doing self-driving for my car would be more problematic.</li> </ul>Reporting of the existence of hallucination doesn't say anything about AI in general, especially when people use it in violation of its licence (it might be important for the people involved, and the specific editor of the AI involved, but not for AI in general. We'll see if Husband's lawyer sues ChatGPT for providing bogus legal precedents... possibly invoking a few more bogus precedents?)</blockquote>

Verification