Judge decides case based on AI-hallucinated case law

I was reading a paywalled article on CNN- via someone else’s machine*- that was exposing ELSA (the FDA’s own AI) as being as prone to hallucinations and misrepresentation as general purpose LLMs. Some of the employees interviewed basically said that ELSA was not saving them time because they had to be extra diligent in evaluating its results.





*🤷🏾‍♂️
 

log in or register to remove this ad

This video is specifically related to things like higher physics and coding, but raises some very good points about why LLMs are bad for doing more complex things. The only point that I disagree with is the concept that venture capitalists have "feelings."

 


Oh, and by the way - DO NOT ask a generative AI for legal advice. Your interactions with the machine ARE NOT privileged, and can be used against you in a court of law...

While true, my mean and accusation-siding leaning actually welcomes criminals who confess their murders on a website and ask how to cover their tracks. You'd bet they are smart enough to run a model locally for that, but hey... Lawyers don't have a monopoly on stupidity when using AI (though there is nothing there specific to AI).

If they were smart, they'd log in to a RPG board and ask for advice on doing a realistic escape for the criminal mastermind in the next detective adventure they'll be GM'ing.
 
Last edited:

While true, my mean and accusation-siding leaning actually welcomes criminals who confess their murders on a website and ask how to cover their tracks. You'd bet they are smart enough to run a model locally for that, but hey... Lawyers don't have a monopoly on stupidity when using AI (though there is nothing there specific to AI).

If they were smart, they'd log in to a RPG board and ask for advice on doing a realistic escape for the criminal mastermind in the next detective adventure they'll be GM'ing.
scroll down to the real life section

Some high lights:
  • One careless murderer left all his murder plans on a floppy disk, which was confiscated by investigators. Given how closely the details he'd written matched the actual murder, the "it's for a book!" defense fell flat.
  • The reference desk on The Other Wiki sees "it's for a book"-type questions from time to time. Some are more believable than others.
I think @overgeeked can tell us if it's true or not:
  • A question that comes up frequently in real-life Masters of Library Science exams is the question of whether or not you assist a patron that's looking for information on something questionable (like forensics), or illegal (building bombs).
 
Last edited:


If they were smart, they'd log in to a RPG board and ask for advice on doing a realistic escape for the criminal mastermind in the next detective adventure they'll be GM'ing.
I realize it’s a joke, but my inner German demands that I explain that this would ALSO be admissible in a court of law.

 

I realize it’s a joke, but my inner German demands that I explain that this would ALSO be admissible in a court of law.

If this was the case, I'd have a rather large file on me somewhere. (I likely do.)

NOTE - Me doing anything criminal would be supremely stupid, as my fingerprints have been on file with RCMP for decades (government job application and firearms/restricted firearms certs).
 

If this was the case, I'd have a rather large file on me somewhere. (I likely do.)

NOTE - Me doing anything criminal would be supremely stupid, as my fingerprints have been on file with RCMP for decades (government job application and firearms/restricted firearms certs).
Mine are on file with the Feds at least because of requirements to study law and a security clearance investigation for a job.

…which was actually a bit of a challenge for the authorities. My fingerprints have visible ridges, but they’re apparently much shallower than normal. The first time they tried taking my prints, they got black blobs. Finally got them by using less ink and pressure.

For the security clearance, I had to go to a local FBI field office, where they used OPTICAL scanners. In the first attempt, the images captured were rejected. Ditto a second, at which point the supervisory agent asked if I’d been altering my fingerprints to facilitate criminal activities.😱

I stammered a denial, and they tried again- using less pressure- getting usable prints.
 

Mine are on file with the Feds at least because of requirements to study law and a security clearance investigation for a job.

…which was actually a bit of a challenge for the authorities. My fingerprints have visible ridges, but they’re apparently much shallower than normal. The first time they tried taking my prints, they got black blobs. Finally got them by using less ink and pressure.

For the security clearance, I had to go to a local FBI field office, where they used OPTICAL scanners. In the first attempt, the images captured were rejected. Ditto a second, at which point the supervisory agent asked if I’d been altering my fingerprints to facilitate criminal activities.😱

I stammered a denial, and they tried again- using less pressure- getting usable prints.
Ink for me, three times. For the licenses I had to go through interviews with the local Firearms Officer, prior to my initial application even being accepted. Fingerprinted at the first interview for background checks. Two more visits just for the basic FAC, then had to go through the whole thing, again, for the Restricted qualification. And that was before Canadian regs got tough ;)
 

Pets & Sidekicks

Remove ads

Top