Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Upgrade your account to a Community Supporter account and remove most of the site ads.
Community
General Tabletop Discussion
*Geek Talk & Media
Judge decides case based on AI-hallucinated case law
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Clint_L" data-source="post: 9698866" data-attributes="member: 7035894"><p>An anecdote: the International Baccalaureate diploma is very rigorous - it is basically modeled on British A-levels, and students earn univeristy transfer credit if they earn high enough marks in a subject. Although some of the assessment is done internally, all of it is moderated by IB, and most courses conclude with sets of rigorous exams that are anomynized and externally assessed.</p><p></p><p>In Language and Literature, which I teach, the last exam students write is their Paper 2, an exacting compare/contrast essay discussing two studied works of literature in response to one of four prompts that are unknown until the start of the exam (example: "In the work of two authors you have studied, compare how the physical setting creates a tension that sustains the reader’s interest."). In order to succeed, students cannot discuss their texts in general terms, they must know them inside out, and be able to support their argument with specific references, which means memorized quotations. So one thing they do when revising and prepping their focus texts is to memorize a number of key quotations that could be unpacked in the context of various essay prompts - basically, that speak to the heart of their texts.</p><p></p><p>This year, as the students gathered for the exam and we teachers were there to cheerlead them, a number were flexing their knowledge a bit - "look at how well I know my stuff" - the usual business. And one student started rattling off quotations from British poet Simon Armitage to me.</p><p></p><p>Except they weren't. I knew this instantly as I had, just this term, prepared a new study guide for Armitage. The student argued with me, and then even showed me his study notes, with a huge number of quotations that purported to be from Armitage but were instead generic pablum that approximated the themes of his work as generated by, say, an algorithmic program with no actual sentience or comprehension. The student then confessed that he had searched them up the night before using, you guessed it, ChatGPT. Which had just invented BS, but because he hadn't actually studied, he bought it.</p><p></p><p>Unfortunately, this is literally as he was walking into an exam worth 25% of his final mark. So I told him not to use any of the BS and just do his best with what he knew and...we will see. Results are published later today, actually. Not good, though.</p><p></p><p>And what struck me was how confident he was in the AI. As mentioned, I had personally created a rigorous study guide for them, which included tons of relevant quotations, but required effort. And instead, he had come in confident that a few hours with AI could replace putting in the work.</p></blockquote><p></p>
[QUOTE="Clint_L, post: 9698866, member: 7035894"] An anecdote: the International Baccalaureate diploma is very rigorous - it is basically modeled on British A-levels, and students earn univeristy transfer credit if they earn high enough marks in a subject. Although some of the assessment is done internally, all of it is moderated by IB, and most courses conclude with sets of rigorous exams that are anomynized and externally assessed. In Language and Literature, which I teach, the last exam students write is their Paper 2, an exacting compare/contrast essay discussing two studied works of literature in response to one of four prompts that are unknown until the start of the exam (example: "In the work of two authors you have studied, compare how the physical setting creates a tension that sustains the reader’s interest."). In order to succeed, students cannot discuss their texts in general terms, they must know them inside out, and be able to support their argument with specific references, which means memorized quotations. So one thing they do when revising and prepping their focus texts is to memorize a number of key quotations that could be unpacked in the context of various essay prompts - basically, that speak to the heart of their texts. This year, as the students gathered for the exam and we teachers were there to cheerlead them, a number were flexing their knowledge a bit - "look at how well I know my stuff" - the usual business. And one student started rattling off quotations from British poet Simon Armitage to me. Except they weren't. I knew this instantly as I had, just this term, prepared a new study guide for Armitage. The student argued with me, and then even showed me his study notes, with a huge number of quotations that purported to be from Armitage but were instead generic pablum that approximated the themes of his work as generated by, say, an algorithmic program with no actual sentience or comprehension. The student then confessed that he had searched them up the night before using, you guessed it, ChatGPT. Which had just invented BS, but because he hadn't actually studied, he bought it. Unfortunately, this is literally as he was walking into an exam worth 25% of his final mark. So I told him not to use any of the BS and just do his best with what he knew and...we will see. Results are published later today, actually. Not good, though. And what struck me was how confident he was in the AI. As mentioned, I had personally created a rigorous study guide for them, which included tons of relevant quotations, but required effort. And instead, he had come in confident that a few hours with AI could replace putting in the work. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*Geek Talk & Media
Judge decides case based on AI-hallucinated case law
Top