Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Upgrade your account to a Community Supporter account and remove most of the site ads.
Community
General Tabletop Discussion
*TTRPGs General
LLMs as a GM
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Scott Christian" data-source="post: 9696206" data-attributes="member: 6901101"><p>Just wanted to share my experiences at having an LLM (in this case, Gemini) act as a gamemaster. I have completed five sessions, each that ran a couple hours long. The system I taught it was my own. The lore it used was written by me, although I gave it creative license to make-up anything it wanted, as long as it stayed with the lore's context. I built several frontload documents for it to reference, which I upload before each session. The frontload documents contain game mechanics, lore, and character summaries. I also have it write a summary of each session, just in case it (or me) needs to reference past events. Here are some key findings:</p><p></p><p>- <strong>Pros</strong></p><ul> <li data-xf-list-type="ul">It does a really nice job with social encounters. That pillar of the game has been consistent, and to be truthful, as good or better than most in-person GMed games. For example, we were spying on the antagonist at a fancy restaurant and the social encounter section (including the skill checks involved) were very well done. The NPCs that have required social skill challenges also went well. For example, we stopped a couple of thieves' guild enforcers using intimidation. </li> <li data-xf-list-type="ul">The exploration pillar is described very well. The skill challenges seem to match the difficulty, and they appear logical. (At least from what I have seen so far.) For example, one of the characters was trying to disarm a trap. The DC was appropriate. One of the characters was using arcana to find any source of magic in a cavern full of debris. The DC seemed appropriate. </li> <li data-xf-list-type="ul">In the combat pillar, it used creatures that were of appropriate strength, setting the correct DC, and giving them an appropriate level of hit points for the encounter.</li> <li data-xf-list-type="ul">The storyline has been entertaining, and even though I wrote the lore, it has still managed to surprise me with a good plot twist. </li> <li data-xf-list-type="ul">It tied in the PCs' backstories very well. (I tried to give it a layup, having the two characters both have their families wrecked by the thieves' guild in the city.) It did this well, and progressed the story nicely.</li> <li data-xf-list-type="ul">I don't know how, but it has a good knack for knowing when to end a session based on the storyline. Like a good gamemaster, it waits until there is downtime and then will end the session. The timing of this has varied. One ended after two hours, another after 45 minutes. But most of the ending were indeed, during a point in the story where you would "start a new chapter."</li> </ul><p><strong>- Cons</strong></p><ul> <li data-xf-list-type="ul">Oddly, like some GMs, it decided to skip one of my PC's turns - twice. Typical gamemaster behavior. <img src="https://cdn.jsdelivr.net/joypixels/assets/8.0/png/unicode/64/1f609.png" class="smilie smilie--emoji" loading="lazy" width="64" height="64" alt=";)" title="Wink ;)" data-smilie="2"data-shortname=";)" /> Once reminded though, it corrected it and allowed the PC to have their turn.</li> <li data-xf-list-type="ul">For some utterly bizarre reason, it seems to have trouble keeping track of coins my characters have. But it doesn't have a problem keeping track of hit points or luck dice?</li> <li data-xf-list-type="ul">It requires some out of character responses that generally involve re-teaching. This can happen in a session, where in the previous session, it had done it successfully. For example, I had to explain that just because my character lost initiative, they could still use a combat card during their turn. It had done this correctly in our other three combat encounters. Why it didn't do it in this one is far beyond me.</li> </ul><p><strong>- Notes</strong></p><p>For those interested in trying this out, I would suggest a few things. </p><ul> <li data-xf-list-type="ul">Use D&D is the first one. It has obviously been trained on that system. For example, it sometimes asks for a skill challenge roll using a skill that is not in my mechanics, but is in D&D's. The frontload document I give it has stopped this. </li> <li data-xf-list-type="ul">Build your frontload documents while you are communicating with it. It will help you use precise wording, and even write it for you after you explain it.</li> <li data-xf-list-type="ul">In your frontload documents, make sure to include examples, <strong>and</strong> non-examples. </li> <li data-xf-list-type="ul">Ask it what it wants. I know, it's weird. But, it has given me precise answers at times. For example, I asked it if it would run a better game using a small area, such as a single city/kingdom or if it would prefer to run a grander adventure using many locales and settings. I know it can change its answer on a dime, but asking questions like this will help tailor your frontload documents to a more specific train of thought.</li> <li data-xf-list-type="ul">Have it write summaries. It hasn't needed them yet and has kept everything pretty coherent (as coherent as most in-person GMs). But knowing its prone to not having a good long-term memory, these might be helpful.</li> </ul><p>For anyone interested, I have copied the summaries into this document so you can see the storyline progression. Also, I am curious if anyone else has tried this out, and what their experiences were. Thanks for reading. </p><p><a href="https://docs.google.com/document/d/1Bt5IuqIAs5o--i_dwC3fMgfa6nuv9D0pPlqvdOmZMG8/edit?usp=sharing" target="_blank">Elias and Emme - Adventure Summary</a></p></blockquote><p></p>
[QUOTE="Scott Christian, post: 9696206, member: 6901101"] Just wanted to share my experiences at having an LLM (in this case, Gemini) act as a gamemaster. I have completed five sessions, each that ran a couple hours long. The system I taught it was my own. The lore it used was written by me, although I gave it creative license to make-up anything it wanted, as long as it stayed with the lore's context. I built several frontload documents for it to reference, which I upload before each session. The frontload documents contain game mechanics, lore, and character summaries. I also have it write a summary of each session, just in case it (or me) needs to reference past events. Here are some key findings: - [B]Pros[/B] [LIST] [*]It does a really nice job with social encounters. That pillar of the game has been consistent, and to be truthful, as good or better than most in-person GMed games. For example, we were spying on the antagonist at a fancy restaurant and the social encounter section (including the skill checks involved) were very well done. The NPCs that have required social skill challenges also went well. For example, we stopped a couple of thieves' guild enforcers using intimidation. [*]The exploration pillar is described very well. The skill challenges seem to match the difficulty, and they appear logical. (At least from what I have seen so far.) For example, one of the characters was trying to disarm a trap. The DC was appropriate. One of the characters was using arcana to find any source of magic in a cavern full of debris. The DC seemed appropriate. [*]In the combat pillar, it used creatures that were of appropriate strength, setting the correct DC, and giving them an appropriate level of hit points for the encounter. [*]The storyline has been entertaining, and even though I wrote the lore, it has still managed to surprise me with a good plot twist. [*]It tied in the PCs' backstories very well. (I tried to give it a layup, having the two characters both have their families wrecked by the thieves' guild in the city.) It did this well, and progressed the story nicely. [*]I don't know how, but it has a good knack for knowing when to end a session based on the storyline. Like a good gamemaster, it waits until there is downtime and then will end the session. The timing of this has varied. One ended after two hours, another after 45 minutes. But most of the ending were indeed, during a point in the story where you would "start a new chapter." [/LIST] [B]- Cons[/B] [LIST] [*]Oddly, like some GMs, it decided to skip one of my PC's turns - twice. Typical gamemaster behavior. ;) Once reminded though, it corrected it and allowed the PC to have their turn. [*]For some utterly bizarre reason, it seems to have trouble keeping track of coins my characters have. But it doesn't have a problem keeping track of hit points or luck dice? [*]It requires some out of character responses that generally involve re-teaching. This can happen in a session, where in the previous session, it had done it successfully. For example, I had to explain that just because my character lost initiative, they could still use a combat card during their turn. It had done this correctly in our other three combat encounters. Why it didn't do it in this one is far beyond me. [/LIST] [B]- Notes[/B] For those interested in trying this out, I would suggest a few things. [LIST] [*]Use D&D is the first one. It has obviously been trained on that system. For example, it sometimes asks for a skill challenge roll using a skill that is not in my mechanics, but is in D&D's. The frontload document I give it has stopped this. [*]Build your frontload documents while you are communicating with it. It will help you use precise wording, and even write it for you after you explain it. [*]In your frontload documents, make sure to include examples, [B]and[/B] non-examples. [*]Ask it what it wants. I know, it's weird. But, it has given me precise answers at times. For example, I asked it if it would run a better game using a small area, such as a single city/kingdom or if it would prefer to run a grander adventure using many locales and settings. I know it can change its answer on a dime, but asking questions like this will help tailor your frontload documents to a more specific train of thought. [*]Have it write summaries. It hasn't needed them yet and has kept everything pretty coherent (as coherent as most in-person GMs). But knowing its prone to not having a good long-term memory, these might be helpful. [/LIST] For anyone interested, I have copied the summaries into this document so you can see the storyline progression. Also, I am curious if anyone else has tried this out, and what their experiences were. Thanks for reading. [URL='https://docs.google.com/document/d/1Bt5IuqIAs5o--i_dwC3fMgfa6nuv9D0pPlqvdOmZMG8/edit?usp=sharing']Elias and Emme - Adventure Summary[/URL] [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*TTRPGs General
LLMs as a GM
Top