• The VOIDRUNNER'S CODEX is coming! Explore new worlds, fight oppressive empires, fend off fearsome aliens, and wield deadly psionics with this comprehensive boxed set expansion for 5E and A5E!

RPG Evolution: The AI DM in Action

How might WOTC launch an AI-powered DM assistant?

How might WOTC launch an AI-powered DM assistant?

technology-4256272_1280.jpg

Picture courtesy of Pixabay.

We know Wizards of the Coast is tinkering with Artificial Intelligence (AI)-powered tools for its multiple properties, including Dungeons & Dragons. But what might that look like in practice?

Interactive NPCs​

Large Language Model (LLM) AIs have been used extensively to create non-player characters of all stripes on Character.AI. It's not a stretch to imagine that Wizards might have official NPCs included as part of the digital purchase of an adventure, with the rough outline of the NPC acting as parameters for how it would interact. DMs might be able to create their own or modify existing NPCs so that the character drops hints or communicates in a certain way. Log outputs could then be available for DMs to use later.

There are several places today where you can create NPC bots powered by AI that are publicly available, although the DM might need to monitor the output in real time to record the conversation. Character.AI and Poe.com both provide the ability to create publicly available characters that players can interact with .

Random Generators​

There are already dozens of these in existence. What's particularly of note is that AI can go deep -- not just randomize what book is in a library, but provide snippets of text of what's in that book. Not just detail the name of a forgotten magic item, but provide stats for the item. For WOTC products, this could easily cover details that no print product can possibly encompass in detail, or with parameters (for example, only a library with books on necromancy).

AI RPG companion is a great example of this, but there are many more.

Tabletop Assistants​

Hasbro recently partnered with Xplored, with the goal of developing a "new tabletop platform that integrates digital and physical play." Of particular note is how Xplore's technology works: its system "intelligently resolves rules and character behaviors, and provides innovative gameplay, new scenarios and ever-changing storytelling events. The technology allows players to learn by playing with no rulebook needed, save games to resume later, enables remote gameplay, and offers features like immersive contextual sound and connected dice."

If that sounds like it could be used to enhance an in-person Dungeons & Dragons game, Xplored is already on that path with Teburu, a digital board game platform that uses "smart-sensing technology, AI, and dynamic multimedia." Xplored's AI platform could keep track of miniatures on a table, dice rolls, and even the status of your character sheet, all managed invisibly and remotely by an AI behind the scenes and communicating with the (human) DM.

Dungeon Master​

And then there's the most challenging aspect of play that WOTC struggles with to this day: having enough Dungeon Masters to support a group. Wizards could exclusively license these automated DMs, who would have all the materials necessary to run a game. Some adventures would be easier for an AI DM to run than others -- straightforward dungeon crawls necessarily limit player agency and ensure the AI can run it within parameters, while a social setting could easily confuse it.

Developers are already pushing this model with various levels of success. For an example, see AI Realm.

What's Next?​

If Hasbro's current CEO and former WOTC CEO Chris Cocks is serious about AI, this is just a hint at what's possible. If the past battles over virtual tabletops are any indication, WOTC will likely take a twofold approach: ensure it's AI is well-versed in how it engages with adventures, and defend its branded properties against rival AI platforms that do the same thing. As Cocks pointed out in a recent interview, WOTC's advantage isn't in the technology itself but in its licenses, and it will likely all have a home on D&D Beyond. Get ready!
 

log in or register to remove this ad

Michael Tresca

Michael Tresca

LesserThan

Explorer
I think that this is less a D&D thing and more a YouTube thing. YouTube seems to go out of its way to promote content dissing on other content and that generally promotes angry reactions. It is not confined to D&D fans.
Twitter, Reddit, and every social media Youtube video reference also does it. Mire often than not, it is D&D players that are the cause of drustration in the TRPG hobby, ans was even before White Wolf started as a company.

D&D always acted like the god of gaming, and never grew out of that phase. :(
 

log in or register to remove this ad

Reynard

Legend
Supporter
"Can", being the key word. Do you think WotC is willing to develop such a LLM, that it can keep Ravenloft seperate from Forgotten Realms, as well as maintain the databases to apply house rules for individual games for little to no cost?

From what I understand Beyond can not even handle house rules or custom content well. :(
WotC isn't going to develop an LLM, it is going to license one to incorporate into the Beyond experience.
 

A lot of you are clearly not using LLMs currently, based on the limits you assume apply. You absolutely can tell Claude3 to respond in a specific character manner,from an angry Reddit poster to a Shakespearean fool etc. The memories get longer with each iteration, as well, and you can feed specific documents into them to ask questions about or use as reference.

Even people in the field are regularly shocked at just how good the LLMs are. If all you know about AI is that Midjourney still can't draw hands, you are a year out of date and that's an eternity.

All that said, the LLMs aren't AGI, and I think you would need AGI to create a real workable AI GM.
I have seen more up to date ai art and it looks still absolutely terrible, even if it gets hands right, I really doubt the writing got any better.
 

Dire Bare

Legend
Yes, from what I have seem online the "D&D crowd" not only targets other D&D players, but other games players as well.
Perhaps within toxic sub-communities in the RPG space on X or YouTube. But in the broader community? No.

X (Twitter) is a cesspool regardless of what you're there for, D&D or something else. And the YouTube algorithm promotes "controversial" videos, both for D&D YouTubers and other fandoms. It's a social media thing, not a D&D community thing.
 

LesserThan

Explorer
Perhaps within toxic sub-communities in the RPG space on X or YouTube. But in the broader community? No.

X (Twitter) is a cesspool regardless of what you're there for, D&D or something else. And the YouTube algorithm promotes "controversial" videos, both for D&D YouTubers and other fandoms. It's a social media thing, not a D&D community thing.
are forums now classified as social media too?
 

timbannock

Hero
Supporter
I have seen more up to date ai art and it looks still absolutely terrible, even if it gets hands right, I really doubt the writing got any better.
Just as a test, in the heat of a moment during a game session I asked Bard (at the time) to write me a short dream sequence (3-5 paragraphs) for a player to experience a very positive "blessing" from their deity, and juxtaposed that AI-written scene with a sequence I had developed a while back for another player that was framed sort of as a nightmare sequence (though parts were really happening) I was waiting to spring on them. (Don't worry, both things made sense in the story, even if this explanation doesn't, since it loses effectively all of the context ;-P) Important to note that the AI sequence was about a god specific to the Forgotten Realms, and the metaphors I asked it to work in were very simple (something like "what blessing would Lliira give a devoted follower via a dream who was doubting their path?")...but framing it as a dream sequence seemed to me like a tall order for AI to do. I fully expected the prompt to fail, and to just have to wing something completely else.

Turns out the players universally thought that was the best sequence in the campaign up to this point, as I interweaved the two scenes. Mind you, AI only did half the work, and didn't handle the shifting of the spotlight between the two players' experiences, but the fact is that the AI-written portion of that scene was used almost word-for-word, and no one picked up on any difference from my usual GMing aside from calling it out at the end of the session as a really good, strong sequence.

So...I dunno, maybe my "usual" is actually pretty sucky, but I hope not! ;-P

Joking aside, the learning I took away is that AI actually can handle certain, moderately decent prompts pretty damn well when you give it the right parameters. And it did it so fast that the players didn't notice a transition from me running the game completely normally to adding an entire pre-written short sequence, half of which was written on the spot using AI from a 2-3 sentence prompt.
 

LesserThan

Explorer
WotC isn't going to develop an LLM, it is going to license one to incorporate into the Beyond experience.
It hired another company to feed all the TSR, WotC and online sales material from the past 50 years into according to the NPR article interview with CEO Chris.

I do not think Beyond will get it. The big money Chris Cao wants for his VTT, means it will need AI DMs to produce more revenue at recurring cost points, than BG3 did.

The tools people are talking about will be needed more for the VTT with its greater potential for DM and player microtransaction and DLC.

A LLM that can both narrate, do dialog on the fly for NPCs, and added able to run digital miniature combat is the ultimate goal. If it fits into a mobile app framework, then replace living DMs, the "player" has been sufficiently monitized for Cynthia Williams.

Beyond cant monetize players like that, since not every player will buy the newest adventure to have the AI DM run it. AI DM on Beyond is really counter productive with its current business model, "charge the DM for everything and let them share with players".
 

Thomas Shey

Legend
The survey wasn't about the reason, it was asking people playing how many of them also GM and if they do know at least one person who plays and also gms. Original survey did it for 5e and OSR on Questing Beast's youtube channel, someone repeated it on Pathfinder 2e subeddit. Results for 5e and 2e had majority percentage of people who only play but don't run not do they know anyone who plays and runs, while for OSR it was an even split. Granted, the number of people who voted on Pathfinder survey was smaller, but it's the best we got.

If it was small enough, doesn't really mean much, "best" or not.
 

Thomas Shey

Legend
I have seen more up to date ai art and it looks still absolutely terrible, even if it gets hands right, I really doubt the writing got any better.

I've got to say if you think all current AI art looks "absolutely terrible", your standards are either exceedingly high, or you're going in with such an expectation it ll be you're projecting on it. Art AIs can produce too wide a variety of work for that to otherwise make sense. The most you can say is that versions that don't have style prompts have a tendency to look very similar, probably from having been trained on mostly the same material.
 

grimmgoose

Adventurer
To call it "unimaginative and trope-y" would be insulting to stuff that unimaginative and trope-y.

God this is so true. I use AI in my day-to-day life (both in work and in play), but as it currently stands, the best use case is to have the robot throw a bunch of nonsense at the wall, from which you can kickstart your own imagination.

You can get better responses through prompt engineering, but that only goes so far, and at a certain point you're spending more time talking to the LLM than you are actually getting the work done.

I went through a point where AI was heavily involved in every step of my D&D prep, for example, but now it's mostly relegated to:
  • copy/pasting statblocks and asking it to convert them to a Markdown format
  • initial brainstorm that is heavily templated (use this template to create a small mining village)
    • this is technically a multi-step process; the template breaks the content up into the environment, the people, and the adventure hooks
I throw out 85% of everything the AI gives me. The remaining 15% (which don't get me wrong, is helpful) gets beaten into shape by my own human brain.
 

Remove ads

Remove ads

Top