Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Next
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
Twitch
YouTube
Facebook (EN Publishing)
Facebook (EN World)
Twitter
Instagram
TikTok
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Community
General Tabletop Discussion
*Dungeons & Dragons
RPG Evolution - The AI DM: Monster Maker Mischief
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="talien" data-source="post: 8992078" data-attributes="member: 3285"><p>With AI confidently creating anything we ask of it, even when it's factually inaccurate, how does it perform when creating monsters?</p><p></p><p style="text-align: center">[ATTACH=full]281924[/ATTACH]</p> <p style="text-align: center"><a href="https://pixabay.com/photos/fantasy-dino-dinosaur-reptile-6611533/" target="_blank">Picture courtesy of Pixabay.</a></p><h3>What's a Monster?</h3><p>When generating monsters for fantasy tabletop role-playing games, it's difficult to pinpoint what's an accurate depiction of a creature. After all, mythology is a rich tapestry of interwoven ideas to create the background for a beast that is later codified through the retelling. Is a basilisk a <a href="https://commons.wikimedia.org/w/index.php?curid=752184" target="_blank">creature with eight legs</a> or <a href="https://en.wikipedia.org/wiki/Basilisk#/media/File:IMG_3734_-_Milano_-_Stemma_visconteo-_sull%27Arcivescovado_-_Foto_di_Giovanni_Dall%27Orto_-_15-jan-2007.jpg" target="_blank">a snake</a>?</p><p></p><p>So it's useful to use dinosaurs as an example. Thanks to paleontology, we have a general sense of how large certain dinosaurs behaved, the ecosystems where they lived (e.g., grasslands, forests, fresh or saltwater), and their dietary habits (carnivore, herbivore, etc.). If AI does its homework, while there will undoubtedly be variance in statistics and abilities, it should get a dinosaur's core attributes right.</p><h3>Meet Our Contestants</h3><p><a href="https://chat.openai.com/" target="_blank">ChatGPT</a> is a (currently) free research preview and is one of the most popular AI due its free access. <a href="https://notion-apps.net/" target="_blank">Notion</a> is a "freemium" productivity and note-taking web application that includes AI. Both are Large Language Models (LLM), which means they source their responses from data sets on the Internet.</p><p></p><p>The first test will be to create Fifth Edition Dungeons & Dragons statistics for shonisaurus.</p><h3>Meet Shonisaurus</h3><p><a href="https://en.wikipedia.org/wiki/Shonisaurus" target="_blank">Shonisaurus</a> is noteworthy because it was a huge sea creature, an air-breathing reptile that grew up to 50 feet long. A quick search reveals any shonisaurus stats should be Huge or larger, have a high Strength and Constitution, hold its breath, and have a swim speed that's faster than its land speed. Just about everything else is open to interpretation.</p><p></p><p>How did the two LLMs do when asked "Create D&D 5E stats for shonisaurus"? Here's what Notion came up with:</p><h4>Shonisaurus</h4> <ul> <li data-xf-list-type="ul"><em><em>Huge beast, unaligned</em></em></li> <li data-xf-list-type="ul"><strong>Armor Class </strong>16 (natural armor)</li> <li data-xf-list-type="ul"><strong>Hit Points </strong>195 (17d12 + 85)</li> <li data-xf-list-type="ul"><strong>Speed </strong>60 ft., swim 60 ft.</li> <li data-xf-list-type="ul"><strong>STR </strong>25 (+7) <strong>DEX </strong>14 (+2) <strong>CON </strong>21 (+5) <strong>INT </strong>2 (-4) <strong>WIS </strong>12 (+1) <strong>CHA </strong>5 (-3)</li> <li data-xf-list-type="ul"><strong>Skills </strong>Athletics +12, Perception +5</li> <li data-xf-list-type="ul"><strong>Senses </strong>passive Perception 15</li> <li data-xf-list-type="ul"><strong>Languages </strong>—</li> <li data-xf-list-type="ul"><strong>Challenge </strong>9 (5,000 XP)</li> <li data-xf-list-type="ul"><strong><em>Hold Breath. </em></strong>The shonisaurus can hold its breath for 1 hour.</li> <li data-xf-list-type="ul"><strong><strong>Actions</strong></strong></li> <li data-xf-list-type="ul"><strong><em>Bite. </em></strong>Melee Weapon Attack: +12 to hit, reach 15 ft., one target. Hit: 30 (4d10 + 7) piercing damage.</li> <li data-xf-list-type="ul"><strong><em>Tail. </em></strong>Melee Weapon Attack: +12 to hit, reach 20 ft., one target. Hit: 24 (4d6 + 7) bludgeoning damage.</li> <li data-xf-list-type="ul"><strong><strong>Legendary Actions</strong></strong></li> <li data-xf-list-type="ul">The shonisaurus can take 3 legendary actions, choosing from the options below. Only one legendary action option can be used at a time and only at the end of another creature's turn. The shonisaurus regains spent legendary actions at the start of its turn.</li> <li data-xf-list-type="ul"><strong><em>Detect. </em></strong>The shonisaurus makes a Wisdom (Perception) check.</li> <li data-xf-list-type="ul"><strong><em>Tail Swipe. </em></strong>The shonisaurus makes a tail attack.</li> <li data-xf-list-type="ul"><strong><em>Fling. </em></strong>The shonisaurus makes a bite attack against a target and, if successful, flings the target up to 30 feet away.</li> </ul><p>Notion gives shonisaurus legendary actions on the scale of a dragon, including detect, tail swipe, and fling. This isn't out of character for a 17 hit dice huge creature, but given its size it should probably be larger. Its land speed seems too fast for a creature that has flippers instead of feet.</p><p></p><p>Let's see how ChatGPT manages the shonisaurus:</p><h4>Shonisaurus</h4> <ul> <li data-xf-list-type="ul"><em><em>Huge beast, unaligned</em></em></li> <li data-xf-list-type="ul"><strong>Armor Class: </strong>16 (natural armor)</li> <li data-xf-list-type="ul"><strong>Hit Points: </strong>198 (12d12+84)</li> <li data-xf-list-type="ul"><strong>Speed: </strong>swim 50 ft.</li> <li data-xf-list-type="ul"><strong><strong>STR DEX CON INT WIS CHA</strong></strong></li> <li data-xf-list-type="ul">24 (+7) 10 (+0) 24 (+7) 2 (-4) 12 (+1) 5 (-3)</li> <li data-xf-list-type="ul"><strong>Skills: </strong>Perception +6</li> <li data-xf-list-type="ul"><strong>Senses: </strong>darkvision 60 ft., passive Perception 16</li> <li data-xf-list-type="ul"><strong>Languages</strong>: --</li> <li data-xf-list-type="ul"><strong>Challenge: </strong>10 (5,900 XP)</li> <li data-xf-list-type="ul"><strong>Amphibious. </strong>The shonisaurus can breathe air and water.</li> <li data-xf-list-type="ul"><strong><strong>Actions:</strong></strong></li> <li data-xf-list-type="ul"><strong><em>Bite. </em></strong>Melee Weapon Attack: +11 to hit, reach 10 ft., one target. Hit: 28 (4d10 + 7) piercing damage.</li> <li data-xf-list-type="ul"><strong><em>Tail Slap. </em></strong>Melee Weapon Attack: +11 to hit, reach 15 ft., one target. Hit: 32 (4d12 + 7) bludgeoning damage.</li> <li data-xf-list-type="ul"><strong><em>Swallow. </em></strong>The shonisaurus can attempt to swallow a Medium or smaller creature that it has grappled with its bite attack. The target must make a DC 19 Dexterity saving throw or be swallowed by the shonisaurus. A swallowed creature is blinded and restrained, it has total cover against attacks and other effects outside the shonisaurus, and it takes 21 (6d6) acid damage at the start of each of the shonisaurus's turns. The shonisaurus can have up to two Medium creatures, four Small creatures, or eight Tiny creatures swallowed at one time.</li> <li data-xf-list-type="ul"><strong><em>Frightful Presence. </em></strong>Each creature of the shonisaurus's choice within 30 feet of it and aware of it must succeed on a DC 17 Wisdom saving throw or become frightened for 1 minute. A creature can repeat the saving throw at the end of each of its turns, ending the effect on itself on a success. If a creature's saving throw is successful or the effect ends for it, the creature is immune to the shonisaurus's Frightful Presence for the next 24 hours.</li> </ul><p>While ChatGPT got the size and stats about right, and its speeds make more sense, the fact that it made a swimming creature amphibious shows the limitations of a tool like this. It's interpreting a swimming creature that's a whale-like reptile as logically being amphibious. It also gives the shonisaurus swallow (appropriate) and frightful presence (might be pushing it for a natural creature).</p><p></p><p>You won't find the fact that shonisaurus breathes air on its Wikipedia entry. Shonisaurus was an <a href="https://en.wikipedia.org/wiki/Ichthyosaur" target="_blank">icthyosaur</a>, which means it had to surface for air like a porpoise. In short, LLMs that take into account more sources than just Wikipedia will likely get closer to an accurate depiction of the beast. In this case, Notion did a better job.</p><p></p><p>Let's try another one.</p><h3>Meet Tanystropheus</h3><p><a href="https://en.wikipedia.org/wiki/Tanystropheus" target="_blank">Tanystropheus</a> was a 20-ft.-long larchosauromorph reptile from the Middle and Late Triassic epochs. It is notable for its very long neck (nearly 10 feet long), giving it considerable reach. Tanystropheus' paleobiology is somewhat controversial in that its peculiar appearance has caused disagreement among paleontologists as to its biology: it was originally thought that it was a confined to waterways due to the massive neck. Recent biomechanics has pegged it more as a shore predator who "fished" with its neck.</p><p></p><p>Given these traits, we would expect a large or larger creature with a bite attack of at least 10 feet. It should be a swimmer, and if the AI uses the most recent data about it, will give it tanystropheus the ability to hold its breath instead of being amphibious.</p><p></p><p>Here's what Notion came up with:</p><h4>Tanystropheus</h4> <ul> <li data-xf-list-type="ul"><em><em>Large beast, unaligned</em></em></li> <li data-xf-list-type="ul"><strong>Armor Class </strong>14 (natural armor)</li> <li data-xf-list-type="ul"><strong>Hit Points </strong>76 (8d10 + 32)</li> <li data-xf-list-type="ul"><strong>Speed </strong>30 ft., swim 30 ft.</li> <li data-xf-list-type="ul"><strong>STR </strong>18 (+4) <strong>DEX </strong>14 (+2) <strong>CON </strong>18 (+4) <strong>INT </strong>2 (-4) <strong>WIS </strong>12 (+1) <strong>CHA </strong>5 (-3)</li> <li data-xf-list-type="ul"><strong>Skills </strong>Athletics +6, Perception +5</li> <li data-xf-list-type="ul"><strong>Senses </strong>passive Perception 15</li> <li data-xf-list-type="ul"><strong>Languages </strong>—</li> <li data-xf-list-type="ul"><strong>Challenge </strong>4 (1,100 XP)</li> <li data-xf-list-type="ul"><strong><em>Hold Breath. </em></strong>The tanystropheus can hold its breath for 1 hour.</li> <li data-xf-list-type="ul"><strong><strong>Actions</strong></strong></li> <li data-xf-list-type="ul"><strong><em>Bite</em></strong>. Melee Weapon Attack: +6 to hit, reach 10 ft., one target. Hit: 15 (2d10 + 4) piercing damage.</li> <li data-xf-list-type="ul"><strong><em>Tail</em></strong>. Melee Weapon Attack: +6 to hit, reach 15 ft., one target. Hit: 11 (2d6 + 4) bludgeoning damage.</li> <li data-xf-list-type="ul"><strong><strong>Legendary Actions</strong></strong></li> <li data-xf-list-type="ul">The tanystropheus can take 2 legendary actions, choosing from the options below. Only one legendary action option can be used at a time and only at the end of another creature's turn. The tanystropheus regains spent legendary actions at the start of its turn.</li> <li data-xf-list-type="ul"><strong><em>Detect. </em></strong>The tanystropheus makes a Wisdom (Perception) check.</li> <li data-xf-list-type="ul"><strong><em>Tail Swipe. </em></strong>The tanystropheus makes a tail attack.</li> </ul><p>Like shonisaurus, Notion provides a equal walking speed to the swim speed, which seems unlikely. It also gives the tail a longer reach than its neck, making it effectively larger (at least 25 feet reach between the two) than the creature's established full length. For some reason it has Legendary Actions as a 8 HD critter that has a challenge rating of 4 (Notion really loves giving creatures Legendary Actions!). To its credit, it gave the tanystropheus only 2 of them.</p><p></p><p>Here's how ChatGPT did:</p><h4><strong>Tanystropheus</strong></h4> <ul> <li data-xf-list-type="ul"><em><em>Large beast, unaligned</em></em></li> <li data-xf-list-type="ul"><strong>Armor Class: </strong>15 (natural armor)</li> <li data-xf-list-type="ul"><strong>Hit Points: </strong>112 (15d10+30)</li> <li data-xf-list-type="ul"><strong>Speed: </strong>30 ft., swim 40 ft.</li> <li data-xf-list-type="ul"><strong><strong>STR DEX CON INT WIS CHA</strong></strong></li> <li data-xf-list-type="ul">18 (+4) 16 (+3) 14 (+2) 2 (-4) 12 (+1) 5 (-3)</li> <li data-xf-list-type="ul"><strong>Skills: </strong>Perception +3</li> <li data-xf-list-type="ul"><strong>Senses: </strong>passive Perception 13</li> <li data-xf-list-type="ul"><strong>Languages: </strong>--</li> <li data-xf-list-type="ul"><strong>Challenge: </strong>5 (1,800 XP)</li> <li data-xf-list-type="ul"><strong><em>Multiattack. </em></strong>The Tanystropheus can use its Bite attack twice per turn.</li> <li data-xf-list-type="ul"><strong><strong>Actions:</strong></strong></li> <li data-xf-list-type="ul"><strong><em>Bite. </em></strong>Melee Weapon Attack: +7 to hit, reach 10 ft., one target. Hit: 18 (3d8 + 4) piercing damage.</li> <li data-xf-list-type="ul"><strong><em>Tail Slap. </em></strong>Melee Weapon Attack: +7 to hit, reach 10 ft., one target. Hit: 16 (3d6 + 4) bludgeoning damage.</li> <li data-xf-list-type="ul"><strong><em>Long Neck. </em></strong>The Tanystropheus has a long neck that can extend up to 30 feet. It can use its Long Neck ability to make Bite or Tail Slap attacks against creatures up to 30 feet away.</li> <li data-xf-list-type="ul"><strong><em>Hold Breath. </em></strong>The Tanystropheus can hold its breath for up to 30 minutes.</li> </ul><p>ChatGPT does better with this one, but makes a curious choice: it creates a special ability known as "Long Neck" that determines it can use its bite to reach creatures up to 30 feet away. The Tail Slap and Long Neck attacks should simply have a reach of 30 ft., but it seems as if ChatGPT is drawing on a different rules set for this trait, possibly an older version of D&D.</p><p></p><p>Despite that peculiarity, ChatGPT did a better job with this one.</p><h3>The Problem with Internet Content</h3><p>Because Large Language Model AIs use undisclosed data sets, we can't be sure where they pull inspiration for their 5E monsters. But we can make a few guesses.</p><p></p><p>For one, the open game license movement has been around since 3.5 Edition and accelerated sharply under Pathfinder. As a result, there is an enormous body of work that eclipses even 5E content on the Internet that LLMs might pull from. In my tests, the AI often provided content that was obviously from a different edition of D&D (the "Long Neck" trait being one example).</p><p></p><p>But OGL content that's drawn from companies like Paizo and WOTC are at least playtested before they're released. The other giant source of publicly available D&D data is wikis and other fan made content. This wild and woolly world of creativity is less constrained by game balance, and likely eclipses even the official OGL content.</p><p></p><p>The third thing to consider is that from a search engine optimization perspective, the characters "5E" are found both in "D&D 5E" and "D&D 3.5E". We might get better results typing out "Dungeons & Dragons Fifth Edition" instead of "D&D 5E" when asking LLMs for RPG content.</p><h3>Should You Use It?</h3><p>Both Notion and ChatGPT can be enormously helpful in generating monster ideas. But they're also significantly flawed in their approach, such that game masters will want to use them with caution. In both experiments, I wasn't satisfied with either result and preferred to mix and match the two versions to create my own.</p><p></p><p>But it still created something out of nothing that was certainly good enough for a home game that a DM could use on the fly. In that regard, it's probably good enough for most gamers to use.</p></blockquote><p></p>
[QUOTE="talien, post: 8992078, member: 3285"] With AI confidently creating anything we ask of it, even when it's factually inaccurate, how does it perform when creating monsters? [CENTER][ATTACH type="full" alt="fantasy-6611533_960_720.jpg"]281924[/ATTACH] [URL='https://pixabay.com/photos/fantasy-dino-dinosaur-reptile-6611533/']Picture courtesy of Pixabay.[/URL][/CENTER] [HEADING=2]What's a Monster?[/HEADING] When generating monsters for fantasy tabletop role-playing games, it's difficult to pinpoint what's an accurate depiction of a creature. After all, mythology is a rich tapestry of interwoven ideas to create the background for a beast that is later codified through the retelling. Is a basilisk a [URL='https://commons.wikimedia.org/w/index.php?curid=752184']creature with eight legs[/URL] or [URL='https://en.wikipedia.org/wiki/Basilisk#/media/File:IMG_3734_-_Milano_-_Stemma_visconteo-_sull%27Arcivescovado_-_Foto_di_Giovanni_Dall%27Orto_-_15-jan-2007.jpg']a snake[/URL]? So it's useful to use dinosaurs as an example. Thanks to paleontology, we have a general sense of how large certain dinosaurs behaved, the ecosystems where they lived (e.g., grasslands, forests, fresh or saltwater), and their dietary habits (carnivore, herbivore, etc.). If AI does its homework, while there will undoubtedly be variance in statistics and abilities, it should get a dinosaur's core attributes right. [HEADING=2]Meet Our Contestants[/HEADING] [URL='https://chat.openai.com/']ChatGPT[/URL] is a (currently) free research preview and is one of the most popular AI due its free access. [URL='https://notion-apps.net/']Notion[/URL] is a "freemium" productivity and note-taking web application that includes AI. Both are Large Language Models (LLM), which means they source their responses from data sets on the Internet. The first test will be to create Fifth Edition Dungeons & Dragons statistics for shonisaurus. [HEADING=2]Meet Shonisaurus[/HEADING] [URL='https://en.wikipedia.org/wiki/Shonisaurus']Shonisaurus[/URL] is noteworthy because it was a huge sea creature, an air-breathing reptile that grew up to 50 feet long. A quick search reveals any shonisaurus stats should be Huge or larger, have a high Strength and Constitution, hold its breath, and have a swim speed that's faster than its land speed. Just about everything else is open to interpretation. How did the two LLMs do when asked "Create D&D 5E stats for shonisaurus"? Here's what Notion came up with: [HEADING=3]Shonisaurus[/HEADING] [LIST] [*][I][I]Huge beast, unaligned[/I][/I] [*][B]Armor Class [/B]16 (natural armor) [*][B]Hit Points [/B]195 (17d12 + 85) [*][B]Speed [/B]60 ft., swim 60 ft. [*][B]STR [/B]25 (+7) [B]DEX [/B]14 (+2) [B]CON [/B]21 (+5) [B]INT [/B]2 (-4) [B]WIS [/B]12 (+1) [B]CHA [/B]5 (-3) [*][B]Skills [/B]Athletics +12, Perception +5 [*][B]Senses [/B]passive Perception 15 [*][B]Languages [/B]— [*][B]Challenge [/B]9 (5,000 XP) [*][B][I]Hold Breath. [/I][/B]The shonisaurus can hold its breath for 1 hour. [*][B][B]Actions[/B][/B] [*][B][I]Bite. [/I][/B]Melee Weapon Attack: +12 to hit, reach 15 ft., one target. Hit: 30 (4d10 + 7) piercing damage. [*][B][I]Tail. [/I][/B]Melee Weapon Attack: +12 to hit, reach 20 ft., one target. Hit: 24 (4d6 + 7) bludgeoning damage. [*][B][B]Legendary Actions[/B][/B] [*]The shonisaurus can take 3 legendary actions, choosing from the options below. Only one legendary action option can be used at a time and only at the end of another creature's turn. The shonisaurus regains spent legendary actions at the start of its turn. [*][B][I]Detect. [/I][/B]The shonisaurus makes a Wisdom (Perception) check. [*][B][I]Tail Swipe. [/I][/B]The shonisaurus makes a tail attack. [*][B][I]Fling. [/I][/B]The shonisaurus makes a bite attack against a target and, if successful, flings the target up to 30 feet away. [/LIST] Notion gives shonisaurus legendary actions on the scale of a dragon, including detect, tail swipe, and fling. This isn't out of character for a 17 hit dice huge creature, but given its size it should probably be larger. Its land speed seems too fast for a creature that has flippers instead of feet. Let's see how ChatGPT manages the shonisaurus: [HEADING=3]Shonisaurus[/HEADING] [LIST] [*][I][I]Huge beast, unaligned[/I][/I] [*][B]Armor Class: [/B]16 (natural armor) [*][B]Hit Points: [/B]198 (12d12+84) [*][B]Speed: [/B]swim 50 ft. [*][B][B]STR DEX CON INT WIS CHA[/B][/B] [*]24 (+7) 10 (+0) 24 (+7) 2 (-4) 12 (+1) 5 (-3) [*][B]Skills: [/B]Perception +6 [*][B]Senses: [/B]darkvision 60 ft., passive Perception 16 [*][B]Languages[/B]: -- [*][B]Challenge: [/B]10 (5,900 XP) [*][B]Amphibious. [/B]The shonisaurus can breathe air and water. [*][B][B]Actions:[/B][/B] [*][B][I]Bite. [/I][/B]Melee Weapon Attack: +11 to hit, reach 10 ft., one target. Hit: 28 (4d10 + 7) piercing damage. [*][B][I]Tail Slap. [/I][/B]Melee Weapon Attack: +11 to hit, reach 15 ft., one target. Hit: 32 (4d12 + 7) bludgeoning damage. [*][B][I]Swallow. [/I][/B]The shonisaurus can attempt to swallow a Medium or smaller creature that it has grappled with its bite attack. The target must make a DC 19 Dexterity saving throw or be swallowed by the shonisaurus. A swallowed creature is blinded and restrained, it has total cover against attacks and other effects outside the shonisaurus, and it takes 21 (6d6) acid damage at the start of each of the shonisaurus's turns. The shonisaurus can have up to two Medium creatures, four Small creatures, or eight Tiny creatures swallowed at one time. [*][B][I]Frightful Presence. [/I][/B]Each creature of the shonisaurus's choice within 30 feet of it and aware of it must succeed on a DC 17 Wisdom saving throw or become frightened for 1 minute. A creature can repeat the saving throw at the end of each of its turns, ending the effect on itself on a success. If a creature's saving throw is successful or the effect ends for it, the creature is immune to the shonisaurus's Frightful Presence for the next 24 hours. [/LIST] While ChatGPT got the size and stats about right, and its speeds make more sense, the fact that it made a swimming creature amphibious shows the limitations of a tool like this. It's interpreting a swimming creature that's a whale-like reptile as logically being amphibious. It also gives the shonisaurus swallow (appropriate) and frightful presence (might be pushing it for a natural creature). You won't find the fact that shonisaurus breathes air on its Wikipedia entry. Shonisaurus was an [URL='https://en.wikipedia.org/wiki/Ichthyosaur']icthyosaur[/URL], which means it had to surface for air like a porpoise. In short, LLMs that take into account more sources than just Wikipedia will likely get closer to an accurate depiction of the beast. In this case, Notion did a better job. Let's try another one. [HEADING=2]Meet Tanystropheus[/HEADING] [URL='https://en.wikipedia.org/wiki/Tanystropheus']Tanystropheus[/URL] was a 20-ft.-long larchosauromorph reptile from the Middle and Late Triassic epochs. It is notable for its very long neck (nearly 10 feet long), giving it considerable reach. Tanystropheus' paleobiology is somewhat controversial in that its peculiar appearance has caused disagreement among paleontologists as to its biology: it was originally thought that it was a confined to waterways due to the massive neck. Recent biomechanics has pegged it more as a shore predator who "fished" with its neck. Given these traits, we would expect a large or larger creature with a bite attack of at least 10 feet. It should be a swimmer, and if the AI uses the most recent data about it, will give it tanystropheus the ability to hold its breath instead of being amphibious. Here's what Notion came up with: [HEADING=3]Tanystropheus[/HEADING] [LIST] [*][I][I]Large beast, unaligned[/I][/I] [*][B]Armor Class [/B]14 (natural armor) [*][B]Hit Points [/B]76 (8d10 + 32) [*][B]Speed [/B]30 ft., swim 30 ft. [*][B]STR [/B]18 (+4) [B]DEX [/B]14 (+2) [B]CON [/B]18 (+4) [B]INT [/B]2 (-4) [B]WIS [/B]12 (+1) [B]CHA [/B]5 (-3) [*][B]Skills [/B]Athletics +6, Perception +5 [*][B]Senses [/B]passive Perception 15 [*][B]Languages [/B]— [*][B]Challenge [/B]4 (1,100 XP) [*][B][I]Hold Breath. [/I][/B]The tanystropheus can hold its breath for 1 hour. [*][B][B]Actions[/B][/B] [*][B][I]Bite[/I][/B]. Melee Weapon Attack: +6 to hit, reach 10 ft., one target. Hit: 15 (2d10 + 4) piercing damage. [*][B][I]Tail[/I][/B]. Melee Weapon Attack: +6 to hit, reach 15 ft., one target. Hit: 11 (2d6 + 4) bludgeoning damage. [*][B][B]Legendary Actions[/B][/B] [*]The tanystropheus can take 2 legendary actions, choosing from the options below. Only one legendary action option can be used at a time and only at the end of another creature's turn. The tanystropheus regains spent legendary actions at the start of its turn. [*][B][I]Detect. [/I][/B]The tanystropheus makes a Wisdom (Perception) check. [*][B][I]Tail Swipe. [/I][/B]The tanystropheus makes a tail attack. [/LIST] Like shonisaurus, Notion provides a equal walking speed to the swim speed, which seems unlikely. It also gives the tail a longer reach than its neck, making it effectively larger (at least 25 feet reach between the two) than the creature's established full length. For some reason it has Legendary Actions as a 8 HD critter that has a challenge rating of 4 (Notion really loves giving creatures Legendary Actions!). To its credit, it gave the tanystropheus only 2 of them. Here's how ChatGPT did: [HEADING=3][B]Tanystropheus[/B][/HEADING] [LIST] [*][I][I]Large beast, unaligned[/I][/I] [*][B]Armor Class: [/B]15 (natural armor) [*][B]Hit Points: [/B]112 (15d10+30) [*][B]Speed: [/B]30 ft., swim 40 ft. [*][B][B]STR DEX CON INT WIS CHA[/B][/B] [*]18 (+4) 16 (+3) 14 (+2) 2 (-4) 12 (+1) 5 (-3) [*][B]Skills: [/B]Perception +3 [*][B]Senses: [/B]passive Perception 13 [*][B]Languages: [/B]-- [*][B]Challenge: [/B]5 (1,800 XP) [*][B][I]Multiattack. [/I][/B]The Tanystropheus can use its Bite attack twice per turn. [*][B][B]Actions:[/B][/B] [*][B][I]Bite. [/I][/B]Melee Weapon Attack: +7 to hit, reach 10 ft., one target. Hit: 18 (3d8 + 4) piercing damage. [*][B][I]Tail Slap. [/I][/B]Melee Weapon Attack: +7 to hit, reach 10 ft., one target. Hit: 16 (3d6 + 4) bludgeoning damage. [*][B][I]Long Neck. [/I][/B]The Tanystropheus has a long neck that can extend up to 30 feet. It can use its Long Neck ability to make Bite or Tail Slap attacks against creatures up to 30 feet away. [*][B][I]Hold Breath. [/I][/B]The Tanystropheus can hold its breath for up to 30 minutes. [/LIST] ChatGPT does better with this one, but makes a curious choice: it creates a special ability known as "Long Neck" that determines it can use its bite to reach creatures up to 30 feet away. The Tail Slap and Long Neck attacks should simply have a reach of 30 ft., but it seems as if ChatGPT is drawing on a different rules set for this trait, possibly an older version of D&D. Despite that peculiarity, ChatGPT did a better job with this one. [HEADING=2]The Problem with Internet Content[/HEADING] Because Large Language Model AIs use undisclosed data sets, we can't be sure where they pull inspiration for their 5E monsters. But we can make a few guesses. For one, the open game license movement has been around since 3.5 Edition and accelerated sharply under Pathfinder. As a result, there is an enormous body of work that eclipses even 5E content on the Internet that LLMs might pull from. In my tests, the AI often provided content that was obviously from a different edition of D&D (the "Long Neck" trait being one example). But OGL content that's drawn from companies like Paizo and WOTC are at least playtested before they're released. The other giant source of publicly available D&D data is wikis and other fan made content. This wild and woolly world of creativity is less constrained by game balance, and likely eclipses even the official OGL content. The third thing to consider is that from a search engine optimization perspective, the characters "5E" are found both in "D&D 5E" and "D&D 3.5E". We might get better results typing out "Dungeons & Dragons Fifth Edition" instead of "D&D 5E" when asking LLMs for RPG content. [HEADING=2]Should You Use It?[/HEADING] Both Notion and ChatGPT can be enormously helpful in generating monster ideas. But they're also significantly flawed in their approach, such that game masters will want to use them with caution. In both experiments, I wasn't satisfied with either result and preferred to mix and match the two versions to create my own. But it still created something out of nothing that was certainly good enough for a home game that a DM could use on the fly. In that regard, it's probably good enough for most gamers to use. [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*Dungeons & Dragons
RPG Evolution - The AI DM: Monster Maker Mischief
Top