D&D 5E (2024) University project on D&D spells

[Hiteshd]

Hi,
I am conducting a survey for my university research project that requires participants who play or are familiar with D&D.
Will you be interested in contributing to it?

It's an anonymous survey where you can try to guess the source of the spells.

Survey on D&D spells

Dungeons & Dragons (D&D) is a well-known tabletop role-playing game that highlights tactical gameplay and cooperative narrative building. In D&D, a "spell" is a unique magical ability a character can use, complete with a name, a description of its effects, and rules for how it works. You will...

docs.google.com

PS - If this post goes against any community guidelines, please let me know and I’ll take it down.

 

[aco175]

You will be shown a series of spells. These spells come from three different sources:

A Human Player: An experienced Dungeons & Dragons player.
GPT: A general-purpose large language model from OpenAI.
LLaMA: A large language model from Meta that has been specially fine-tuned to generate D&D spells.

Some of the spells were ok and some felt obvious like AI.

I do not really know what the difference is between GPT and LLaMA and it seems like arguing between 5e and 4e where they are all D&D. I was just guessing on some between the two not really knowing.

 

[Celebrim]

So, interesting experiment.

I have thoughts about it but I don't want to give spoilers.

 

[Mannahnin]

I do not really know what the difference is between GPT and LLaMA and it seems like arguing between 5e and 4e where they are all D&D. I was just guessing on some between the two not really knowing.

I gave LLaMA the benefit of the doubt that it would make fewer or less obvious mistakes than GPT; at least not leave out standard parts of the template.

 

[TigerDude]

you really need an option of "I have no opinion," I am not a fan of answering questions without knowing which to choose, and you're just introducing noise into the results. If you want me to always pick B when I don't know that's what I'll do.

 

[The Firebird]

Cool project. Typical LLM text I feel confident identifying, but that was not the case here. I haven't seen too many LLM spells.

Will you update us with the results? It would be fun to see.