Cergorach
The Laughing One
I've played around with a couple of different LLMs for this, including a specialized service for this (forgot the name). It was interesting, and I can see why people like it. But... I tend to see that people 'try' it and that's generally a short individual session, not a campaign. When we look at the technical side of LLMs we're looking at context windows. Depending on the LLM, they can be small or large, but even those with large context windows have issue the larger the context window gets. Now, you can work with RAG, and/or compressing previous sessions into shorter summaries. But when I look at how LLMs make summaries of D&D sessions of 4+ hours with four different people talking, they aren't all that great. They confuse people and characters, who did what and why, sometimes add hallucinated events or don't weigh events properly. I really wonder how fast a ChatGPT blows a gasket with a 4+ hour D&D session with a party of four players (with voice to text).
I've also noticed that during a 'conversation' with an LLM, the loose 'consistency', either moving to a longer or shorter prose format, going into a different story telling style, or they keep repeating the same stuff. You can make software layers on top of the LLM that could mitigate that behaviour, but that would become more and more costly, both in compute and response time.
While it was interesting to (role)play with the LLMs in that way, I doubt that would ever replace group play or computer game play. i recently tried the introduction to Solasta, which was imho more fun then playing with the LLM, and that is just one of the many, many CRPGs I want to play over playing with the LLM.
I wonder how much of that preference over LLM is due to me recognizing when the LLM messes up drastically and knowing it's limitations... If a child or someone without much technical computer/LLM knowledge tries it, would they be convinced by the illusion?
I've also noticed that during a 'conversation' with an LLM, the loose 'consistency', either moving to a longer or shorter prose format, going into a different story telling style, or they keep repeating the same stuff. You can make software layers on top of the LLM that could mitigate that behaviour, but that would become more and more costly, both in compute and response time.
While it was interesting to (role)play with the LLMs in that way, I doubt that would ever replace group play or computer game play. i recently tried the introduction to Solasta, which was imho more fun then playing with the LLM, and that is just one of the many, many CRPGs I want to play over playing with the LLM.
I wonder how much of that preference over LLM is due to me recognizing when the LLM messes up drastically and knowing it's limitations... If a child or someone without much technical computer/LLM knowledge tries it, would they be convinced by the illusion?
