Reply to thread

Message: <blockquote data-quote="Milieu" data-source="post: 9079851" data-attributes="member: 7041560">As LLMs exist now, no. If you've tried AI Dungeon, that's sort of what you're talking about, and it can get pretty silly, pretty quickly. It will give responses that contradict previous ones, ignore context, or don't follow logically. It's more like playing D&D in a dream world where things happen that are kind of like things that happen in a fantasy game, but don't really fit together in a sensible way.LLMs hallucinate all the time. If you ask ChatGPT about a fake historical event that you make up on the spot, it will probably make up an answer. If you ask it to write code, it will make up non-existent libraries to import, and then someone will upload a library with that name <a href="https://twitter.com/llm_sec/status/1667573374426701824" target="_blank">containing malicious code</a>. If you ask it about legal cases supporting your client's case, it will make up legal citations to non-existent cases, as a couple of lawyers <a href="https://www.reuters.com/legal/new-york-lawyers-sanctioned-using-fake-chatgpt-cases-legal-brief-2023-06-22/" target="_blank">found out the hard way</a>. If you try to play chess with it, it will <a href="https://twitter.com/GothamChess/status/1624755982105513992" target="_blank">break the rules</a> and move its rook on top of its bishop or bring back a piece that was previously captured. This can be mitigated to some extent, but probably never eliminated. So, for example, even though it's trained on the specific module, by prompting it in a certain way, you could probably convince it to give out any magic item you want whether they're in the module or not, including ones that you just made up. Or you could be fighting a dire wolf and it suddenly "forgets" and describes you attacking the wyvern.I am very skeptical that without a major new advancement (not just feeding it more training data), any LLM-based thing will be worthwhile as a semi-autonomous agent in any use case. As a tool used by a person for brainstorming/creating first drafts, sure.</blockquote>

Verification