Reply to thread

Message

<blockquote data-quote="The Firebird" data-source="post: 9768575" data-attributes="member: 7015803">Likewise, I want to respond to this specifically. I agree with your entire description of the limitations based on mechanism, but I don't agree that this causes the technology to lack value. It just means it should be used properly. If you interface with a search function and ask it for references, then matching &quot;what my question looks like&quot; to &quot;what the text of the sources the search function returned&quot; are is actually incredibly useful. A post later, you critique me for providing an anecdote. It's a fair critique, but, please.&nbsp;I'm familiar with the coding study. I remember it being criticized because it was focused on users who were experts at the code bases they were working on, while the ideal LLM use case is someone who is generally skilled in a language working with a new codebase. That said, I'm not going to rule out the thesis that all perceived benefits of LLMs are just due to people having favorable, subjective experiences which don't match reality. But I think that is far from proven.</blockquote>

[QUOTE="The Firebird, post: 9768575, member: 7015803"] Likewise, I want to respond to this specifically. I agree with your entire description of the limitations based on mechanism, but I don't agree that this causes the technology to lack value. It just means it should be used properly. If you interface with a search function and ask it for references, then matching "what my question looks like" to "what the text of the sources the search function returned" are is actually incredibly useful. A post later, you critique me for providing an anecdote. It's a fair critique, but, please. I'm familiar with the coding study. I remember it being criticized because it was focused on users who were experts at the code bases they were working on, while the ideal LLM use case is someone who is generally skilled in a language working with a new codebase. That said, I'm not going to rule out the thesis that all perceived benefits of LLMs are just due to people having favorable, subjective experiences which don't match reality. But I think that is far from proven. [/QUOTE]

Verification