Reply to thread

Message: <blockquote data-quote="Gradine" data-source="post: 9855684" data-attributes="member: 57112"><p>The carbon footprint for these models is largely down to the way they are trained and maintained, so while an individual front-end query may require a miniscule amount of energy, to even exist in the first place, let alone have the ability to effectively answer that query, is what requires the burning of multitudes of rivers. The direct, immediate impact of your single query might be miniscule, but adding in the average back-end energy usage of the LLM to all front-end query users drastically ramps up the actual environmental impact of your single query substantially. Using the LLM justifies its continued existence which allows any given LLM owner to justify the massive impact of their models on the world, so they are heavily invested in decoupling any back-end energy usage from front-end queries, covertly obfuscating the individual user's culpability and thus their own.</p></blockquote><p></p>