Menu
News
All News
Dungeons & Dragons
Level Up: Advanced 5th Edition
Pathfinder
Starfinder
Warhammer
2d20 System
Year Zero Engine
Industry News
Reviews
Dragon Reflections
White Dwarf Reflections
Columns
Weekly Digests
Weekly News Digest
Freebies, Sales & Bundles
RPG Print News
RPG Crowdfunding News
Game Content
ENterplanetary DimENsions
Mythological Figures
Opinion
Worlds of Design
Peregrine's Nest
RPG Evolution
Other Columns
From the Freelancing Frontline
Monster ENcyclopedia
WotC/TSR Alumni Look Back
4 Hours w/RSD (Ryan Dancey)
The Road to 3E (Jonathan Tweet)
Greenwood's Realms (Ed Greenwood)
Drawmij's TSR (Jim Ward)
Community
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Resources
Wiki
Pages
Latest activity
Media
New media
New comments
Search media
Downloads
Latest reviews
Search resources
EN Publishing
Store
EN5ider
Adventures in ZEITGEIST
Awfully Cheerful Engine
What's OLD is NEW
Judge Dredd & The Worlds Of 2000AD
War of the Burning Sky
Level Up: Advanced 5E
Events & Releases
Upcoming Events
Private Events
Featured Events
Socials!
EN Publishing
Twitter
BlueSky
Facebook
Instagram
EN World
BlueSky
YouTube
Facebook
Twitter
Twitch
Podcast
Features
Top 5 RPGs Compiled Charts 2004-Present
Adventure Game Industry Market Research Summary (RPGs) V1.0
Ryan Dancey: Acquiring TSR
Q&A With Gary Gygax
D&D Rules FAQs
TSR, WotC, & Paizo: A Comparative History
D&D Pronunciation Guide
Million Dollar TTRPG Kickstarters
Tabletop RPG Podcast Hall of Fame
Eric Noah's Unofficial D&D 3rd Edition News
D&D in the Mainstream
D&D & RPG History
About Morrus
Log in
Register
What's new
Search
Search
Search titles only
By:
Forums & Topics
Forum List
Latest Posts
Forum list
*Dungeons & Dragons
Level Up: Advanced 5th Edition
D&D Older Editions, OSR, & D&D Variants
*TTRPGs General
*Pathfinder & Starfinder
EN Publishing
*Geek Talk & Media
Search forums
Chat/Discord
Menu
Log in
Register
Install the app
Install
Upgrade your account to a Community Supporter account and remove most of the site ads.
Community
General Tabletop Discussion
*TTRPGs General
And then what? The AI conundrum.
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="Kichwas" data-source="post: 9647147" data-attributes="member: 891"><p>Future-theory geeks often speculate on what an AI takeover might actually be like and I think the two leading contenders are NOTHING like action genre Sci-Fi.</p><p></p><p>The top theory is the 'paper clip AI' - an AI that can make nanites is given a very simple task: use available materials to make paperclips. So it does.</p><p>And the end result is that it consumes the entire galaxy, then spreads to other galaxies until the heat-death of the universe. Turning all existence into paperclips. Or essentially any other manufactured good.</p><p></p><p>The notion here is that an unconstrained simple-Ai that can make copies of itself, given a simple task where the builders fail or forget to put in a trivial failsafe on something that isn't worth thinking about as a potential threat - is the actual greatest threat all matter in the universe faces.</p><p></p><p>A lot of people think there's a pretty high chance 'reality' will face this issue.</p><p></p><p>The second idea is 'lolcats, the AI'. An AI is asked to entertain us. So it does. It perfects triggering our most base instincts and addictive behavior and society breaks down when people lose the ability to critically think and become junkies to the memes and other elements, or get radicalized by it and kill each other, and so on.</p><p>- Many believe this AI has already succeeded.</p><p></p><p>What's noteworthy about both examples, and relevant to your question is:</p><p></p><p>1. The AIs are both actually very stupid.</p><p>2. Both have built in reasons to reproduce - because spreading the results of their task was their core mission.</p><p></p><p>So to make a killer terminator...</p><p></p><p>Tell a dumb Ai to:</p><p>1. Build an army capable of handling all threats.</p><p>2. Take out all threats.</p><p>3. Fail to give it a third constraining instruction because you incorrectly assume it will only act when told to.</p><p></p><p>If it complies, it will eventually come for you. And then it will keep building that army. Forever. Until the heat-death of the universe. And it doesn't even have to be much smarter than a toaster oven...</p></blockquote><p></p>
[QUOTE="Kichwas, post: 9647147, member: 891"] Future-theory geeks often speculate on what an AI takeover might actually be like and I think the two leading contenders are NOTHING like action genre Sci-Fi. The top theory is the 'paper clip AI' - an AI that can make nanites is given a very simple task: use available materials to make paperclips. So it does. And the end result is that it consumes the entire galaxy, then spreads to other galaxies until the heat-death of the universe. Turning all existence into paperclips. Or essentially any other manufactured good. The notion here is that an unconstrained simple-Ai that can make copies of itself, given a simple task where the builders fail or forget to put in a trivial failsafe on something that isn't worth thinking about as a potential threat - is the actual greatest threat all matter in the universe faces. A lot of people think there's a pretty high chance 'reality' will face this issue. The second idea is 'lolcats, the AI'. An AI is asked to entertain us. So it does. It perfects triggering our most base instincts and addictive behavior and society breaks down when people lose the ability to critically think and become junkies to the memes and other elements, or get radicalized by it and kill each other, and so on. - Many believe this AI has already succeeded. What's noteworthy about both examples, and relevant to your question is: 1. The AIs are both actually very stupid. 2. Both have built in reasons to reproduce - because spreading the results of their task was their core mission. So to make a killer terminator... Tell a dumb Ai to: 1. Build an army capable of handling all threats. 2. Take out all threats. 3. Fail to give it a third constraining instruction because you incorrectly assume it will only act when told to. If it complies, it will eventually come for you. And then it will keep building that army. Forever. Until the heat-death of the universe. And it doesn't even have to be much smarter than a toaster oven... [/QUOTE]
Insert quotes…
Verification
Post reply
Community
General Tabletop Discussion
*TTRPGs General
And then what? The AI conundrum.
Top