SORA AI Technology Preview: We are Entering a Golden Age of Chaos


log in or register to remove this ad




Morrus

Well, that was fun
Staff member
Remember when blogs became a thing and everyone was convinced they would be the downfall of orderly society because they undermined real writing and journalism? I do. They weren't.
The difference is the ability to convincingly impersonate. That's what the fear is.

Creating a Tumblr called 'Tom Cruise' and putting a picture of Tom Cruise on it, and then writing posts from 'Tom Cruise' about how he hates Australians is fundamentally unbelievable. A video of Tom Cruise saying that? That's different. That's viral believable stuff.

Until it's happening to everybody. Every politician, every actor, even you because of that waiter you pissed off. Then, sure, none of it is believable--but at that point nothing is believable. We've reached an information crunch point where fact no longer exists, because you can't believe anything you see or hear.

So, no, it's not a trivial non-issue. Wait until your wife is filing for a divorce because that waiter didn't like your tip and made a 'video' between courses. Or every criminal case is overturned because the video evidence isn't credible, and there's videos of the bank robber partying in the Caribbean at the time. Or nobody believes any of that stuff because it's so prevalent, that the very concept of 'news' ceases to exist. How do you decide who to vote for? The guy with 1000 videos talking about how he loves kicking puppies, or the woman with 1000 videos talking about how she prefers drowning them?

It’s not like blogs becoming a thing.
 

FitzTheRuke

Legend
It's a big extreme leap to make it a yes or no question when there may be infinite potential ways to make rules for and regulate AI through carefully considered laws.
Did I say your answer was limited to yes or no? My own answer to the same question wouldn't be either yes or no.
Not every tech should be pursued and implemented.
I'm pretty sure I didn't imply that it should.
 

Stalker0

Legend
Not every tech should be pursued and implemented.
This is unfortunately the ultimate pitfall.

While we can argue that technological progress has overall been good (and some would counter thst even now), we cannot argue that it will continue to be good indefinitely. In fact, history has shown the opposite, the “too much of a good thing” tends to tear it’s ugly head eventually.

But human nature is drawn to power, and as long as technology increases the power of some element of humanity…it will continue to be pursued.

We don’t really have the toolset to stop technological progress even if we wanted to. We can slow it a few decades in some cases but we don’t really know how to put the genie back in the bottle
 

Stalker0

Legend
The difference is the ability to convincingly impersonate. That's what the fear is.

Creating a Tumblr called 'Tom Cruise' and putting a picture of Tom Cruise on it, and then writing posts from 'Tom Cruise' about how he hates Australians is fundamentally unbelievable. A video of Tom Cruise saying that? That's different. That's viral believable stuff.

Until it's happening to everybody. Every politician, every actor, even you because of that waiter you pissed off. Then, sure, none of it is believable--but at that point nothing is believable. We've reached an information crunch point where fact no longer exists, because you can't believe anything you see or hear.

So, no, it's not a trivial non-issue. Wait until your wife is filing for a divorce because that waiter didn't like your tip and made a 'video' between courses. Or every criminal case is overturned because the video evidence isn't credible, and there's videos of the bank robber partying in the Caribbean at the time. Or nobody believes any of that stuff because it's so prevalent, that the very concept of 'news' ceases to exist. How do you decide who to vote for? The guy with 1000 videos talking about how he loves kicking puppies, or the woman with 1000 videos talking about how she prefers drowning them?

No, it's not like blogs becoming a thing. And no, everybody wasn't convinced blogs would be the downfall of orderly society.
Hell the concern about the erosion of truth has been accelerating for decades. The modern internet and social media has already created entire camps of people that genuinely believe utter and outright scientifically provable lies.

AI will be the next tier of this movement, and I do agree that potentially the biggest threat to humanity is the utter removal of trust in communication. Because if we cannot trust communication it’s the Tower of Babel all over again. We cannot share knowledge or coordinate to solve problems. We revert right back to small tribes..and everything else crumbles.

And likely the only solution…is AI. We will need AI to able to filter through the BS, it’s the only thing that will be able to sniff out lies fast enough to combat the misinformation of people and other AIs.

And so you get the AI arms race, people will have to rely on AIs to beat AIs, and therefore more and more decisions will be handled by AI…and possible at some point…all of them
 

Reynard

Legend
The difference is the ability to convincingly impersonate. That's what the fear is.

Creating a Tumblr called 'Tom Cruise' and putting a picture of Tom Cruise on it, and then writing posts from 'Tom Cruise' about how he hates Australians is fundamentally unbelievable. A video of Tom Cruise saying that? That's different. That's viral believable stuff.

Until it's happening to everybody. Every politician, every actor, even you because of that waiter you pissed off. Then, sure, none of it is believable--but at that point nothing is believable. We've reached an information crunch point where fact no longer exists, because you can't believe anything you see or hear.

So, no, it's not a trivial non-issue. Wait until your wife is filing for a divorce because that waiter didn't like your tip and made a 'video' between courses. Or every criminal case is overturned because the video evidence isn't credible, and there's videos of the bank robber partying in the Caribbean at the time. Or nobody believes any of that stuff because it's so prevalent, that the very concept of 'news' ceases to exist. How do you decide who to vote for? The guy with 1000 videos talking about how he loves kicking puppies, or the woman with 1000 videos talking about how she prefers drowning them?

No, it's not like blogs becoming a thing. And no, everybody wasn't convinced blogs would be the downfall of orderly society.
We already live in a world in which lies outnumber and out perform truths ever second of every day. It is a shift in scale, but not kind.

Do you know what is a change in kind? The speed and efficiency that LLMs and other models can bring to science, medicine and engineering. These things are prediction machines, extremely efficient at finding patterns and filtering them for the best options.

This fear that there will be no truth has already been realized. We already live in a post truth society. We can't undo that by throwing the AI baby out with the AI bathwater.

And finally: if things turn out that the Pornomatic3000 app is so ubiquitous that your waiter can whip up a hoax video that quickly, no one will care because everyone will have access to the same tools.
 

UngainlyTitan

Legend
Supporter
This is unfortunately the ultimate pitfall.

While we can argue that technological progress has overall been good (and some would counter thst even now), we cannot argue that it will continue to be good indefinitely. In fact, history has shown the opposite, the “too much of a good thing” tends to tear it’s ugly head eventually.

But human nature is drawn to power, and as long as technology increases the power of some element of humanity…it will continue to be pursued.

We don’t really have the toolset to stop technological progress even if we wanted to. We can slow it a few decades in some cases but we don’t really know how to put the genie back in the bottle
I agree, AI is potentially a massively disruptive technology. There are those that stand to gain from its success and those within the current elite with reason to fear it.
It is not obvious what the long term social and economic outlook will be like in the post AI age. Riding that tiger will be interesting in the Chinese curse sort of way.
Not in a world where private actors have the resources once reserved for state actors.
 

Remove ads

Top