AI/LLMs DLSS 5 will be the worst thing to EVER happen to video games

Filters are different than generative AI, which makes up stuff. And DLSS5 is generative AI.
No. DLSS any version is generative AI. It uses artificial intelligence - based on deep learning - to create an image that isn't in the original content made by the artist. The game is rendered in a lower resolution and possibly at a lower frame rate than is later put out on screen, DLLS upscales the resolution and number of frames, basically "thinking" up the missing pixels and frames based.
But in the end, DLLS is also still just an algorithm, like the algorithm to do ray-tracing or repeating a 512x512 Pixel texture on a surface to generate the apperance of a 1000x5433 Pixel wall or grass.

Also, the legal definition of what can be copyrighted or trademarked and what has "artistic intent" are not really the same thing. And whether "artistic intent" is even relevant for the quality or enjoyability of a computer game is also yet another matter.
 

log in or register to remove this ad

Because then we're talking about the modder's intent. AI has no intent, no vision, thus it strips out intent. I have no idea how to explain this any more simply.
But what does that mean? AI has no intent, no vision. But does it it strip out intent? It's a tool, we don't expect it to add intent.

The reason it might not be copy-rightable might be because the AI itself would alwasy be creating derivative work, because it is fed with millions of pieces of art or photography to create (and the source and usage of this art and photography for this purpose is dubious, too).

But that doesn't mean that there is no artistic intent if you use AI to create an image. It just means you're basing your work too hard on pre-existing work so that it legally you cannot claim copyright on an original work, and it could be claimed that you are violating someone else's copyright - like if you were painting Donald Duck or Robert Downey Jr. in an Iron Man costume.
But that doesn't mean you had no artistic intent! Your brush didn't, your water colors didn't, your palette didn't, the AI that you used to upscale the image after you scanned it with your scanner didn't, but you did.
 

No idea how that first image was found or created but if you watch the actual video referenced above in real time that’s not at all what the character looked like with DLSS5 on.
Whats worse, nothing that looks like that actual image can be found in the actual video.
It's a screenshot of the video. It is, in fact, what that character looks like in real time because it's from a video demonstrating what they look like in real time. I didn't photoshop that. I watched the video, in real time, saw the problem and then took a screenshot to demonstrate it. Your denial of its existence doesn't actually make it vanish. It's a screenshot from the video. It's not even the most egregious problem with the motion in that video it's just one that screenshots can demonstrate. The much larger issue is DLSS5's inability to smoothly track a face so the movement in the dialogue's fixed perspective show the characters face wobbling around the model's skull like it's attached with jelly.

I didn’t go frame by frame. My guess is that such a rendering was in the first few frames after it turned on as it was transitioning between off and on. If it does exist at all as a frame it’s also not something visually perceptible in the real time view.
That screenshot was taken from a portion of the video in which DLSS5 was turned on the entire time. It just handles movement poorly. It also was visually perceptible because that's how I knew to take a screenshot of it. DLSS4 has ghosting in it too, to a lesser extent, so I'm not sure why you'd be shocked that DLSS5 has it in a more severe capacity when it's apply visuals on top of a scene rather than just upscaling it.


I will also mention I find this whole conversation about artistic intent genuinely pretty sad when the representative showing it off in the TES video is derisively laughing at the game being "stylised" and that DLSS5 makes it "much more like you'd expect".
 
Last edited:

And whether "artistic intent" is even relevant for the quality or enjoyability of a computer game is also yet another matter.

From EGA to VGA, from SVGA to DirectX, from OpenGL to ray tracing. There has never, in the history of digital media, been the expectation that graphics designed on an old standard will render exactly the same way on newer hardware. It's has never, ever, been an issue about "artistic intent", it's just the reality of the medium that the art is rendered in.

In the context I'd DPSS 5, it's just an attempt to pull people on the bandwagon. Pull the most rage possible. Make the biggest boogeyman.

If anyone actually cares about artistic intent, there's a legitimate community based on preservation of old games. People who try and find lost software, manufacture retro consoles that are compatible with modern tech (i.e. HDMI connectors, etc.), and make software bridges and emulators so that people can still play old games. But no one preserves old games by telling new gamers they're not allowed to use next gen video cards. Art and its intent are never saved by lecturing someone about what they're not allowed to make in the future.
 

It just handles movement poorly. It also was visually perceptible because that's how I knew to take a screenshot of it.

It’s not perceptible to me, but we’ve said multiple times here that it’s not great at motion yet. It’s an early demo, remember?

I will also mention I find this whole conversation about artistic intent genuinely pretty sad when the representative showing it off in the TES video is derisively laughing at the game being "stylised" and that DLSS5 makes it "much more like you'd expect".

No need to feel sad over Oblivion Remastered NPCs, which are too often worse than their potato-headed originals.


IMG_1575.jpeg



IMG_1574.jpeg
 
Last edited:

No. DLSS any version is generative AI. It uses artificial intelligence - based on deep learning - to create an image that isn't in the original content made by the artist. The game is rendered in a lower resolution and possibly at a lower frame rate than is later put out on screen, DLLS upscales the resolution and number of frames, basically "thinking" up the missing pixels and frames based.
But in the end, DLLS is also still just an algorithm, like the algorithm to do ray-tracing or repeating a 512x512 Pixel texture on a surface to generate the apperance of a 1000x5433 Pixel wall or grass.

Also, the legal definition of what can be copyrighted or trademarked and what has "artistic intent" are not really the same thing. And whether "artistic intent" is even relevant for the quality or enjoyability of a computer game is also yet another matter.

Not in the same way, which is why this is so different. This is well-beyond just upscaling things, and just looking at the pictures makes it rather clear. Previous versions of DLSS weren't adding makeup to characters and such. That's more than just an upscale, which is why the outrage is rightly much deeper.

But what does that mean? AI has no intent, no vision. But does it it strip out intent? It's a tool, we don't expect it to add intent.

The reason it might not be copy-rightable might be because the AI itself would alwasy be creating derivative work, because it is fed with millions of pieces of art or photography to create (and the source and usage of this art and photography for this purpose is dubious, too).

If something else is doing all the work of it, your intent gets lost. You can try and steer AI in certain ways, but ultimately it can't make conscious decisions, which is why DLSS5's visuals have come out incredibly wonky with the blast lighting. It's taking away conscious decisions for what finds in its scrapped database. Hence "stripping intent": it is taking away aspects of the piece and replacing it with stuff that it finds. We've taken away a choice made by a dev and substituted whatever the AI put there. By nature, I would say that is absolutely stripping something out.

But that doesn't mean that there is no artistic intent if you use AI to create an image. It just means you're basing your work too hard on pre-existing work so that it legally you cannot claim copyright on an original work, and it could be claimed that you are violating someone else's copyright - like if you were painting Donald Duck or Robert Downey Jr. in an Iron Man costume.
But that doesn't mean you had no artistic intent! Your brush didn't, your water colors didn't, your palette didn't, the AI that you used to upscale the image after you scanned it with your scanner didn't, but you did.

No, I would say that makes you not the artist anymore. I keep saying that, instead, you are the commissioner: you are giving what you want, but someone or something else is doing the actual work of it. A commissioner can tell an artist what they want, but the artist is there to realize it, to make decisions about how its realized. AI... well, it can't make decisions as much as it just tries to copy what it can based on the data it has and associations its made. It can't intend to do something because it lacks thought.

AI upscaling is a much lesser version I would say compared to what we are talking about. We can talk about degrees and how upscaling can be terrible (look at the 4K version of True Lies, for example), but it certainly can take away from certain choices. It just does so to a much lesser degree. DLSS5 is so extreme that it is basically creating a new image with new lighting, new visuals, even doing visual touchups and makeup and such. That's more than just upscaling something.
 

Not in the same way, which is why this is so different. This is well-beyond just upscaling things, and just looking at the pictures makes it rather clear. Previous versions of DLSS weren't adding makeup to characters and such. That's more than just an upscale, which is why the outrage is rightly much deeper.
I am not debating that it's more than just upscaling the picture, but it is still inferring graphical details that do not exist in the original picture based on machine learning. It's still not fundamentally different. The upscaling cannot guarantee that all the pixels look how the original artist would have done it if he could have done it at that resolution and frame rate.

And mind you even there, we already have to realize that the artist doesn't actually have a specific intent for every single frame and camera angle that might be possible, unless perhaps there is a specific cut scene with a fixed camera.
In the picture of Grace, DLSS5 isn't adding some random make-up out of nowhere, it's taking the make-up that is there and infers a more realistic-looking face with that make-up. The kind of face that the artist could only get with a tool like this - or by making the scene render unacceptably slow, which also wouldn't be their intent.

If something else is doing all the work of it, your intent gets lost. You can try and steer AI in certain ways, but ultimately it can't make conscious decisions, which is why DLSS5's visuals have come out incredibly wonky with the blast lighting. It's taking away conscious decisions for what finds in its scrapped database. Hence "stripping intent": it is taking away aspects of the piece and replacing it with stuff that it finds. We've taken away a choice made by a dev and substituted whatever the AI put there. By nature, I would say that is absolutely stripping something out.
It cannot strip intent just as a loose hair in a painter's brush isn't stripping their intent - even if it leads to an extra line or a gap. If the painter is still happy with the result, the intent is achieved.

No, I would say that makes you not the artist anymore. I keep saying that, instead, you are the commissioner: you are giving what you want, but someone or something else is doing the actual work of it. A commissioner can tell an artist what they want, but the artist is there to realize it, to make decisions about how its realized. AI... well, it can't make decisions as much as it just tries to copy what it can based on the data it has and associations its made. It can't intend to do something because it lacks thought.
But there is no one else doing the actual work. It's just me, using a tool. In the relationship between a commissioner and artist, there are two seperate humans at work. That isn't true when I use AI, there isn't another person. There is just an AI tool. The AI tool has, as you say yourself, no intent. How could that strip away my intent? When I draw with my pencil, I don't really intent to spread graphite on a paper, but that's what is happening (I think, roughly, not really an expert on this matter.) But what I want is to create a particular imagine I have in my mind. But the tool is spreading graphite on paper, without any intent on its own, just as the physics happen to work out, and I use it until I am satisfied (or give up, to be honest, I am not an artist of any quality or skill.) Still somehow, art can be made with pencils. But AI is a special type of tool where this stops being possible to some metaphysical quality? I don't believe so.

Also, the "artist intent" is kinda overrated or misplaced in games sometimes. Sure, games are also art. But it might not really matter to the "artistic intent" behind if if the characters were generated by AI - instead, the real focus was on telling the story they wanted to tell, and the exact looks of the characters and sets might never have been as important as the characterization. Or maybe it wasn't even that, maybe it where the specific mechanics and type of gameplay the game achieved, and in theory, it didn't matter if the game had a comic look or photo-realistic graphic or not, but they went with the eye-candy variant in hopes of getting more people excited for the game, and if DLSS 5 gets you there, it's the tool of choice. The "artistic intent" for a game might actually not be impacted at all by whether a character is wearing more or less make-up than the original model that it was based on.

I would cut out these metaphysics of "artistic intent" and the line where some tool can strip it out or not.

The problem with AI here isn't that you can't create art with it. It's that you might be creating it unethically, because for training its model, intellectual property was stolen by big corporation from original artists. In using it, you might also risk the livelihoods of people that used to create art (quite possibly the ones that was stolen from in the first place). That I can all understand.
It's kinda as if you were painting with blood. Sure you can create art with that. But if you steal the blood from blood banks (or even more nefarious means), less blood is available for patients and you violated people's constent, you're still doing something that is bad for socienty and we probably should not support your blood paintings, even if they look gorgeous and evoke strong emotions. I can get that.
 

I am not debating that it's more than just upscaling the picture, but it is still inferring graphical details that do not exist in the original picture based on machine learning. It's still not fundamentally different. The upscaling cannot guarantee that all the pixels look how the original artist would have done it if he could have done it at that resolution and frame rate.

And mind you even there, we already have to realize that the artist doesn't actually have a specific intent for every single frame and camera angle that might be possible, unless perhaps there is a specific cut scene with a fixed camera.
In the picture of Grace, DLSS5 isn't adding some random make-up out of nowhere, it's taking the make-up that is there and infers a more realistic-looking face with that make-up. The kind of face that the artist could only get with a tool like this - or by making the scene render unacceptably slow, which also wouldn't be their intent.

It's adding makeup because its database has people who would have makeup in this way and have a nose job in this way. It's taking what it can glean from places like Instagram and others and putting that effect on there. But that doesn't necessarily jive with the character of Grace, nor any of the characters it makes look like photo influencers. It changes the situation and the image just like interpreting all lighting as being blasted out. It's a face an artist could only get with a tool... but the artist would also have to want that face, and we've seen a lot of devs bash at it using this sort of homologized ideas of what scenes and people look like to ruin them.

It cannot strip intent just as a loose hair in a painter's brush isn't stripping their intent - even if it leads to an extra line or a gap. If the painter is still happy with the result, the intent is achieved.

It can absolutely strip intent and plenty of the devs have outright complained as such. It modifies faces, models, lighting, all sorts of things. It's not a limitation of the artist, but something active that they have no control over once its on. To remove such things is to strip away the presentation, the intended idea or effect. You can try and dance all you want around it, but such massive changes it makes absolutely dilute what the artist intended, especially given what we've seen so far.

But there is no one else doing the actual work. It's just me, using a tool. In the relationship between a commissioner and artist, there are two seperate humans at work. That isn't true when I use AI, there isn't another person. There is just an AI tool. The AI tool has, as you say yourself, no intent. How could that strip away my intent? When I draw with my pencil, I don't really intent to spread graphite on a paper, but that's what is happening (I think, roughly, not really an expert on this matter.) But what I want is to create a particular imagine I have in my mind. But the tool is spreading graphite on paper, without any intent on its own, just as the physics happen to work out, and I use it until I am satisfied (or give up, to be honest, I am not an artist of any quality or skill.) Still somehow, art can be made with pencils. But AI is a special type of tool where this stops being possible to some metaphysical quality? I don't believe so.

There's not a person doing the work, but a machine attempting a facsimile of it. Like, I don't see how this is exactly hard to get: it's the same relationship between a commissioner and an artist, except that it lacks the thought of an artist and instead tries to recreate it through algorithmic data sets. You only have limited control of what this level of generative AI can do, and given that their idea of how to control it is largely by setting how transparent it is really keys in on how little control there is over the tool itself. It's turn on, turn off, and either make it more or less difficult to see. There's no control over the actual result, no thought to direct it.

Also, the "artist intent" is kinda overrated or misplaced in games sometimes. Sure, games are also art. But it might not really matter to the "artistic intent" behind if if the characters were generated by AI - instead, the real focus was on telling the story they wanted to tell, and the exact looks of the characters and sets might never have been as important as the characterization. Or maybe it wasn't even that, maybe it where the specific mechanics and type of gameplay the game achieved, and in theory, it didn't matter if the game had a comic look or photo-realistic graphic or not, but they went with the eye-candy variant in hopes of getting more people excited for the game, and if DLSS 5 gets you there, it's the tool of choice. The "artistic intent" for a game might actually not be impacted at all by whether a character is wearing more or less make-up than the original model that it was based on.

I feel like the saying "maybe the looks weren't important" kind of proves my point: it lacks intent. Artists will create things all the time and while they won't have the most compelling reason for certain choices, they do make them, even unconsciously. Just leaving such things up to AI because you don't care kind of strips that whole aspect away from the characters, doesn't it? It removes a whole idea and aspect that could have mattered, but now lacks something because we let something generate a random character and we wrote stuff for whatever it outputted. Now whatever is written will have intent, but not the design of t he characters themselves, and I think you'd basically have to concede that with this sort of argument.

Like, you're basically say "Yeah, it strips away some of the artist's intent, but what if they didn't want that part?" and that's conceding my idea. And that's fine, but the second half of the argument I would say is that it seems like a whole lot of people in videogame land care about that and we shouldn't suddenly act like it doesn't matter.

I would cut out these metaphysics of "artistic intent" and the line where some tool can strip it out or not.

That's cool for you, but it seems like the people who actually make the games care about this sort of thing.

The problem with AI here isn't that you can't create art with it. It's that you might be creating it unethically, because for training its model, intellectual property was stolen by big corporation from original artists. In using it, you might also risk the livelihoods of people that used to create art (quite possibly the ones that was stolen from in the first place). That I can all understand.
It's kinda as if you were painting with blood. Sure you can create art with that. But if you steal the blood from blood banks (or even more nefarious means), less blood is available for patients and you violated people's constent, you're still doing something that is bad for socienty and we probably should not support your blood paintings, even if they look gorgeous and evoke strong emotions. I can get that.

I would say that you can't create art with it and it's incredibly unethical. You are removing yourself from the actual creation of things, and instead just using a plagiarism machine that attempts to recreate art without really knowing what art is. Creating art with blood has meaning, intent, thought behind it; AI doesn't. It's imitation, mimicry, the styling of something without the thought of it. It puts things in because it is weighing how often it sees something. That can be passable sometimes, but it's not really art and I don't think we should even humor the people who want it to be art with such a concession.
 

DLSS weren't adding makeup to characters and such.

In these images, DLSS 5 doesn’t add any cosmetic product that didn’t previously exist. Grace is wearing the half-face of makeup she wore in the first image.

The guy on YouTube was wrong. He conjectured that DLSS added lipstick and blush, new materials, when all he had to to was comment on her rosier, healthier glow, which is just human blood flow.

IMG_1576.jpeg
 
Last edited:


Recent & Upcoming Releases

Remove ads

Top