This is a perfect example of how a multitude of subtle changes can dramatically affect a character's appearance. This is not simple enhancement. This is generative AI using inferencing and algorithms are guessing and making judgments about how a character should be presented based on the given character model. If you put your face through an AI image generator, you start to find subtle changes to your face that completely change your overall look and presentation in such a way that you no longer recognize that generated image as you. This is what DLSS 5 is also doing. These are dramatic reskinnings of character's faces being generated on-the-fly by algorithms via generative geometry and remodeling of displacement maps; the textures seem to be reprocessed too, perhaps to tease out additional detail via sharpening or the generative renderer also touched those pixels in an additive way by trying to remove typical rendering errors. It's not just simply enhancing the character model: it's doing a multitude of subtle changes that inevitably change the character's face, including nose, eyes, mouth, and I also see hair being changed in certain ways too. Female characters seem more drastically affected than male characters, and this is due to inherent training bias in AI algorithms.
DF, you should not be supporting this tech. This is too far a step from simply improving upscaling and improving framerates. This is reimagining art on the fly and inserting it over the original content (and it is inserted, as DLSS 5's generative AI is fully tied to frame generation). I just can't support that.
If this new PSSR 2.0 is competing well with the very latest FP8 and FP4/6 upscalers, that's quite a feat. We should remember that PS5 Pro only supports WMMA INT8 and (maybe) DP4a (unless disabled by shader ISA fallback), so fine details can naturally be lost in an integer-only algorithm. Seeing them maintained here means Sony and AMD have co-developed a very strong alternative to traditional FP-only algorithms and can apply this to future hardware that may not include latest WMMA FP8 (handheld silicon typically forfeits feature sets to save on die-area), while also serving as a baseline for future hardware that does, like PS6.
Looking forward to comparisons between previous awful PSSR implementations and system-wide, front-end switch to PSSR 2.0 in games. Gran Turismo 7 is a 1st party game, so I expect a native patch before this system firmware update launches, but for 3rd party games, it'll be interesting to monitor developer interest - especially as there's a rumored PS Handheld on the horizon.
Comments 2
Re: Nvidia's new DLSS 5 Brings Photo-Realistic Lighting To RTX 50-Series
This is a perfect example of how a multitude of subtle changes can dramatically affect a character's appearance. This is not simple enhancement. This is generative AI using inferencing and algorithms are guessing and making judgments about how a character should be presented based on the given character model. If you put your face through an AI image generator, you start to find subtle changes to your face that completely change your overall look and presentation in such a way that you no longer recognize that generated image as you. This is what DLSS 5 is also doing. These are dramatic reskinnings of character's faces being generated on-the-fly by algorithms via generative geometry and remodeling of displacement maps; the textures seem to be reprocessed too, perhaps to tease out additional detail via sharpening or the generative renderer also touched those pixels in an additive way by trying to remove typical rendering errors. It's not just simply enhancing the character model: it's doing a multitude of subtle changes that inevitably change the character's face, including nose, eyes, mouth, and I also see hair being changed in certain ways too. Female characters seem more drastically affected than male characters, and this is due to inherent training bias in AI algorithms.
DF, you should not be supporting this tech. This is too far a step from simply improving upscaling and improving framerates. This is reimagining art on the fly and inserting it over the original content (and it is inserted, as DLSS 5's generative AI is fully tied to frame generation). I just can't support that.
Re: It's Official: Resident Evil Requiem Uses Sony's Brand-New PSSR Upscaler
If this new PSSR 2.0 is competing well with the very latest FP8 and FP4/6 upscalers, that's quite a feat. We should remember that PS5 Pro only supports WMMA INT8 and (maybe) DP4a (unless disabled by shader ISA fallback), so fine details can naturally be lost in an integer-only algorithm. Seeing them maintained here means Sony and AMD have co-developed a very strong alternative to traditional FP-only algorithms and can apply this to future hardware that may not include latest WMMA FP8 (handheld silicon typically forfeits feature sets to save on die-area), while also serving as a baseline for future hardware that does, like PS6.
Looking forward to comparisons between previous awful PSSR implementations and system-wide, front-end switch to PSSR 2.0 in games. Gran Turismo 7 is a 1st party game, so I expect a native patch before this system firmware update launches, but for 3rd party games, it'll be interesting to monitor developer interest - especially as there's a rumored PS Handheld on the horizon.