Testing Nvidia DLSS 3.5 Ray Reconstruction Using Cyberpunk 2.0

The following iteration of Nvidia’s DLSS expertise has landed and at present we’re testing what DLSS 3.5 is and extra particularly, take a better take a look at its new ray reconstruction function.

The brand new tech has been built-in into Cyberpunk 2077 2.0 which launched this week forward of the Phantom Liberty enlargement, and we have been spending a while with it during the last week or so to see how properly DLSS 3.5 works.

TL;DR: What’s ray reconstruction and why is it an vital improve?

Ray tracing results in at present’s video games are noisy, as a result of working these results at a better high quality degree would cripple present graphics playing cards. To struggle and take away this picture noise, builders implement denoising filters, which do assist this noise however include a bunch of different points, like ghosting, decrease ranges of element, and varied inaccuracies.

Ray reconstruction replaces the sport’s denoiser with a DLSS AI-enhanced denoiser that guarantees higher high quality and fewer artifacts than customary denoisers. It achieves this by combining the upscaling and denoising passes into the one algorithm, successfully changing DLSS Tremendous Decision with a mixed DLSS ray reconstruction and Tremendous Decision algorithm. Like present DLSS strategies, it requires sport engine inputs as seen on this diagram.

DLSS 3.5 ray reconstruction is educated to not solely present upscaling reconstruction from a decrease pixel depend picture, however ray tracing impact reconstruction from a low ray depend picture, too.

As ray reconstruction replaces the usual Tremendous Decision algorithm with a mixed model, it should be used with Tremendous Decision enabled, however Nvidia believes it will ship an general superior picture at little or no value to efficiency relative to enjoying with conventional denoisers and solely Tremendous Decision.

DLSS 3.5 might have been named higher

In our opinion, DLSS 3.5 is confusingly named. When DLSS was first launched, it referred solely to Nvidia’s upscaling expertise, “Deep Studying Tremendous Sampling.” Nvidia has since modified this to check with their assortment of AI rendering applied sciences, so what was once DLSS and DLSS 2.0 is now DLSS Tremendous Decision.

Then, with the launch of GeForce RTX 40 collection GPUs, they’ve added in Body Era to the DLSS household, and now we’re getting ray reconstruction as properly.

Every of those additions has led to a brand new DLSS model quantity: 3.0 for Body Gen, 3.5 for ray reconstruction. Staying with us to date? Good…

On prime of this, every DLSS expertise has its personal model quantity. So with DLSS 3.5, Nvidia has added ray reconstruction, and up to date each Tremendous Decision and Body Era to model 3.5. Recreation builders are free to decide on no matter applied sciences they like.

Cyberpunk 2077, for instance, has been up to date to make use of DLSS 3.5 however just for the ray reconstruction half; Tremendous Decision remains to be on model 3.1.1, and Body Era is on 3.1.13. Equally, there can be video games that use DLSS 3.5 Tremendous Decision, however do not combine ray reconstruction. Nonetheless with us?

To make it possible for avid gamers positively cannot observe all of this, DLSS 3.5 ray reconstruction works on all RTX GPUs. However not all of DLSS 3.5 works on all RTX GPUs: Body Era remains to be unique to RTX 40 collection merchandise.

Contemplating that Nvidia spent a variety of time advertising DLSS 3 as an unique to RTX 40 playing cards, it is a bit bizarre to have DLSS 3.5’s important new function engaged on older RTX playing cards.

However do not get us mistaken, it is nice that ray reconstruction is on the market to the overwhelming majority of present GeForce homeowners, however absolutely there was a greater technique to identify all of this.

Can DLSS Render “Higher Than Native” Graphics?

We’re assured that sooner or later RTX 30 collection homeowners, for instance, will not perceive that their card does not assist DLSS 3 Body Era however does assist DLSS 3.5 ray reconstruction.

Early limitations of ray reconstruction in Cyberpunk 2077

Transferring on, having examined ray reconstruction in Cyberpunk, it is clear that that is an early stage expertise that is successfully a preview of what’s (hopefully) to come back. It is arduous to attract too many overarching conclusions from seeing it in only one sport, however ray reconstruction does have some instantly apparent limitations.

Ray reconstruction is barely educated for use with DLSS upscaling enabled, not DLAA (Deep Studying Anti-Aliasing), so you possibly can’t use each concurrently, identical to you possibly can’t use ray reconstruction with none type of DLSS Tremendous Decision. Nvidia says they’re engaged on coaching ray reconstruction for use with DLAA and that may finally be supported.

However the greater limitation is that ray reconstruction is barely out there when utilizing Cyberpunk’s path tracing mode, a.ok.a. RT Overdrive mode. It can’t be enabled when utilizing the sport’s common and fewer taxing ray tracing results. Nvidia advised us that is an intentional restriction, at the very least for now. They “centered [their] efforts to make RT Overdrive look nice in Cyberpunk 2077, and [are] working with CD Projekt so as to add assist for ray reconstruction for different RT modes.”

We suspect it’s because the primary model of ray reconstruction has solely been optimized for path traced results and desires optimization work for normal ray tracing. We do not know this for positive, and Nvidia does declare DLSS 3.5 has been educated on 5x extra information than DLSS 3 and acknowledges completely different RT results.

It is a bit disappointing for many GeForce RTX GPU homeowners as a result of the trail traced mode in Cyberpunk is punishing on GPU {hardware}. Until you’ve got a high-end GPU like an RTX 4090 or RTX 4080, it is arduous to attain acceptable efficiency utilizing RT Overdrive even at decrease resolutions like 1080p.

So whereas it is good that DLSS 3.5 does work on decrease tier RTX GPUs, virtually talking, somebody with one thing like an RTX 3060 shouldn’t be going to be utilizing it – at the very least for now. That is why it could have been good to see ray reconstruction out there to be used with the common RT results which are extra playable on mid-tier GPUs.

Ray reconstruction visible evaluation

So how does ray reconstruction impression the visible high quality of Cyberpunk 2077’s path tracing mode? There’s areas of enchancment and there are areas which are the identical. Watch the video under for a full breakdown.

We recorded gameplay utilizing an Asus ROG Strix GeForce RTX 4090 on a Ryzen 7 7800X3D take a look at system, setting the picture high quality to 4K on extremely, path tracing enabled, DLSS High quality mode, and no body technology until in any other case specified.

For a greater illustration of picture high quality comparisons, try the HUB video under:

For ray traced reflections on extremely reflective surfaces, ray reconstruction is ready to denoise these results to provide a better obvious decision. In some scenes it produces a noticeably larger reflection high quality in comparison with the trail traced mode with out ray reconstruction, and the common ray tracing mode.

The ray reconstructed picture is sharper and clearer, each stationary and in movement. It is a disgrace this tech is not out there with the common RT mode as I feel it may gain advantage from it simply as a lot as we’re seeing within the path traced mode. It isn’t refined and makes ray tracing a extra worthwhile impact to allow.

Ray reconstruction additionally improves the temporal accuracy of reflections. The trail tracing mode by default clearly makes use of a temporal denoising filter that works over a protracted time period. If you transfer round and cease whereas viewing a mirrored image, it might probably usually take a number of seconds for the ultimate reflection to “settle” into place, with the reflection showing to maneuver when it should not be. Ray reconstruction considerably shortens that settling interval and nearly removes this temporal artifact.

This brings the ray traced picture a lot nearer to the responsiveness of the sport’s non ray traced display house reflections. Whereas the display house reflections are additionally of a better obvious decision at instances, they’ve some… fairly vital limitations in movement, like disappearing fully.

At instances at night time we see a mix of those enhancements to reflections, although this is not all the time this case. The scene above has a better reflection decision, lowered reflection ghosting and reflections which are extra attentive to movement when ray reconstruction is enabled. Ray reconstruction additionally handles the precise denoising half higher for some extra diffuse reflections.

Not all reflections are enhanced by ray reconstruction although. In some examples we noticed reflections in clear glass. Each with and with out ray reconstruction enabled, the readability of reflections is great both method, so for this kind of impact, enhanced denoising shouldn’t be needed.

It isn’t simply reflections that ray reconstruction improves although. When assessing shadow high quality, ray reconstruction produced much less noisy shadows in movement, it is a refined impact that is not as noticeable because the enhancements to reflections – and usually the responsiveness of shadows in movement is lots higher than reflections – however ray reconstruction did seem a bit sharper.

On prime of improved noise discount, ray reconstruction offered extra correct automotive headlights with lowered smearing, ghosting and blur. With the traditional path traced mode, automotive headlights lack definition in movement and nearly seem like a blob of sunshine on the entrance of the automotive – generally with gentle showing earlier than the precise place of the headlight, an impact of temporal denoising. With ray reconstruction enabled, the sunshine emitted from the headlight is extra outlined and fewer prone to seem earlier than its precise place, bettering the accuracy of this impact.

International illumination and ambient occlusion are additionally improved by ray reconstruction. Ambient occlusion enhancements are refined, although varied scenes do look completely different with ray reconstruction on.

For a greater illustration of picture high quality comparisons, try the HUB video under:

The scene above is among the weirder ones we discovered for picture high quality. Right here we have now a light-weight panel that illuminates concrete above and under. With all three ray traced modes: the traditional RT Psycho mode, RT Overdrive with out ray reconstruction, and RT Overdrive with ray reconstruction; it takes a quick second for the colour change of the sunshine to impression the worldwide illumination seen right here. ray reconstruction does not remedy this delay, there’s nonetheless an unnatural disconnect.

Nevertheless when the colours do change, with out ray reconstruction you get this ugly transition between colours that is particularly noticeable across the transferring pedestrians. It is this bizarre coloration ghosting impact and it occurs between each coloration. With ray reconstruction, some coloration transitions happen immediately with out this ugly ghosting, like purple to yellow, or blue to purple. Different colours see some however lowered ghosting, like yellow to inexperienced. Fairly a weird discovery.

Sadly ray reconstruction does not all the time look higher when it is enabled. The expertise struggles with some particular varieties of reflections, normally when it is a semi-reflective, not as shiny floor with texturing. Take the scene above for example which has this marbled concrete tiling on the bottom. The trail traced mode with out ray reconstruction produces a clearly larger decision and extra outlined reflection. It is a stark distinction, too, to the purpose the place we had been positive we had been getting the settings tousled. However nope, we have tripled checked and that is certainly labelled appropriately.

Once we add movement to the combo, the ray reconstructed picture additionally has worse ghosting and stability. It appears to be the case the place the ray reconstruction algorithm is not fairly positive whether or not what it is seeing is a mirrored image or not, and finally ends up dealing with each the reflection and the feel utilized to this floor reasonably poorly.

And eventually right here is probably the clearest instance of the strengths and weaknesses of a majority of these reflections. Once we begin additional away from this glassy floor, ray reconstruction is ready to produce a greater high quality reflection.

When strolling in the direction of the floor, after a sure level a texture hundreds in throughout the glass, it is smudgy and has a variety of scratches and stuff. After this level, the non ray reconstructed picture higher preserves this texture and produces a better element picture.

Additionally, as anticipated, with a decrease render decision, not solely does basic picture high quality worsen, however so does the sharpness and readability of ray traced results. Nonetheless, even with DLSS Efficiency getting used, we nonetheless get many of the advantages of ray reconstruction, so reflection high quality as one instance does not turn into worse than not utilizing ray reconstruction, it nonetheless finally ends up wanting higher regardless of the decrease render decision.

DLSS 3.5 ray reconstruction efficiency

There’s lot lots to say relating to efficiency. When testing utilizing the GeForce RTX 4090 throughout a number of resolutions and DLSS high quality modes, ray reconstruction has little impression to border price whether or not it is enabled or disabled. On the RTX 4090, having the setting off was barely quicker within the space we examined, however even then we’re speaking about as much as a 4% distinction, with a typical margin round 1% which is successfully margin of error sort stuff. Provided that it typically supplies superior picture high quality, it is good to see this setting has little impression to efficiency.

DLSS 3.5 Efficiency

That is additionally true when wanting on the setting throughout a spread of GPUs, right here we have now 4 fashions examined at 1440p utilizing the DLSS High quality mode. Whereas the RTX 4090 was barely quicker with out ray reconstruction, the opposite fashions had been all barely quicker with ray reconstruction enabled.

Greatest case, we noticed a 7% win for ray reconstruction with the RTX 4070. By the point we received to the RTX 3070, this card is just too sluggish for path tracing at 1440p, so efficiency is basically an identical both method.

At 1080p once more most of those decrease tier playing cards actually aren’t able to path tracing, although typically the ray reconstruction mode is barely quicker. It isn’t an earth shattering margin, we might usually name this a tie which is an effective end result for higher picture high quality on the entire.

What We Realized

Total, we’re fairly impressed with this primary take a look at DLSS 3.5 ray reconstruction in Cyberpunk 2077. With no impression to efficiency, ray reconstruction usually improves picture high quality for ray traced results in numerous methods: larger constancy reflections and shadows, a much less noisy picture in movement, a extra responsive picture in movement with a a lot shorter settling time for results, lowered ghosting, and improved accuracy for lighting leading to higher picture definition.

For probably the most half, this solves a number of points we have had with ray tracing over time. In lots of video games, whenever you allow ray traced results, absolutely we are able to see extra spectacular reflections that look extra correct and work correctly in additional conditions. However this has usually come at a value of a decrease impact decision, a extra grainy picture, extra artifacts and fewer temporal responsiveness.

Generally ray traced results will boil, sizzle and transfer even when there is not any precise movement on display, a byproduct of very low ray counts and weak denoisers. There are occasions we have not wished to play with ray tracing on as a result of these points are so noticeable and annoying and actually do not justify the large efficiency hit.

Ray reconstruction is a step in the direction of fixing this type of issues, making ray tracing way more usable. We’re extra prone to allow ray tracing in a sport when the picture high quality is genuinely spectacular, when there’s not many artifacts or points, and when the efficiency hit is visually justified. This expertise looks like an acceptable technique to cut back artifacts and enhance ray tracing high quality while not having to extend ray counts and make the efficiency hit even bigger.

We’re additionally hopeful that ray reconstruction will encourage builders to make use of extra intensive ray tracing results as a result of the ensuing high quality will truly justify the efficiency value. It is clear that some builders are being conservative with ray tracing to the purpose the place the visible distinction is negligible with it enabled, all as a result of they do not wish to trigger a large hit to efficiency.

Ray reconstruction does not cut back the efficiency hit from enabling top quality RT results, but it surely makes them simpler to justify as a result of the ultimate picture high quality is extra acceptable than it in any other case could be. Nevertheless, ray reconstruction clearly nonetheless has some points and Nvidia has a protracted technique to go earlier than this function is a slam dunk win for bettering ray tracing.

In a number of areas we noticed ray reconstruction cripple picture high quality, because it does appear to battle with some varieties of reflections on textured surfaces. This is not one thing you will see on a regular basis, it is extremely depending on the floor, lighting, location, time of day, and so forth, but it surely was apparent at instances throughout many hours testing Cyberpunk.

If we needed to put some numbers to it, we are saying that ray reconstruction improves picture high quality about 60% of the time, ~20% of the time there isn’t any impression, and ~20% of the time we see a regression. Nevertheless Nvidia does have a confirmed observe document of bettering DLSS high quality over time by updates – we have seen that with Tremendous Decision and Body Era. Nvidia additionally acknowledged that there are specific situations the place ray reconstruction would profit from extra AI coaching, so we’ll be retaining an eye fixed out for enhancements over time.

What additionally leads us to consider that that is an early, maybe even rushed implementation and that is why ray reconstruction shouldn’t be out there for the common ray tracing modes, after they would clearly profit from superior denoising and higher picture high quality.

Having it working with probably the most intensive path traced mode is good, however the majority of RTX homeowners do not have the GPU energy for path tracing. It is barely viable on an RTX 4070 or RTX 3080, the latter of which does not even have the crutch of Body Era. As soon as we get to GeForce fashions priced at $500 or much less (or the complete Turing technology), at greatest you will be utilizing the traditional ray traced modes, which at the moment aren’t suitable with ray reconstruction.

Nvidia and CDPR have to get the function working with common ray tracing, so the vast majority of GeForce homeowners can profit, and in order that DLSS 3.5 can really stay as much as its compatibility claims throughout all RTX GPUs, as a result of proper now that is simply on-paper assist. As well as, supporting DLAA could be good, though DLAA with path tracing is fairly crippling even on an RTX 4090.

As soon as once more, that is an early look of the expertise based mostly on testing with only one sport. DLSS 3.5 ray reconstruction replaces the ray tracing denoiser within the sport, so the profit over customary picture high quality will range relying on how good the sport’s conventional denoiser is. It is doable that video games with wonderful denoisers will profit much less from ray reconstruction, whereas these with rubbish denoisers or poor implementations will profit extra. Over time we’ll get a greater thought of the final impression in video games, though this preliminary look is fairly spectacular and we have but to see many (or any) examples of video games with superior ray tracing impact high quality than what DLSS 3.5 is offering.

At current, ray reconstruction shouldn’t be a promoting level to buy a GeForce GPU. Recreation assist, even in upcoming titles, could be very restricted and Nvidia has a lot to work on to enhance the function. However AMD and Intel must be engaged on a competing expertise immediately, as a result of neither will wish to fall behind in ray tracing picture high quality over time if ray reconstruction takes a maintain throughout numerous video games. AMD specifically should not wish to be the model the place not solely does ray tracing carry out worse on their merchandise, however seems worse as properly.