NVIDIA Predicts DLSS 10 Will Offer Full Neural Rendering Interfaced with Game Engines for Much Better Visuals

Sep 24, 2023 at 02:00pm EDT
Streamline NVIDIA DLSS NVIDIA Invites Developers To Test Experimental DLSS Models Directly From Company's Supercomputer NVIDIA DLSS 2.5

[UPDATE - January 31, 2026] Google's new experimental Project Genie technology now provides a glimpse into NVIDIA's vision for DLSS 10, allowing quick creation of virtual 3D worlds based on a mere prompt.

[ORIGINAL STORY] NVIDIA placed its bets on AI very early and is now reaping the benefits, as evidenced by its incredible growth in the past year. It all began with gaming's Deep Learning Super Sampling, or DLSS, a technique focused on accelerating game performance with the power of AI (specifically, a trained neural network). That's when NVIDIA started putting Tensor Cores in all GeForce graphics cards from the RTX series onward; with the advent of real-time ray tracing, there was a strong need to recoup as much performance as possible.

Related Story Why PC Game System Requirements Are Often Misleading

Over time, NVIDIA evolved DLSS. Version 2.0 delivered much higher quality while maintaining its status of performance accelerator; version 3.0 added Frame Generation, which unlocked new levels of performance, especially in CPU-bound games; and version 3.5 focused on improving the quality of ray tracing under upscaling with the new Ray Reconstruction feature that just debuted in Cyberpunk 2077 to widespread acclaim.

In the final segment of the recent 'AI Visuals' roundtable hosted by Digital Foundry, NVIDIA's VP of Applied Deep Learning Research Bryan Catanzaro said he believes future releases of DLSS, perhaps in version 10, could take care of every aspect of rendering in a neural, AI-based system.

Back in 2018 at the NeurIPS conference, we actually put together a really cool demo of a world that was being rendered by a neural network, like, completely but it was being driven by a game engine. So, basically, what we were doing was using the game engine to generate information about where things are and then using that as an input to a neural network that would do all the rendering, so it was responsible basically for every part of the rendering process. Just getting that thing to run in real time in 2018 was kind of a visionary thing. The image quality that we got from it certainly wasn't anything close to Cyberpunk 2077, but I think long term this is where the graphics industry is going to be headed. We're going to be using generative AI more and more for the graphics process. Again, the reason for that is going to be the same as it is for every other application of AI, we're able to learn much more complicated functions by looking at huge data sets than we can by manually constructing algorithms bottom up.

I think we're going to have increased realism and also hopefully make it cheaper to make awesome AAA environments by moving to much, much more neural rendering. I think that's going to be a gradual process. The thing about the traditional 3D Pipeline and the game engines is that it's controllable: you can have teams of artists build things and they have coherent stories, locations, everything. You can actually build a world with these tools.

We're going to need those tools for sure. I do not believe that AI is gonna build games in a way where you just write a paragraph about making a cyberpunk game and then pop comes out something as good as Cyberpunk 2077. I do think that let's say DLSS 10 in the far future is going to be a completely neural rendering system that interfaces with a game engine in different ways, and because of that, it's going to be more immersive and more beautiful.

Catanzaro refers to this 'driving game' first showcased at December 2018's NeurIPS conference in Montreal, Canada. Needless to say, the quality wasn't great, but AI is capable of major improvements in a relatively brief amount of time.

It's not far-fetched at all to imagine that in around ten years, DLSS could be capable of entirely replacing the traditional rendering methods. NVIDIA is already working on more neural techniques, such as radial caching and texture compression, which could be added to the DLSS suite as it expands to replace additional parts of the rendering process. If that turns out to be the direction, though, NVIDIA might have to greatly increase the amount of Tensor Cores available in its GPUs.

We'll keep a close eye on the new research papers as they are the best indication of what's to come from NVIDIA in the field of neural rendering.

About the author: With over two decades of experience in gaming journalism, Alessio Palumbo has led the gaming vertical at Wccftech since August 2015. He started working at a young age for Italian websites like Everyeye.it, Gamestar.it, Nextgame.it, and Multiplayer.it before kickstarting the indie English-language publication Worlds Factory as its founder and Editor in Chief. In the last decade, he has coordinated the overall output of Wccftech's gaming section, managed PR relations, assigned reviews, produced daily news coverage, edited gaming content as needed, and delivered game reviews. Arguably, his trademark content is the long series of exclusive developer interviews that have been cited by Wikipedia and by the biggest news media and gaming publications. His passion for technology also makes him knowledgeable when it comes to gaming hardware and tech. His favorite genres include RPGs, MMORPGs, and action/adventure games.

Follow Wccftech on Google to get more of our news coverage in your feeds.