NVIDIA unveils Avatar Cloud Engine (ACE), a custom AI model that integrates AI into Non-Playable Characters (NPCs) for natural game language interactions.
NVIDIA ACE Model Intends to Revolutionize Gaming Experience With The Help of AI-Generated Characters
With the aid of this tool, software, and game developers will be able to create and integrate unique voice, conversation, and motion AI models. The project is being carried out in partnership with Convai, a business developing conversational AI for online gaming environments.
Here is how NVIDIA breaks down the foundations of the model:
- NVIDIA NeMo — for building, customizing and deploying language models, using proprietary data. The large language models can be customized with lore and character backstories and protected against counterproductive or unsafe conversations via NeMo Guardrails.
- NVIDIA Riva — for automatic speech recognition and text-to-speech to enable live speech conversation.
- NVIDIA Omniverse Audio2Face — for instantly creating expressive facial animation of a game character to match any speech track. Audio2Face features Omniverse connectors for Unreal Engine 5, so developers can add facial animation directly to MetaHuman characters.
NVIDIA also showcased the model by demonstrating an example of an AI-generated conversation with an NPC. As you can see in the video below, the character answers questions based on the narrative backstory through the help of generative AI.
NVIDIA's new tool is a significant advancement for the gaming industry. We're excited to see how AI is incorporated into forthcoming games since it will significantly change the experience of playing a particular title, mainly when dealing with NPCs.
NVIDIA ACE: Bringing Life To NPCs
Game developers and startups are already using NVIDIA generative AI technologies. For instance, GSC Game World is using Audio2Face in the much-anticipated S.T.A.L.K.E.R. 2 Heart of Chornobyl. And indie developer Fallen Leaf is using Audio2Face for character facial animation in Fort Solis, their third-person sci-fi thriller set on Mars. Additionally, Charisma.ai, a company enabling virtual characters through AI, is leveraging Audio2Face to power the animation in their conversation engine.
NVIDIA is leveraging AI across the board and games are an essential segment where the company is also bringing its Neural Compression technology for up to 16x details, training the DLSS 3 models in NVIDIA servers for enhanced details and quality & a new radiance cache technology that can help enhance the performance of path tracing in titles such as Cyberpunk 2077 that utilize it.
About the author: Muhammad Zuhair is a hardware and technology reporter for Wccftech, specializing in the semiconductor industry and the complex interplay between technology, manufacturing, and geopolitics. His coverage focuses on the corporate strategies and technological roadmaps of industry giants like TSMC, NVIDIA, Samsung, and Intel. Zuhair's expertise lies in deconstructing complex topics such as fabrication nodes (e.g., 2nm process), the economic impact of policies like the CHIPS Act, and the strategic development of AI infrastructure from NVIDIA, AMD and Intel.
Follow Wccftech on Google to get more of our news coverage in your feeds.
