NVIDIA's Generative AI to Enable Real-time Dialogue between Players and NPCs

2023-05-30

When games collide with artificial intelligence... It should look good, but sound even better. At the 2023 Taipei International Computer Exhibition, NVIDIA CEO Jensen Huang showcased a stunning cyberpunk ramen shop scene, giving a glimpse of what it could be like when games and AI come together. In this scene, you can directly interact with the shop owner instead of clicking dialogue options. Simply hold a button and speak your words with your own voice, and the video game character will respond to you. NVIDIA calls it a "glimpse into the future of gaming". However, the actual dialogue system still needs improvement, perhaps next time NVIDIA can consider using GPT-4 or Sudowrite. The entire conversation transcript is as follows: Player (Kai): Hey, Jin, how are you doing? Jin: Unfortunately, not too good. Kai: What happened? Jin: I'm worried about the crime rate here. It's been getting worse lately. My ramen shop got caught in the crossfire. Kai: Can I help? Jin: If you want to do something, I heard rumors that a powerful crime boss named Aokikoumei is causing all sorts of chaos in this city. He might be the root of this violence. Kai: Where can I find him? Jin: I heard he often hangs out at the underground fighting club in the east of the city. Give it a try there. Kai: Alright, I'll go. Jin: Be careful, Kai. From just a conversation, it's hard to tell if this interaction method is better than selecting from an NPC's dialogue tree. But it's impressive that generative AI can respond to natural speech. Hopefully, NVIDIA will release a demo so we can try it out and get some completely different results. This demo was created by NVIDIA and its partner Convai, aiming to promote the tools used to create it, including a middleware called Nvidia ACE (Avatar Cloud Engine for gaming), which can run locally and in the cloud. The entire ACE suite includes the company's NeMo tool for deploying large language models (LLMs), Riva for speech-to-text and text-to-speech, and more. Of course, this demo doesn't solely rely on these tools - it was built with Unreal Engine 5, featuring impressive visual effects such as ray tracing, making the chatbot part seem somewhat plain in comparison. At this point, we have seen more engaging chatbot conversations, even if they can sometimes be mediocre and lack creativity. During the preview event at Computex, Jason Paul, Vice President of GeForce Platform at NVIDIA, mentioned that this technology can be scaled to multiple characters simultaneously, theoretically allowing NPCs to have conversations with each other. However, he admitted that he hasn't seen actual testing yet. It is still unclear whether developers will adopt the entire ACE toolkit like the demo version, but "Stalker 2: Heart of Chernobyl" and "Solisburg" will use a part of NVIDIA's toolkit called "Omniverse Audio2Face", which attempts to synchronize the facial animations of 3D characters with the voice performances of actors. Source: https://www.zdnet.com/article/nvidia-unveils-new-kind-of-ethernet-for-ai-grace-hopper-superchip-in-full-production/

RECENT AI NEWS

RECENT AI TOOLS