NVIDIA’s Simon Yuen Talks About the Future Horizon of Digital Humans

by Clarissa Garza

We all know about the applications for digital humans for films and video games, but at NVIDIA, Simon Yuen has discovered the vast need and potential for digital humans beyond the entertainment industry.

Yuen spoke with NVIDIA AI Podcast host Noah Kravitz about how we’re getting to a point where the simulation of digital humans is possible as opposed to just the visual representation.

Yuen leads the Digital Human project at NVIDIA. One of the first products the team is developing is Audio2Face, an AI based solution that automates high quality facial animation in real-time, based only on audio as input.

Key Points From This Episode:

  • For the AI to simulate human behavior, the system not only learns the behavior but also the physics behind each movement.
  • Audio2Face is a technology that creates facial animation, specifically for lip sync, voice-based animation. Picture the six-year-old daughter of Yuen’s coworker saying ‘happy birthday’ as a rhino.


“We are at a point where programs can write programs that no humans can write. And as cliché as that may sound, it is very true. ” — Simon Yuen [21:34]

“So I think this idea of metaverse for enterprises is very real, and it’s coming” — Simon Yuen [28:59]

You Might Also Like:

UC Berkeley’s Pieter Abbeel on How Deep Learning Will Help Robots Learn

Robots can do amazing things. Compare even the most advanced robots to a three-year-old, however, and they can come up short. UC Berkeley Professor Pieter Abbeel has pioneered the idea that deep learning could be the key to bridging that gap: creating robots that can learn how to move through the world more fluidly and naturally.

Speaking the Same Language: How Oracle’s Conversational AI Serves Customers

At Oracle, customer service chatbots use conversational AI to respond to users with more speed and complexity. Suhas Uliyar, vice president of bots, AI and mobile product management at Oracle, talks about how the newest wave of conversational AI can keep up with the nuances of human conversation.

Hugging Face’s Sam Shleifer Talks Natural Language Processing 

Hugging Face is more than just an adorable emoji — it’s a company that’s demystifying AI by transforming the latest developments in deep learning into usable code. Research engineer Sam Shleifer talks about the company’s NLP technology, which is used at over 1,000 companies.

Tune in to the AI Podcast

Get the AI Podcast through iTunes, Google Podcasts, Google Play, Castbox, DoggCatcher, Overcast, PlayerFM, Pocket Casts, Podbay, PodBean, PodCruncher, PodKicker, Soundcloud, Spotify, Stitcher and TuneIn. If your favorite isn’t listed here, drop us a note.

Tune in to the Apple Podcast Tune in to the Google Podcast Tune in to the Spotify Podcast

Make the AI Podcast Better

Have a few minutes to spare? Fill out this listener survey. Your answers will help us make a better podcast.