AI creates stunning 3D facial animation for in-game dialogue

AI 3D face animation
AI research

NVIDIA built an interesting AI algorithm capable of creating 3D face animation using audio input. The tool can accurately mimic facial muscle movements as well as render emotion.

This new machine learning technique relies on deep neural network to map audio input and latent code to disambiguates the variations in facial expression in order to identify emotion. As NVIDIA explains, the latent code is used as an intuitive control for the emotional state of the speaker.

AI 3D face animation — the training method

To achieve this high level of accuracy, NVIDIA captured the facial expressions of actors using nine synchronized video cameras. The AI algorithm analyzes the captures, identifies patterns and then reconstructs the facial expressions.

The system requires only five minutes of training data in order to generate the facial animation needed for an entire game.

For more information, check out the video below:

Better facial animation for in-game dialogue

As you can see in the face animation sample listed above, this new AI algorithm will help game developers to add better facial animation for in-game dialogue. In this manner, video games will become more realistic. Moreover, this algorithm will help game developers create high-quality facial animation much faster than today.

In other words, with the help of this tool, game developers will add more supporting game characters and produce games in multiple languages much easier.

Making video games is a time-consuming and very expensive business. NVIDIA’s new AI tool will reduce both variables and this will translate into more affordable video games.

We’re sure that this impressive AI-powered 3D animation tool will also boost VR games. Imagine being able to play Gears of War 7 VR and walk alongside a super realistic J.D Fenix. How cool is that?

YOU MAY ALSO LIKE: AI creates video game after watching gamers play

Follow The AI Center on social media:

Maddie Blau

I strongly believe that Artificial Intelligence is the future of technology. AI research has yielded significant advancements in recent years and this is only the beginning.

Join me as I track the latest progress in AI research.
AI stock exchange
AI in real life
Canada’s first AI exchange-traded fund enters the market

  Canada launched the first artificial intelligence exchange-traded fund with the ticker MIND. The Horizons Active A.I. Global Equity ETF is an investment strategy run by an AI system. The AI algorithm analyzes financial data to extract patterns in order to determine what are the best investments to make. MIND …

smartest AI
AI research
Are you curious to see who’s the smartest AI in the world?

  The AI world is dominated by fierce competition. Well-known tech giants such as Google, Microsoft, Intel, NVIDIA and other are working at full speed to push AI research forward and innovate the field. The question is: who’s the smartest AI in the world? This is a very difficult question …

google assistant natural sound voice
AI research
Google Assistant’s voice is now more realistic thanks to WaveNet

Getting speech synthesis algorithms to sound natural is a hard nut to crack. AI researchers have been struggling to make digital assistants sound more natural for years, and the results are indeed impressive. However, there’s still something that doesn’t sound right and users can always tell if they’re talking to …