Cyberpunk 2077 got its facial animation mostly right – Polygon

The dead-eyed NPC has been the butt of endless jokes and memes for pretty much as long as 3D games have been around. When playing big-time open-world RPGs, you spend most of your time talking to digital faces. Whether thats in Deus Ex, Skyrim, or even The Witcher 3, if the NPC talking to you seems off in any way could ruin every gamers favorite synergistic word, immersion. This often leaves NPCs in the tough spot of either looking like a puppet or looking like Angelina Jolie in that movie Beowulf from 2007.

Now, with the release of Cyberpunk 2077, a new system for facial animation has entered the video game industry. Jali Technology has worked to create an animation system that takes all 44 of the English phonemes and animates them to an NPCs face along with an audio file. This is all based on machine learning and basic locations of jaw, lip, and tongue movements. Jalis tech also goes beyond English and supplies other phonemes from other languages, allowing Cyberpunk 2077 to sync multiple languages with relative ease.

So what does the future hold for this technology, and will it bring us closer to crossing the uncanny valley?

Here is the original post:

Cyberpunk 2077 got its facial animation mostly right - Polygon