Omniverse Audio2Face is a beta application that uses generative AI to animate a 3D character’s facial movements to match an audio source. This tool is useful for animating characters for games, films, digital assistants, and other real-time applications. The app comes preloaded with a 3D character model named “Digital Mark,”.
You have to record audio, insert it into the app, and watch your 3D character come to reality. You can generate facial animations live using a microphone. The app supports many languages and can process audio in real time. Audio2Face allows you to retarget facial animations to any 3D human or human-esque face, making it easy to swap characters on the fly.
The app allows you to animate as many characters as you like from the same or different audio tracks. Adjust the degree of facial expression on the face and multiple animation files from multiple audio sources. This site includes several emotional and customizable levels of intensity to choose from.
Some other important features are blending shape conversion and blend weight export options. It also supports export-import with Blendshapes for Blender and Epic Games Unreal Engine to generate motion for characters using their respective Omniverse Connectors.