By akademiotoelektronik, 30/10/2022

Nvidia AI will allow you to make videos without showing your real head

A specialist in artificial intelligence, Nvidia has just unveiled a collection of tools supposed to make our meetings in videoconferencing less painful.Using two neural networks, the company is able to change the direction of your gaze, and to reply your head movements to a virtual avatar.

Nvidia wants to change the way we make videoconference.The graphics card manufacturer and AI specialist unveiled new advances in the field on June 24, with a lot of tools supposed to improve our video meetings.

The company has made the demo of an artificial intelligence capable of analyzing your face in real time in order to appear impeccable during all your calls, even if you have just got out of bed and you are still in pajamas.

Vid2vid Cameo, of his little name, is actually able to reply your head movements and animate your avatar in real time, to make your interlocutors believe that you are perfectly attentive.Thus, if you watch TV from home during a meeting in Visio, you just have to nod with punctually so that your avatar appears involved and serious, looking straight in the eyes of your interlocutors and interlocutors.

Test the tool on one of your photos

In his research article, Nvidia explains to use a technique called "facial redirection" which will somehow straighten the angle of your face so that you appear to look straight in the camera, even if your face is actually bias.The network of neurons behind the tool will in a certain way animate a photo of you with your eye movements, jaw and head so that you appear as natural as possible.

A tool has been made available by Nvidia to better understand the functioning of all of this.By sending a simple portrait of you, you can modify the image by getting your eyes up, turn your head on the right or lower your eyes, all in seconds without touching Photoshop.The result is far from impeccable for the moment.The modified photo lacks detail and sports notable artefacts, but beyond the raw quality of the shot, the work on the rotation of the face and the eyes is quite stunning.The AI easily manages to make you raise and lower your head in a relatively realistic way.Real -time demonstration is even more striking.

A photo entirely straightened by IA

Source : Nvidia

Another notable advantage of this technique: it considerably reduces the bandwidth necessary to make a phone call in Visio.Rather than sending the raw video flow of your camera, it is possible to send only the information on the movement of the face and therefore to reduce the bandwidth required for a fluid phone call.

10 times less bandwidth

"By compressing and sending only the position of the head and key points in both directions, instead of the complete video flow, this technique makes it possible to reduce by 10 the bandwidth needs for videoconferences, thus offering a more fluid experience"Indicates Nvidia.

All these advances are still at the experimental stage, but the demonstration of Nvidia reveals a future or the Visio will be less painful than today.It only remains to convince users and users to let a neural network analyze their facial expressions, and as with everything related to facial recognition, this is not easy.

All about Nvidia