Nvidia rolled out the “Nvidia Maxine”, a platform with GPU-accelerated AI conferencing software to improve video quality. This platform is a cloud-native solution that assists service providers in providing AI effects like super-resolution, gaze correction, face relighting, noise cancellation, and like to end-users.
Nvidia’s Maxine platform to reduce bandwidth to one-tenth requirements of the H.264 standard
The company says that Nvidia Maxine greatly reduces the bandwidth required for videoconferencing calls. The platform analyses the facial points of every person present on the call. It then algorithmically recreates the face in the video on the other side. Hence, one can online stream with much lesser data that flows back and forth across the internet.
Nvidia also stated that Maxine can minimize bandwidth to one-tenth requirements of the H.264 standard. This improved compression is achieved by applying AI models called Generative Adversarial Networks (GANs).
These two-part models consist of a generator for creating samples and a discriminator to differentiate between these samples and real-world samples. The top-performing GANs are capable of creating realistic portraits of people who don’t exist like snapshots of fictional apartment buildings.
Nvidia’s Jarvis SDK used for conversational features
Want to publish your own articles on DistilINFO Publications?
Send us an email, we will get in touch with you.
Another important feature of this platform is face alignment. It enables automatic adjustment of faces so that the participants appear facing each other in the call. Also, gaze-correction helps simulate eye contact, even though the camera may not be aligned to the end user’s screen. Auto-frame enables the video feed to follow a speaker as they move away from the screen.
Also, participants can choose their avatars, having animations that are automatically driven by their voice and tone. Maxine also uses Nvidia’s Jarvis SDK for conversational features. It also uses AI language models for speech recognition, language understanding, and speech generation.
Avaya becomes the early user of the Maxine platform
The Maxine platform has been adopted by Avaya. Through the Avaya Space videoconferencing app, end-users will be greatly benefited by the removal of background noise, virtual green screen backgrounds, and features that help presenters to be overlaid on the top of the presentation content. Also, live transcriptions can recognize and differentiate voices.
With the ongoing pandemic, videoconferencing has increased exponentially, allowing people to converse with minimum infection risk. In April, Zoom had surpassed 300 million daily meeting participants, an increase from 200 million in the previous month, and 10 million in December. As per reports, business conferencing apps were the most preferred apps, with 62 million downloads during the week of March 14-21.