Nvidia Maxine Eye Contact

2023: Deepfake System Announcement

On January 12, 2022, Nvidia announced the Maxine Eye Contact system. This is a deepfake technology that provides constant eye contact for users when conducting video conferencing sessions.

It is noted that visual interaction plays a key role in establishing social relationships: in face-to-face conversations, it, in particular, means trust and attention. However, constant eye contact is not possible in video conferencing scenarios: in this case, it is necessary that users constantly look directly at their cameras, and not at computer displays. However, this is impossible, since conference participants need to view certain documents, open and send any files, etc.

Nvidia Maxine Eye Contact

Nvidia Maxine Eye Contact solves the problem. The system uses artificial intelligence and a special software filter for a webcam, so that the user's real-time view is "redirected" to the lens. Moreover, the algorithms preserve the color of the user's eyes and reproduce natural blinking. In addition, all kinds of factors are taken into account, such as ambient lighting, shadows, white balance and shade, blur, as well as skin color, face and eye shape, head pose, etc. View redirection is disabled in cases where the head rotation exceeds the specified threshold.

Maxine Eye Contact technology is available for use as part of the AR SDK for Windows and. There Linux SDK is appropriate application documentation API and an application example that demonstrates the ability to integrate the function into third-party programs. With this SDK API, you can control various parameters, such as time filtering, sensitivity, etc.^[1]

Notes