Sber Deepfake Recognition System

The main articles are:

• DeepFake
• Video analytics (terms, applications, technologies)
• Neural networks (neural networks)
• Biometric identification technologies
• Facial recognition systems

2022: Obtaining patents

Sberbank on August 17, 2022 announced the receipt of two patents of the Federal Service for Intellectual Property for Technologies created as part of a study to identify deepfakes. The result of the work is an increase in the accuracy and efficiency of detecting synthetic changes in images of people's faces in video.

The basis of the technologies is a number of ensembles of neural network models of the EffectiveNet class (patent No. 2768797) and a method of amplification and analysis by AI of micro-changes in the colors of objects on personnel (patent No. 2774624). Combined into one system, they allow you to determine synthetically modified images of faces in video with high accuracy.

A distinctive feature of the system is the ability to process video content with several faces in the frame. In this case, the system identifies an individual created in a synthetic way and evaluates its reliability, which allows counteracting a number of methods for bypassing deepfake detection systems.

The system efficiency indicators, when measured on independent test samples, amounted to 98%, which is significantly higher than the indicators of published analogues.

The developed technologies are intended for use in solving the following problems:

• protection against cyber attacks by bypassing Face Recognition and Liveness Detection systems;
• identifying early information attacks to combat fake news;
• Secure video conferencing.

Sberbank is constantly improving its cybersecurity systems and conducting scientific research in this area. Our patented inventions will effectively solve the problems of detecting information attacks and cyber attacks using deepfake technologies. Synthetic videos used to attack Sberbank and our clients will be identified at the earliest stages, "said Stanislav Kuznetsov, Deputy Chairman of the Management Board of Sberbank.