HSE and Sberbank: an AI system for recognizing emotions

2024: Product Announcement

In October 2024, Russian scientists announced the development of an innovative system capable of endowing artificial intelligence (AI) with emotional characteristics when interacting with people. Technology created by the joint efforts of researchers from the National Research University "Higher School of Economics" (HSE) and Sberbank.

According to the press service of the Higher School of Economics, the system is based on effective AI models of computer vision, capable of recognizing the expressions of users' faces in real time. These models analyze the emotional responses of the interlocutor to AI responses, which allows the formation of special data sets for training and improving the system of generating emotional responses.

iStock

Lyudmila Savchenko, associate professor at the Higher School of Economics in Nizhny Novgorod, explained that the system uses recognized emotions to choose a more empathic AI response. This response is generated simultaneously by several language models attuned to basic emotions: joy, sadness, fear, or anger. As a result, AI is able to provide a more detailed analysis of its recommendations, taking into account the emotional response of users.

The new technology will find application in various areas where it is important to take into account the emotional state of users: in chat bots of companies, support services, educational applications. This will make the offerings and recommendations of products and services more natural and empathic, which will improve the interaction between companies and customers.

According to the HSE press service, by October 2024, scientists are already using the developed AI models in creating a medical diagnostic assistant GigaPevt based on a large language model. GigaChat This assistant is able to analyze the emotional state of the user, which opens up new opportunities in the field of telemedicine and psychological assistance.^[1]

Notes