Sberbank: GigaDoc Multimodal Medical Diagnostic Assistant

The main articles are:

• Virtual Assistants
• Chatbots in medicine
• Speech Recognition (Technology, Market)
• Speech technology: On the path from recognition to understanding
• Medical Decision Support Systems (CDS)
• Artificial Intelligence in Medicine

2025

Launch of free express health assessment via smartphone camera

In November 2025, SberZdorovye launched a free express health assessment for users of the mobile application. The function uses a mobile phone camera and the technology of the medical assistant "GigaDoc" from Sberbank. This was reported by the press service of Sberbank on November 25, 2025.

Each person using a mobile phone can monitor important indicators of their body at any time. Rapid health assessment allows you to easily and quickly track the state of the body and quickly respond to changes in indicators.

𝓲

Фото: Freepik

The system assesses health in just a few seconds of face scanning. The technology analyzes nine key health indicators:

• level; stress
• heart rate variability;
• fatigue level;
• mean glucose;
• risk of impaired glucose metabolism;
• blood pressure;
• cholesterol levels;
• arterial wall stiffness;
• heart rate.

Based on the results of the analysis, the user receives a push notification with a link to a personalized assessment of the risks of developing diseases. The system assesses the likelihood of cardiovascular pathologies, atherosclerosis, hypertension, and type II diabetes mellitus.

The application will offer recommendations for further action. The system may offer to make an appointment with a doctor, undergo additional examinations or pass tests. This helps to identify potential risks in time and take measures to minimize them or prevent the development of diseases.

The results and decoding of rapid health assessments using the medical assistant "GigaDoc" are stored in the user's personal account in the mobile application. Users can track the dynamics of indicators and compare the results of previous measurements.

The director of the health industry center Sberbank Sergei Zhdanov noted that with the help of a smartphone camera, you can quickly and free of charge assess health indicators - from stress levels to risks for the development of diabetes and hypertension. According to Sergei Zhdanov, each person can get an objective picture of his condition in just a few seconds.^[1]

Doctor's digital avatar

On November 19, 2025, an updated version medical AI assistant of GigaDoc was presented - now it communicates with the user through the doctor's digital avatar. The solution also identifies the risks of developing diseases and allows you to get the results of measuring health indicators with the decoding and recommendation of the desired doctor, to whom you can sign up medical for the service SberHealth or connect a package of telemedicine services.

The system determines 20 health indicators in 15 seconds from the face video:stress level, mood, body mass index, pulse, blood pressure, heart rate variability, total cholesterol, low and high density lipoproteins (LDL and HDL), triglycerins, hemoglobin, risks of cardiovascular and metabolic diseases - atherosclerosis, hypertension, type 2 diabetes and others.

{{quote 'author=said Sergey Zhdanov, director of the health industry center of Sberbank. | GigaDoc offers an end-to-end service - from non-invasive diagnostics to an appointment with a doctor. The solution is based on advanced technologies - photoplethysmography -, MLalgorithms a language model Gigachat and an interactive visual interface that creates a feeling of live dialogue with a doctor. Now GigaDoc has a face - a doctor's digital avatar that enhances trust and engagement. The system tracks up to 20 parameters, providing personalized screening, and the results can be instantly stored smartphone in for further appointment with a specialist, shortening the path to medical care. The technology draws attention to health and clinical examination issues, simplifies primary screening and helps identify risk factors early on,}}

GigaDoc analyzes and interprets the obtained data, notes deviations that need to be noticed, and recommends contacting the right specialist to clarify the condition. He also gives personal advice on a healthy lifestyle and answers medical questions - all within the framework of support, and not instead of consulting a doctor.

Inclusion in the register of Russian software

GigaDoc and AI-assistant for health were included in the Unified Register of Russian Software of the Ministry of Digital Science of the Russian Federation. Sberbank announced this on November 13, 2025.

Inclusion in the registry means state that customers can now purchase these solutions as. domestic software Decisions meet the requirements of the national, and benefits and information security tax preferences are laid for their use. This simplifies the process of introducing technologies into the system health care and expands the number of people who can use them.

GigaDoc is an AI-based medical assistant who assesses a person's health from a face video in ten seconds. The complex defines 16 indicators, including body mass index, pressure, risk of type II diabetes, cholesterol and glycated hemoglobin. The technology draws attention to health and medical examination issues, accelerates primary screening and allows the identification of risk factors for the development of diseases.

The AI health assistant on the base neuronets Gigachat collects a history and refers to the relevant doctor, decrypts laboratory tests, gives personal advice on a healthy lifestyle, and also answers medical questions. This tool speeds up diagnosis and saves doctors time collecting a history, and helps people quickly get answers to medical questions and understand further actions. AI assistant Health already works application SberHealth in and conducted more than 350 thousand dialogues with users.

Шаблон:Quote 'author=noted Sergei Zhdanov, Director of the Health Industry Center of Sberbank.

2024: GigaDoc Presentation

On December 11, 2024 Medical , the GigaDoc diagnostic assistant was presented. This service was also developed Sberbank Health Industry Center by scientists of the Laboratory. artificial intelligence Sberbank GigaDoc runs on neural network a model GigaChat and specialized medical models. It can be integrated into any device (or) smartphone laptop and used to monitor human health.

GigaDoc recognizes key human biomarkers: gender, age, pulse, body mass index, emotional state, risk of type 2 diabetes, heart rate variability, cholesterol, and so on. He is also able to offer hypotheses about diagnoses based on the photos provided. The assistant's work is based on technologies such as computer vision, machine learning and remote photopletismography (analysis of skin color change, which is associated with blood flow and is designed to measure heart rate, breathing and blood oxygen saturation).

The multimodal assistant GigaDoc in the future will help medical professionals speed up the initial screening of patients, determine the priority of medical care depending on the severity of the disease (triage), monitor the dynamics of the health of patients and conduct qualitative monitoring of chronic non-communicable diseases.

Smart GigaDoc can be used in a wide range of situations. For example, he can become a personal AI assistant to a doctor and help him more accurately understand the patient, collect a medical history, as well as make individual recommendations. This technology can become especially valuable during telemedicine consultations. Also, GigaDoc can be used for pre-trip and production inspections and in the work of insurance companies in order to assess the potential health risks of the insured.