Innopolis University: HLOIA Digital Operating

Main article: Virtual reality in medicine

2021: Virtual Operating System Development

Innopolis University February 16, 2021 announced the development of a digital operating room.

With it, surgeons can view human organs in 3D through mixed reality glasses, assess risks and rule out errors during surgery. The digital operating room was used during 30 operations in urology and oncology at the University Hospital of Urology of Moscow State Medical University named after A.I. Evdokimov, urology departments No. 2 of PSPbGMU named after I.P. Pavlova and MKNC named after A.S. Loginova.

Usually, the surgeon studies the organ on which the operation is to be performed, based on the results of computed tomography or MRI on the monitor. During surgery, he can return to the results of MSCT/MRI - video and images of the organ being operated, but for this he needs an assistant who will switch media files on the screen, since the surgeon's hands must remain sterile.

Specialists of the STI Competence Center in the field "Robotics and Mechatronics Component Technologies" at Innopolis University developed the HLOIA product. Now it's enough for surgeons to make a 3D model of an organ, video and images, based on MRI data, save it all in cloud storage, and then use this program to load the necessary models and files for use during surgery on mixed reality glasses.

The doctor takes the glasses to the operating room and starts the application using gestures: he can once again examine the modeled organ, enlarging it and rotating it 360 degrees, comparing it with the real organ - this helps to navigate the preparation and during laparoscopic surgery, when all manipulations are carried out under the skin through small incisions. He can also gesture to launch, if necessary, pre-prepared videos and images without an assistant. Setting up glasses takes a couple of minutes. The same algorithm is possible in any operation.

Urologists performed the first operations on patients with localized kidney cancer using Microsoft HoloLens 1st generation mixed reality glasses, then switched to Microsoft HoloLens 2nd generation. In February 2020, the development was tested during laparoscopic pancreatic surgery.

In fact, we created a digital operating room that helps surgeons imagine the location of the patient's organs in spatial form, and not in the form of black and white CT sections. Plus, we exclude from the chain of physician assistants who cannot always immediately understand what exactly the specialist wants to see at the moment. The topic ARVR of application/technologies to medicine is popular and we have seen similar projects with colleagues St. Petersburg in and in other countries. But while their development is at the stage when doctors need the help IT of specialists, we have made a ready-made full-fledged product, with which doctors work independently. 1.5 years passed from the beginning of work on the project to the finished project. said Mikhail Ostanin, junior researcher at the Industrial Robotics Laboratory of the STI Center

For the first operation, the developers of Innopolis University prepared for a month, as it was necessary to build the entire chain and a combination of software settings for the task. Just before the operation itself, it took another 9 - 11 hours to model. As of February 2021, it takes no more than an hour to prepare the application for surgery - it all depends on how quickly the surgeon will do the segmentation and which organ is operated on.

We became pioneers in Russia in this area - we were the first to conduct such operations. This development allows you to fully adhere to the principle of "personalized medicine." The creation of a digital operating room allows you to arrange virtual screens as convenient for the surgeon, to project volumetric models onto the operating field and at the same time not to be distracted from the patient while maintaining sterility. Very important is the possibility of assistance in training specialists, easy to use in training. The use of augmented reality during surgery makes it possible to achieve a reduction in the learning curve, especially since it allows to reduce potential critical complications of the patient. noted Igor Semenyakin, associate professor of urology, Moscow State Medical University named after A.I. Evdokimova, doctor of medical sciences

Шаблон:Theme Virtual Reality