Smart Engines Video Stream Document Recognition Technology

Main article: OCR - Optical Character Recognition

2023: Obtaining a U.S. Patent

Scientists Moscow Smart Engines the companies patented USA one of the key components of the technology document recognition smartphone in a video camera. This is the development behind the line of Smart Engines software products implemented internationally and the Russian companies, including nine out of 13 systemically important banks in Russia. This was announced on June 16, 2023 by representatives of Smart Engines.

Video Stream Document Recognition Technology

According to the company, unlike scanners used in recognition systems of previous generations, smartphones allow you to use a video stream for recognition. In this case, a whole series of images of an object of various qualities, including those with glare, in unusual angles or even in the dark, enters the recognition system at the input.

To solve the problem of mobile recognition, the authors of the patent - researcher programmer Olga Petrova, senior researcher-programmer Ph.D. Konstantin Bulatov and CEO of Smart Engines Ph.D. Vladimir Arlazarov - proposed to first assess the suitability of incoming personnel for recognition, and for the best personnel to share the results of their processing. This allows you to significantly optimize the quality of document recognition. They called this method the weighted method integration.

As follows from the description of patent No. 11640720 of May 2, 2023, Smart Engines scientists proposed to use 50% of the best personnel, taking into account the accuracy of focusing the image and evaluating the recognition results, and assign each character a "weight" based on these criteria. For example, if part of the field is covered with a finger or glare, then the weight of the character will tend to zero, and if the character is clearly visible, its "cost" will be close to 1. After assigning weights, the final result of the analysis of the video stream is reconstructed using the algorithm proposed by the researchers.

{{quote 'author
= noted Vladimir Arlazarov' The method of character-by-character weighting with focus assessment allows optimize the quality of recognition in cases where the certifying document is shot in imperfect conditions - at an angle, in the dark, with glare. Character-wise weighting also positively affects the result of recognition if there are long continuous lines in the document - say, a machine-readable zone.}}

This patent was the fourth invention obtained by Smart Engines scientists in the United States, and the third consecutive patent of the company registered by the States in 2023.

The patent for document recognition technology in the video stream was our third invention to be registered in the States in 2023. Of course, due to the tense international situation, we faced various difficulties in the process of registering inventions. told Vladimir Arlazarov

The method of weighted integration when recognizing text in a video stream was developed by Smart Engines scientists back in 2015. It formed the basis of Smart ID Engine software products (recognition and authentication of a Russian passport), Smart Code Engine (recognition of QR codes, bank cards, phone numbers and bank card numbers), Smart Document Engine (recognition corporate documents). All Smart Engines software products are included in the register of Russian programs. Smart Engines sells them in Russia, the USA and other countries. In 2022 alone, the technology protected by the patent brought Smart Engines more than 400 million rubles in revenue.

Smart Engines technologies are also protected by patents in Russia. Smart Engines employees have registered nine patents of the Russian Federation and 40 utility models. As of June 2023, Smart Engines is in seventh place among Russian IT companies in terms of the number of "digital" patents.