Smart ID Engine (formerly Smart IDReader)

Main article: OCR - Optical Character Recognition

Smart ID Engine (formerly Smart IDReader) is an artificial intelligence system for recognizing documents.

Smart ID Engine is a rethink of the company's flagship technology Smart IDReader and allows you to recognize the passport of the Russian Federation and another 1,482 certifying documents of 210 jurisdictions in the world with support for 99 languages, including hieroglyphic writing (data for 2020).

The program for recognizing identity cards Smart ID Engine (formerly Smart IDReader) is entered Register of Russian Software in (order Ministry of Digital Development, Communications and Mass Media Russia of 14.12.2016 No. 653).

2024

Smart ID Engine 2.5

On December 5, 2024, the AI company Smart Engines introduced a version of the passport recognition system and other Smart ID Engine 2.5 documents for customer identification. To do this, the developers trained two neural network ensembles "Da Vinci" and "Sherlock." The execution time of both AI models in one image averages less than 1 second without using a GPU.

Smart ID Engine

The Da Vinci neural network architecture is able to find and recognize a document located at an angle, upside down or mirrored, as well as determine its geometry. According to the developers, the speed and alignment of the technology's actions made it possible to compare it with the outstanding Italian artist, geometry and inventor Leonardo da Vinci - the standard of a Renaissance man.

In extreme cases, Da Vinci AI can extract passport data when the document spread takes less than 15% of photos with dimensions of 720 by 1280 pixels. The number of errors when recognizing document fields on selfies has decreased by 5 times. This makes it possible to conduct the KYC procedure one selfie at a time with a passport for customers with budget smartphones. Using Smart ID Engine 2.5, banks and fintechs will be able to offer modern remote service standards.

Sherlock is a neural network ensemble for verifying the authenticity of documents. According to the developers, like the literary prototype, the AI created by Smart Engines thinks and acts as a real scientist and detective. AI analyzes hundreds of parameters in parallel and then makes a logically reasonable conclusion that before it: a genuine document, fake or dummy. At the same time, the neural network Sherlock is not unfounded - it argues its decision and gives an understandable explanation.

Sherlock deals with both elementary fakes and complex ones - for example, made using deepfake technologies. In total, the AI performs 533 checks, divided into 13 groups. The ensemble of neural networks certifies the digital authenticity of the document, detects any interference in images ("Anti-Photoshop"), examines samples in the ultraviolet, infrared and visible ranges, analyzes the data for consistency. In addition, Sherlock determines the "vivacity" of the document (liveness), excluding the substitution of real paper by photocopy or shooting from the screen, and checks the photo from the document with the bearer's face. The neural network will determine the forgery of a document from any country in the world, and if the form is outdated or the state does not exist, it will inform about it. Sherlock is suitable for work in both the physical channel and the digital channel with photo and video streams.

Previously, the neural network was a "black box" for business, since it gave a binary answer - "fake" or "not fake." Neural network "Sherlock" will become assistants, for specialists of banks, MFIs or other organizations, since in each the case will give an understandable explanation - why neural networks gave a positive or negative answer. The AI algorithms used in this version of the Smart ID Engine will optimize protection against fraudsters in digital channels, without complicating the process of obtaining services to conscientious customers.

Thanks to the algorithmic optimizations carried out in the Smart ID Engine update, the amount of memory consumption for the Russian passport has been reduced by 17% and the quality of document recognition has been improved. The number of errors in recognizing a passport of the Russian Federation filled by hand decreased by 19%, in the case of typewritten - by 6%. The changes also affected other most popular documents: the number of errors in STS recognition decreased by 29%, the driver's license - by 20%, SNILS - by 14%, birth certificates - by 15%. Due to the integration of 4.6-bit neural networks, the detection speed of printed and handwritten texts in the image increased by 10%, Smart Engines reported.

Compliance with the law is ensured both at the stage of AI training and during the operation of the system at the client. Specialized graphics datasets created according to the MIDV methodology were used to train systems and take measurements. Smart ID Engine 2.5 works in the customer's loop, while documents are not transferred for processing to third-party services, cloud verifiers, and crowdsourcing platforms.

We called the created neural network ensembles so it is no coincidence. The name of the painter and inventor Leonardo da Vinci was given, since the great Italian scientist was fluent in mirror writing - like our AI. The second ensemble is named after the brilliant detective Sherlock Holmes, who masterfully revealed the most difficult things and was able to elegantly and simply explain his conclusions. When developing it, we set ourselves the goal of making AI with an interpretable result so that companies can reduce the risks of document fraud and do not say NO to customers without a good and understandable reason. told Vladimir Arlazarov, CEO of Smart Engines, Doctor of Technical Sciences

As of December 2024, the Smart ID Engine allows you to recognize all pages of the Russian passport, including handwritten registration, driver's license, registry office certificates and other identity cards in photos, scans and in the video stream. This version adds support for 107 document types, now Smart ID Engine recognizes 2897 document types. A total of 4573 document templates from all countries of the world are supported.

Smart ID Engine is included in the Register of Information Technologies of the Russian Federation and belongs to the class of AI systems. The system is available for integration into server, desktop, mobile and web applications, and is also compatible with all current operating systems, including domestic Linux distributions, Aurora and Elbrus OS.

Compatibility with Rosa Chrome 12

STC IT ROSA has confirmed the compatibility of its ROSA Chrome 12 operating system with key solutions in the Smart Engines line. Thus, users of the operating system of the ROSA family were able to use Smart ID Engine technologies, which greatly simplifies the identification and verification processes, increasing the speed of working with documents. This was announced by STC IT ROSA on November 7, 2024. Read more here.

AI for remote identification of a person by selfie with a passport

Smart Engines has developed AI for remote identification of a person with a selfie with a passport. The company announced this on October 31, 2024. The technology automatically recognizes passport data and checks the photo in the document with the bearer's face, allowing you to go through KYC procedures for issuing cards, issuing loans or registering with services in 1 second. Now the process of identity confirmation, which is familiar to customers of banks, MFIs and sharing services, has become possible with one photo and is fully automated.

The end-to-end neural network model created by Smart Engines scientists instantly recognizes all the data of the main spread of the passport, including the photo of the owner, and checks the photo with the bearer's face in a selfie. The technology does not allocate biometric descriptors for sending to the EBS, which ensures the security of the procedure for users. The AI system automatically eliminates the aberrations of the front camera and recognizes the document, even if it is shot in low resolution.

Artificial intelligence Smart Engines allows you to automate the KYC procedure in two key scenarios - confirmation of the client's identity by an away employee of the bank and independent remote user identification. The system operates in digital and remote service channels, and the entire process of reading data and comparing faces takes no more than 1 second.

The solution is supplemented by a module for checking the "vitality" and identifying signs of falsification of the presented document, which helps to timely detect and prevent illegal actions using stolen photos and deepfakes in digital channels.

Worldwide, passport photography of a person is the gold standard for remote identity identification (KYC). We set the task - to create AI for joint document recognition and face reconciliation. And we present the fruits of our research - we implemented the recognition of the entire spread of the passport, including handwritten ones, and the reconciliation of faces without highlighting biometrics in one photo. In the future, we plan to scale this technology and export it to other countries, "said Vladimir Arlazarov, CEO of Smart Engines, Doctor of Technical Sciences .

Integration with Atomais platform

Technologies for recognizing and authenticating documents the Russian AI- company Smart Engines are integrated to the platform Atomaiz"." Smart Engines announced this on September 12, 2024. More. here

Obtaining the status of software with artificial intelligence

The Ministry of Digital Development of Russia has assigned software solutions of the Russian company Smart Engines the status of software related to the field of artificial intelligence. The corresponding changes were made to the Unified Software Register. Smart Engines announced this on August 29, 2024.

Now users of all flagship products of the company, including Smart ID Engine, and Smart Document Engine Smart Code Engine , Smart Tomo Engine can receive additional support from the outside, states including by reducing to tax income payments. This measure was introduced in 2023 to stimulate demand for domestic software high-tech equipment.

Smart Engines software products cover the full range of document recognition tasks. On the basis of its own OCR, such problems as recognizing a QR code in an Internet bank, recognizing a passport in any systems and applications, recognizing unstructured documents in more than 100 languages ​ ​ have been solved.

Tablet compatibility Kvadra_T

Smart Engines confirmed the compatibility of its software products and domestic Kvadra T tablets ones following a series of tests. Earlier, the company Yadro announced its intention to occupy 10-15% of PCs Russian market tablet in the middle price segment. Compatibility has been confirmed with the Smart ID Engine. Smart Engines reported this on August 9, 2024. More. here

Smart ID Engine 2.4.0

Smart Engines on June 6, 2024 introduced an updated version of their Smart ID Engine 2.4.0 product. Now the solution based on artificial intelligence even better reads the handwritten text in the passport of the Russian Federation and in the registration stamp. The company's scientists managed to make a breakthrough and improve the quality of recognition thanks to an updated model of generating synthetic data for training neural networks.

In this version of the software product, the number of registration recognition errors was reduced by 30%. Smart ID Engine recognizes handwritten and printed registration in the passport in photos, scans and in the video stream in real time. If there are several stamps on the pages in the passport of the Russian Federation about registration and deregistration, then the system recognizes all of them. The recognition time of the registration page on a modern phone is 0.4 seconds. In server solutions, dozens of images per second can be recognized without using graphics accelerators.

Measurements on the verification sensors of the synthesized images also showed that compared to the previous version, the quality of recognition of all letter and digital fields of the handwritten passport was improved: in the field "Name" the number of errors decreased by 53%, "Date of birth" - by 24%, "Gender" - by 31%, "Surname" - by 16%, "Patronymic" - by 10%.

Smart ID Engine is a system that can extract data from a Russian passport, driver's license and more than 2,700 types of certification documents from 235 jurisdictions around the world in more than 100 languages. The technology is an on-premium solution that allows you to recognize documents in photos, scans and video streams. In the process of recognition, data and images are not transferred to cloud services or other unauthorized persons, which ensures the security of processing personal data for the bearer of documents and business.

Smart Engines neural networks are able to identify fake documents. Algorithms check the originality of the document form, the integrity of its protection elements, and also find re-labels, reprints and other signs of mechanical intervention. The system also checks the "validity" of the document at the moment of time, performs cross-validation of data in the visual and machine-readable areas. In total, the system checks for more than 60 parameters.

Another feature of the Smart ID Engine for identifications customers is non-biometric face reconciliation. The system compares two images - a photo in the certifying document and a selfie of its owner - and gives an assessment of how similar they are, while not highlighting biometric descriptors.

Integration into Notary Office Automation System

Smart Engines, Intek Group of Companies and Triasoft have created and tested a new AI-based complex that is designed to protect citizens and businesses from document fraud when performing notarial actions. Smart Engines announced this on May 23, 2024. Read more here.

Ability to recognize a foreign national's card

Smart Engines scientists have trained AI to recognize a foreign national's map in a video stream, photos and scans. The company announced this on May 7, 2024. A pilot project for issuing such cards is being implemented in Moscow and the Moscow region. Now developers will be able to add recognition of a foreign citizen's card to their applications on a smartphone, tablet, desktop computer and terminal. Ultralight 4.6-bit neural networks provide 1 frame recognition in less than 1 second.

A foreign citizen's card is issued free of charge to foreign citizens and stateless persons staying in the Russian Federation when they apply to the Multifunctional Migration Center to obtain or renew a work patent. It contains the owner's name, date of birth, citizenship, signature sample, validity period, QR code, machine-readable zone (MRZ) and other data.

The presence of such a card allows migrants to confirm the receipt of a patent for work, as well as the passage of such mandatory procedures as a medical examination or fingerprint examination at the migration center. The document has a built-in Troika card, with the help of which foreigners can make and pay for trips in public transport in Moscow and the Moscow region. It is recommended to always have a foreign citizen card with you, since it may be needed when passing a document check by police officers.

In addition to a foreign citizen's card, Smart Engines AI solutions can not only recognize passports and other documents, but also verify their authenticity. Smart Engines neural networks check the originality of the document form, the integrity of its protection elements, as well as identify re-labels, reprints and other signs of mechanical intervention. In addition, the system checks the "validity" of the document at the moment of time, performs cross-validation of data in the visual and machine-readable areas and, if it has a chip, checks the data from it with the information from the document. In total, the system checks documents for more than 60 parameters.

The topic of illegal migration is a serious concern in society, and the government is taking various measures to address this problem, including the introduction of new documents. We create systems that will allow these documents to be quickly and efficiently recognized and verified. In particular, our OCR technologies allow you to add recognition of a new type of document literally one example, almost immediately as they appear. Today, our system supports more than 2.7 thousand documents of 220 countries and jurisdictions, "said Vladimir Arlazarov, CEO of Smart Engines, Doctor of Technical Sciences.

Integration with Aurora OS

Smart ID Engine and other systems developed by the Russian company Smart Engines have become available to owners of devices based on the Aurora OS right in the web browser. This was announced on April 12, 2024 by representatives of Smart Engines. Read more here.

Red OS Compatibility 8

Smart Engines has tested the compatibility of the latest version of its technologies with Red OS 8. The company announced this on March 28, 2024.

Previously, the company's software products - Smart ID Engine, Smart Code Engine, Smart Document Engine and Smart Tomo Engine - received the 2.3.0 update. Read more here.

10% better recognition of Latin American ID documents

Smart Engines on April 5, 2024 introduced an updated version of 2.3.0 software products.

Now the Smart Code Engine solution recognizes MRZ twice as quickly - a machine-readable zone in passports or other identity cards containing basic information about the owner of the document. Smart Code Engine 2.3.0 is trained to extract data from a machine-readable area even in the most difficult cases: for example, if the MRZ on a document is curved, that is, it looks not like a straight line, but like an arc.

The upgrade also received a product for instant payments Universal Pay, which is part of the Smart Code Engine. This payment tool allows customers to automatically run the desired payment script when the camera of a mobile device hovers over a barcode, bank card or phone number. In this version, it can recognize phone numbers and card numbers in the same frame at the same time. Other improvements include facial account recognition in payment details and REST API support.

As for the Smart Document Engine, it added the ability to recognize several identity documents in one video clip or image. In addition, the recognition of Russian documents, such as a certificate of income of an individual, a diploma, a certificate from a previous place of work, an order to grant leave to an employee, a comparative statement of inventory-19 and an employee's personal card (form T-2), as well as a new type of documents was added for recognition - power of attorney.

Scientists have improved their flagship Smart ID Engine credential recognition product. It improved the quality of recognition of ID-documents of Latin American countries by 10%. In addition, this product can now recognize:

• 24 new types of identity documents that were not previously supported. We are talking, for example, about new documents of countries Africa (driver's license, Libya ID-card Sierra Leone or visa Madagascar), as well as several (the European states medical cards in or Finland military ticket in). Norway
• 69 new subtypes of identity documents, including Argentina, Armenia, Brazil, Germany, France and other countries.

Thus, Smart ID Engines currently supports recognition of 2709 (+ 142) document types with 4305 (+ 258) unique templates.

The technology of non-biometric reconciliation of persons was significantly improved: the number of errors was reduced by 20% in it. State-of-the-art development compares two images: one is a photo from a certification document, the other is a selfie of its owner, and then gives an assessment of how similar they are, without highlighting and analyzing biometric characteristics.

The operation of AI-based technology for detecting interference in the image of a document has been quadrupled. It is part of the authentication system for passports and other ID documents.

Introduction of Express notary workflow into the automation system

In the system of automation of notarial workflow EXPRESS"" it became possible to check the face of a visitor with a photo in his document without creating any biometric descriptors and sending data to. EBS The technology based on AI will protect more attacks than 7,000 notaries from fraudulent notaries who use the EXPRESS program developed by the company "." Triasoft The developer of the solution is the company that Smart Engines announced this on March 18, 2024. More. here

The ability to recognize any number of documents in one frame

Smart Engines March 12, 2024 presented, AI capable of recognizing any number of documents in one frame - up to several dozen. This system will help, and to banks IFI other companies not fintech market only improve the client path in the process, but also identifications protect themselves from fraudulent ones. attacks

This is a fundamentally different and much more convenient scenario for identifying customers. Previously, a user who wants to get a loan or use another banking service had to alternately photograph and attach identity documents to the application - a general civil passport of the Russian Federation, SNILS, a driver's license and others. This, on the one hand, is not very convenient and labor-intensive, and on the other hand, it leaves room for attackers to maneuver. Scammers can use AI to generate images of documents or edit them using photo editors to pass anti-fraud checks.

The alternative state-of-the-art scenario created by Smart Engines researchers is based on multi-object document recognition. Now the client does not need to separately photograph documents - just arrange them in one frame and take a picture. All the rest of the work will be done by AI. Due to the latest achievements of scientists in the field of computer vision and machine learning, the system automatically detects documents, recognizes all the necessary fields and detects any fraudulent attacks - traces of Photoshop or other interventions. If a fraudster "inserts" a document into an image or mounts several, the system will instantly detect fraud.

The number of documents in the photo is essentially limited only by the ability of the device's camera, since the proprietary OCR Smart Engines provides text recognition as long as a person sees it. At the same time, recognition of all documents in the photo takes literally a second, which makes the new user path not only safer for banks, but also convenient for the client himself. This speed is achieved through its own OCR technology with the use of ultralight neural networks.

Speed, convenience and security are the most important characteristics of any system. We made a decision that improved all these indicators. In addition, it is capable of recognizing an unlimited number of documents in 1 image, "said Vladimir Arlazarov, CEO of Smart Engines, Doctor of Technical Sciences.

The functionality was included in the latest version of the Smart ID Engine 2.3.0 software product. In addition to them, it contains a number of other important improvements. So, 24 types of identity documents were added to the Smart ID Engine, which were not previously supported. We are talking, for example, about documents countries Africa (driver's license in, Libya ID-card Sierra Leone or visa for), Madagascar as well as several (the European states medical cards in or Finland military ticket in). Norway Added 69 subtypes of identity documents, including,,,,, and Argentina Armenia others. Brazil Germany France Thus, the Smart Engines product supports the recognition of 2709 (+ 142) document types with 4305 (+ 258) unique templates for March 2024.

2023

The ability to recognize a handwritten stamp with a registration in the passport of the Russian Federation

Smart Engines has added recognition of a handwritten stamp with a registration in the passport of the Russian Federation to the Smart ID Engine system. This is a fundamentally different tool for automating business processes, which ensures that customer address data is entered into information systems. The ultralight neural networks used in the solution without the use of GPU and even on the phone allow you to recognize passport pages with registration in the image in 0.4 seconds. The developer announced this on December 7, 2023.

Smart ID Engine recognizes handwritten registration in photos, scans and video stream in real time. If there are several stamps on the pages in the passport of the Russian Federation about registration and deregistration, then the system recognizes all of them. At the same time, when recognizing a passport, the user does not need to worry about how these stamps are filled - handwritten or typewritten. These addresses are retrieved automatically and provided in a convenient structured form.

The solution will speed up customer service in cases where in order to provide services, it is necessary to enter data not only the main spread of the passport, but also the registration pages. You need to enter these addresses, for example, when opening a bank account, to receive various financial products, buy SIM-cards, connect the Internet, issue an insurance policy, when hiring new employees, register in applications and in other situations.

Smart ID Engine is based on artificial intelligence technologies and allows you to recognize all pages of the Russian passport, as well as check the document for authenticity. This is safe for the company and its customers, since to extract the details of the image and document data are not transferred for processing to third-party services for manual entry by external verifiers. The proprietary GreenOCR technology (trademark) developed by Smart Engines scientists is responsible for recognizing handwritten and printed passport data.

Smart ID Engine 2.2 with improved quality of Russian passport recognition

Smart Engines on November 30, 2023 introduced an updated version of the Smart ID Engine 2.2 certification recognition system. In it, the quality of recognition of the passport of the Russian Federation has been improved by 10% and the list of supported documents has been expanded - now there are more than 2.5 thousand of them, and recognition of Korean writing has been improved by 15%.

In the update - due to the use of the latest generation neuronets - the accuracy of recognition of all fields of the main spread of the passport - RUSSIAN FEDERATION digital ones such as the passport number, date of issue, division code and text - full name, "by whom issued," "place of birth" for printed and handwritten filling is increased.

In this release, the previously presented stamp recognition technology with handwritten registration has become available to users. The AI registration page detects and recognizes in 0.4 seconds. Data on the place of registration is required when issuing financial products from banks or receiving SIM-cards from mobile operators .

Smart ID Engine 2.2 adds 19 types of identity documents that were not previously supported or that have undergone changes. We are talking, for example, about documents countries Europe (ID-card, and Greece, Ireland Sweden residence permits and), Hungary (Switzerland North America driver's licenses of a number of states - Idaho USA , Utah and Virginia, ID-card of the Canadian state of Alberta),, and others China. Turkey In total, the Smart ID Engine allows you to recognize 2567 types of ID documents of 230 countries and jurisdictions, and the total number of templates has grown to 4047.

Smart ID Engine 2.2 has 15% improved Korean language recognition. As of November 2023, OCR supports 103 languages.

Obtaining the status of software in the field of AI

Smart ID Engine 2.0 software solution for identification recognition and authentication has received the status of software related to the field of artificial intelligence. This means that when implementing the system, Smart Engines customers will receive a number of advantages when calculating income taxes. Smart Engines (Smart Endzhins) announced this on November 3, 2023.

Benefits for domestic companies using and implementing Russian software from the register of Ministry of Digital Development marked "belongs to the field of artificial intelligence" began to operate on January 1, 2023. In accordance with the letter of the Federal Tax Service (FTS) dated 07.03.2023 No. SD-4-3/2672 @, when forming costs for the right to use the software, the taxpayer has the right to indicate expenses with an increased coefficient of 1.5.

Availability on Abanking

The company Abanking entered into a partnership agreement with the developer of recognition systems. Smart Engines The goal of the partnership is to promote the development and promotion of technologies for and. bank industries fintech Smart Engines announced this on October 31, 2023.

Abanking customers using the platform in their IT ecosystem will have access to all the key solutions of the Smart Engines product line. Among them are the flagship product Smart ID Engine, Smart Code Engine and Smart Document Engine. Read more here.

Smart ID Engine 2.1.0

On July 20, 2023, AI-company Smart Engines presented an updated version of software products for recognizing bank cards, QR codes, Russian passports and other certification documents, as well as for scanning primary, accounting and business documents.

According to the company, the Smart ID Engine, Smart Code Engine and Smart Document Engine programs for July 2023 are used by ten of the thirteen systemically important credit institutions in Russia - for onboarding, opening accounts, issuing banking products, services and payments.

In the version of the Smart ID Engine 2.1.0 product, recognition of the Russian passport was optimized. Scan speed document on PCs with x86 architecture increased by 15%. Quality of recognition of the stamp on registration at the place of residence improved by 5%.

In the updated version of the Smart ID Engine, Smart Engines developers have achieved a 23% reduction in the number of errors in recognizing the machine-readable zone (MRZ) of passports while maintaining speed characteristics.

The Smart ID Engine added 27 types of identity documents that were not previously supported. We are talking, for example, about the documents of African countries (identity card of the Central African Republic, card of the voter of Mozambique), as well as the CIS countries (birth, death and marriage certificates of the Republic of Kazakhstan and Kyrgyzstan).

Added 45 subtypes of identity documents, including China, the Republic of Korea, Australia, USA, Finland, Switzerland and others. In total, as of July 2023, Smart Engines technology provides data recognition of 2511 types of certification documents and 3907 templates from 230 countries and jurisdictions in 102 languages.

Smart Code Engine 2.1.0 optimizes the phone number recognition module that is used for scanning in banking applications when paying for services. The Smart Engines team added support for recognizing all groups of telephone codes of the Russian Federation, and also optimized the quality of barcode recognition.

In Smart Document Engine 2.1.0, the speed of recognition of full-text documents increased by 5%. The process of scanning an individual's income statement (previously 2-NDFL) on processor an x86 architecture has become 1.4 times faster.

All Smart Engines products have improved the quality of the built-in data depersonalization tool. This feature was developed by the Smart Engines team in 2018. With its help, the regions of the document image containing sensitive ones personal data are pixelated, which ensures protection the personal data of customers from misuse.

Software Products Smart Engines - Smart ID Engine, Smart Code Engine and Smart Document Engine - developed in Russia and entered into the register of domestic programs. They ensure safe processing and do not pose risks of personal data and confidential information leakage. Smart Engines systems do not transfer personal data to third parties. They work autonomously and do not require a network connection.

Smart ID Engine 2.0 with improved registration stamp recognition quality

Smart Engines on May 17, 2023 presented an updated version of the Russian software product for recognizing a passport of a citizen of the Russian Federation Smart ID Engine 2.0. The system began to work faster and more accurately. The number of recognition errors in the main fields of the Russian passport decreased by 15%. The quality of recognition of the registration stamp increased by 5%. The process of detecting passport pages is now seven times faster. The quality of detection of secondary passport pages has significantly improved - by correcting 60% of errors. The quality of detection of the signature of the passport holder has also grown.

In this version, Smart ID Engine artificial intelligence detects 36 signs of forgery of the Russian passport in the mobile and - Internet channel. Users can check the liveness of the document, anti-photoshop (image editing), identify copy-paste and check holograms. The system automatically verifies the fonts with which the document is executed. She knows how to check the protective elements of a passport, RUSSIAN FEDERATION including machine-readable MRZ zones. The system also checks whether the document is "valid" for the time being.

Users of the Russian three-band scanner for data extraction and multispectral authentication of documents PS4 with Smart ID Engine 2.0 software have access to the mode of enhanced passport verification on the first four pages of the document. This solution also improves font and signature verification. PS4 with the Smart ID Engine 2.0 program reveals 66 signs of forgery of the Russian passport.

Smart Engines has been continuously developing the Russian passport recognition system since 2015. We are introducing the latest generation of Smart ID Engine. The program has received powerful functionality for authenticating a passport, which practically leaves no chance for fraudsters, "said Vladimir Arlazarov, CEO of Smart Engines, Candidate of Technical Sciences.

Most systemically important credit institutions - eight out of thirteen large banks in Russia - are already using the Smart ID Engine. In addition to providing banking services, Smart Engines is used for issuing insurance policies, railway tickets and SIM-cards, for automatic passport control at Sheremetyevo and in the business processes of Russian retailers.

Module for identification of signs of falsification of documents

In April 2023, SMART Endzhins Service completed the refinement of the Smart ID Engine identity card recognition software product, which developed a module for identifying signs of falsification of documents and attacks on presentation of documents in the optical range based on artificial intelligence technologies. The refinement of the IT solution was implemented using the funds of the Russian Information Technology Development Fund (RFRIT). The amount of the grant amounted to 74.8 million rubles. The funds of the Fund were used to pay employees, purchase the necessary equipment and attract IT specialists who worked on the implementation of the project. Its total cost is 152.3 million rubles. RFRIT announced this on April 26, 2023.

The IT product is a completely domestic development that does not contain foreign components, which avoids external risks. The system substitutes foreign solutions in the corporate and public sector such as Jumio, Onfido, ABBYY, Kofax. The software is included in the Unified Register of Russian programs for electronic computers and databases.

The transition of Russian banks to domestic software is successful and quite active, and the security of the financial sector is extremely important for the economic sovereignty of the country.

As of April 2023, Smart ID Engine is used by 8 out of 13 systemically important banks of the Russian Federation. The introduction of the Smart ID Engine product in the Russian banking sector has had a significant economic effect. For example, the bank "Kuban Credit" accelerated the service of payers by 2 times, and the bank "World of Privileges" - by 10 times.

Taking into account the strengthening of sanctions pressure and the withdrawal from the Russian market of foreign vendors, projects in the information protection field INFORMATION SECURITY have acquired the highest priority status for state, private companies, and especially financial and banking sector organizations. A huge corporate order has been formed for such decisions. The Fund's task is to provide developers with access to grant financing tools that will allow them to ultra-quickly replace foreign software and bring a popular product to the market, - said the CEO of RFRIT. Alexander Pavlov

Thanks to the timely support of RFRIT, we were able to create the product necessary for the market. As early as April 2023, we have a number of potential customers who are ready to implement the created solution. Russian business is actively transforming with the help of artificial intelligence infrastructure, without changing the interfaces familiar to employees and customers. The introduction of Smart Engines technologies for safe human identification in the ecosystems of Russian companies is especially important in connection with the withdrawal of foreign players from the Russian market. We offer a solution that protects personal data and does not transfer it to third parties and services, - said Vladimir Arlazarov, General Director of SMART Endzhins Service, Candidate of Technical Sciences.

The IT solution simplifies and speeds up the document entry and validation process. Thus, an employee of a bank or insurance company will not need to enter data from a passport and other client documents manually. The operator just needs to show the document to the phone camera or scan it. The technology itself will determine the type of document, recognize the necessary fields, enter client data into the system and perform basic authentication. At the same time, the entry of personal data does not require a network connection, which completely eliminates the risk of their leakage. The procedure is absolutely safe for both customers and companies, since personal data is not transferred for processing to third-party services or third parties.

The software has received functions that allow you to identify disagreements in data, anomalies and discrepancies characteristic of fraudulent attempts. The system allows detecting synthesis or interference in document images, detecting optically variable ink and replacing the document in the form of a photocopy or image of the document on. computer monitor The program detects overlaps of information text and graphic areas with foreign elements, including fingers.

Use in Jump.Work

The company Just Look has started using technology passport recognition Smart Engines in. This will application Jump.Work greatly simplify the freelance procedure identifications and ensure the safety of the processing process. data Smart Engines announced this on March 27, 2023. More. here

Integration with Finservugi Personal Finance Platform

The personal platform finance "" Financial services Moscow Exchange has implemented a system recognitions passports developed by the Russian AI the -company. Smart Engines This was announced on February 27, 2023 by representatives of Smart Engines. More. here

2022

Smart ID Engine 1.13 with Russian passport recognition function

On December 22, 2022, the company Smart Engines announced an update to the Smart ID Engine certification recognition system. For version 1.13, the Smart Engines team completely redesigned all components of recognitions Russian passport technology. This made it possible to improve the accuracy of document recognition by half - by reducing the number of errors by 2 times - while maintaining the speed characteristics of the system. The achieved level of passport recognition quality allows you to declare the transition of the process, scannings extraction and subsequent introduction data into corporate systems into automatic mode.

The accuracy, speed and reliability of the automatic passport recognition system of the Russian Federation from Smart Engines will help business become more efficient. By refusing to manually enter passport data, companies will be able to reorient operators to more important tasks, for example, to sell additional services and products. If earlier the operator spent minutes entering personal data, then the machine enters information in 0.5 seconds.

Automatic recognition of the passport of the Russian Federation significantly reduces business risks: errors caused by the human factor, data leaks through operators and fraudulent actions of employees. Smart ID Engine is already used when opening bank accounts, issuing insurance policies, selling tickets, onboarding customers and in many other processes that require a certification document.

Smart ID Engine 1.13 uses neural network algorithms artificial intelligence the next generation. With the help of their own algorithms AI , Smart Engines developers have achieved a significant improvement in localization technology, which combines the processes of searching for a document in space, detecting all text fields of the Russian passport (series and numbers, dates and places of issue, name, gender, year and place of birth) and recognizing them.

The system in real time recognizes all pages and data of the passport of the Russian Federation, including handwritten fields, and also checks its authenticity. By releasing the next version, the company made the process of recognizing and entering passport data automatic. The quality of recognition of the passport of the Russian Federation, which was achieved in 2022, significantly exceeds the quality of manual entry by operators. This allows you to raise the level of client service in branches and in remote channels, commented on the CEO of Smart Engines Candidate of Technical Sciences Vladimir Arlazarov.

Smart ID Engine provides safety for both companies and end customers, since the system does not transfer personal data to third parties and does not require connection to. to the Internet The software product is included in. register of Russian programs It allows developers to integrators to add highly accurate recognition of passports and other documents to,, mobile server desktop and web applications for OS the family,,,, and Linux"." Windows iOS Android OS Aurora Elbrus

Implementation in the service "Kontur. Hotel"

Service Kontur. The hotel, which helps hotels and hostels manage the number of rooms, automates the process of processing guest documents using Smart Engines passport recognition technology. This will allow hotels to significantly speed up the process of registering guests and, at the same time, save on the purchase of expensive equipment for scanning documents. Smart Engines announced this on December 14, 2022. Read more here.

Smart ID Engine 1.12.0 with visual memory algorithm

The company Smart Engines introduced recognitions the next generation Smart ID Engine 1.12.0 certification document system on October 31, 2022. The system has a special algorithm visual memory, which has improved the quality and speed of automatic determination of the type of document.

The Smart ID Engine uses compact indexing methods for the multidimensional feature space of local document features identification. They allow you to almost instantly determine the type of document among more than 3 thousand possible options. Automatic type detection mode is available when you recognize documents using the Smart ID Engine in a real-time, time on, and video stream. photos scans

The company has developed and implemented a special visual memory algorithm in the Smart ID Engine. It significantly speeds up streaming images on the server and makes the process of recognizing documents on a smartphone convenient and fast. Now users do not need to specify the document type in the mobile application before scanning. This will greatly simplify the processes of identifying customers, said CEO of Smart Engines, Candidate of Technical Sciences, Vladimir Arlazarov.

The next generation Smart ID Engine supports docking functionality and is therefore much faster it is integrated infrastructure in the customer. This feature allows you to deploy a highly loaded identity recognition system in minutes using -. Dockercontainer To install application developers, Linux including domestic distributions, it is enough to execute one command. The Smart ID Engine in the Docker container integrates into the client's local server infrastructure and is ready to scan 55 passport spreads per second on a 32-core without HPC using a GPU.

Smart ID Engine is entirely developed by Smart Engines scientists and is included in the unified register of Russian programs. Document recognition in the Smart ID Engine is a secure technology. Personal data is not transferred to third-party services for processing or to third parties for manual entry.

Smart Engines researchers, introducing their own advanced developments into the Smart ID Engine, achieved an average 10% improvement in the quality of character recognition of Cyrillic and Latin alphabets. Proprietary GreenOCR technology supports printed text recognition in 102 languages ​ ​ of the world.

In total, 148 types of identification documents have been added to the Smart ID Engine. The total number of documents supported reached 2,198 types and 3,385 templates from 220 countries and jurisdictions. Among them, more than 50 types are national documents of Russia and other EAEU countries.

Introduction in Tinkoff Junior

In the children's version of the Tinkoff application, schoolchildren will be able to pay for purchases using a QR code using the fast payment system (FPS). Scanning QR codes uses a technology developed by specialists of the Russian company Smart Engines, which reported this on September 1, 2022. Read more here.

Implementation in the application "Traveling without Covid-19"

The Travel Without COVID-2019 app uses AI to safely and correctly enter user data. Smart Engines announced this on June 24, 2022. Automatic recognition of passports of citizens of the EAEU + is implemented on the basis of technologies of the Russian company Smart Engines and is carried out on the user's mobile device without the need to enter data manually. Read more here.

Smart ID Engine 1.11.0 with 43 additional credential types

Smart Engines On June 20, 2022, the company introduced an updated version of the Smart ID Engine system for recognitions passports RUSSIAN FEDERATION and other personal documents in mobile applications web applications and other information systems. In version 1.11.0, due to the use of branded algorithms AI researchers, the company managed to achieve significant acceleration. Now the iPhone 12 system is capable of recognizing 8 passport turns per second. server In solutions on 32-core HPC without the use of GPU, the recognition speed of the Smart ID Engine can reach 55 images per second.

Smart ID Engine 1.11.0 adds 43 additional types of certification documents, and the total number of documents that can be recognized as of June 2022 is 1974 for more than 200 countries. The system allows you to automatically extract data in images (photos and scans) and in the video stream in real time. Recognition does not use verifiers from third-party collaboration services or crowdsourcing platforms to enter customer data. Working in the customer's information loop ensures the security of the process of personal data recognition.

Implementation of IDpay for money transfers to Armenia in the mobile application

On June 14, 2022, Smart Engines presented software solutions for document recognition for customer identification in Armenia. The system supports high quality and speed of recognition of passports, ID cards, driver's licenses, other documents and forms in English, Armenian, Russian and 99 more languages, as well as recognition of bank cards and QR codes. Technology also provides face reconciliation for document photos and selfies. Companies and integrators can use recognition in mobile applications, web solutions, and accounting systems.

Smart Engines technologies for June 2022 are already used to recognize identity documents of Armenia and Russia in the Russian mobile application "IDpay - Money Transfers." This application allows you to make convenient and fast money transfers in rubles from any Russian card to the card of any bank of Armenia. The development of the application and the integration of recognition libraries were carried out by Mobile Payments specialists.

Citizens of Armenia and Russia can register in the IDpay application. To do this, they need to go through remote identification by taking a photo of a passport RUSSIAN FEDERATION or ID card of Armenia. Using the Smart ID Engine, documents are recognized and the necessary ones data are automatically entered into the fields of the registration form filled in the application. The recognition process is performed safely on the user's mobile device without transferring images to external resources. The recognition time of the main reversal of the passport of the Russian Federation or the ID of the map of Armenia on 1 frame smartphone on takes about 0.15 seconds.

After the person checked and confirmed his own, in the personal data IDpay application it becomes possible for him to do by entering money transfer the data (attaching) of the Russian bank card. You can send funds to IDBank customers by phone number, and to customers of other banks in Armenia by card number. To enter the data of the bank card from which the transfer is made or to which the transfer is made, recognition is also used on the basis. algorithms AI The user just needs to show the map to the camera. smartphone The accuracy of card number recognition using Smart Engines technologies reaches 99.68%, and the speed of operation is 0.035 seconds per frame.

We are pleased to offer document recognition technologies in Armenia in photos and in video streaming in mobile applications, web solutions and accounting systems. Our software products support data extraction in more than 100 languages, including Armenian and Russian recognition. On the basis of our products, Armenian companies will be able to realize a fundamentally different digital experience of interaction with customers when remotely servicing or providing services in departments, "said Vladimir Arlazarov, Candidate of Technical Sciences, General Director of Smart Engines.

In addition to Armenia, more than 1974 types of certification documents of 210 countries of the world are supported. The most complete coverage has been implemented for document recognition of the countries of the Eurasian Economic Union, which, in addition to Armenia, includes Belarus, Kazakhstan, Kyrgyzstan and Russia.

Release version 1.10.0 with support for 1887 document types

Smart Engines, a representative of the Russian market for automatic document recognition systems, on March 15, 2022 announced the release of version 1.10.0 for the entire line of its products.

Key Smart ID Engine updates include:

• Added types of identity documents that were not previously supported. The Smart ID Engine now supports 1,887 document types with 2,839 unique templates.

Read more here.

Integration into the Alfa-Bank mobile application

Alfa-Bank offered customers the opportunity to update passport data directly in the mobile application. The service allows you to update the data if a document has been replaced when you reach 20 or 45 years old, lose your passport or for other reasons - for this you do not need to come to the office on purpose. This was announced on February 7, 2022 by Smart Engines, together with which this solution was implemented. Read more here.

AI system for recognizing all pages of the passport of the Russian Federation

January 26, 2022 The research company Smart Engines presented an AI system for automatic recognition of all pages of the Russian passport. It is intended for safe entry of passport data in client service processes when extended or complete document information is required. Its application will allow companies to realize user experience when opening a bank account, registering a mortgage, conducting real estate transactions and hiring new employees.

AI developed by Smart Engines researchers finds on images passport pages and searches for stamps on them. Automatically recognized data of the main spread of the passport with printed and handwritten filling, all typewritten stamps about the place of registration and information about previously issued passports.  For all pages of passport AI automatically determines serial number of page in document, and also recognizes the document number, regardless of whether it is printed or applied by laser perforation.

You can use the development to recognize passport data in photos, scans and in video streaming in mobile applications, Internet solutions and accounting information systems. The recognition quality of Smart Engines is achieved exclusively for account of application of AI algorithms. This ensures the security and privacy of everything process and does not create additional risks to business and users. Images with client data are not transferred to manual input in any way to external performers or to teamwork services, which allows companies to comply with international and national security standards for the processing of personal data. The time for recognizing the data of the main spread of the passport on 1 frame on a mobile phone is 0.15 seconds, and modern computers can process dozens of images in 1 second. This speed was made possible thanks to its own OCR technology, which uses light neural networks. Their creation is the result of advanced research conducted by Smart Engines scientists in the field of energy efficient AI (Green AI).

{{quote 'author
= comments CEO of Smart Engines Ph.D. Vladimir Arlazarov|"We present tools for digital business transformation based on AI technologies to Russian clients and partners of the company. The system can recognize the passport of the Russian Federation in real time if the user shows the document to the camera of his phone page by page or automatically check that all the necessary pages of one passport are present in the application from the client in photographs or scan images, and recognize the necessary data. By performing recognition, the AI we created treats the entire passport as a single set of data, exploded to different pages, "}}

2021

Implementation in Raiffeisen Online

Scanning QR codes in Raiffeisen Online has become even easier thanks to Smart Engines technology. The bank announced this on December 9, 2021. Read more here.

Ability to recognize the certificates of a tractor driver

Smart Engines has taught its artificial intelligence to recognize the certificates of a tractor driver. The company announced this on November 24, 2021. Thus, Smart Engines wanted to emphasize the need to use high technologies to simplify working with documents in all areas of the economy, from industry to agriculture.

The Smart Engines system allows you to recognize data of more than 1834 types of identity documents, including passports, driver's licenses, STS, SNILS and others. Using the Smart ID Engine software, you can easily provide fast and safe remote customer acquisition and service for banks, insurance companies, telecom operators, microfinance organizations, brokers, tour operators and other organizations. The product allows you to organize the sale of financial, insurance, transport services and products, tickets and SIM cards in vending machines and terminals.

Smart ID Engine technology makes the process of recognizing the rights of a tractor driver and other documents fast and convenient. The system automatically detects, determines the type and recognizes the identity document data. Recognition algorithms are resistant to poor lighting conditions, shooting angles and geometric distortions. The technology can even recognize the "book" of the Russian passport.

The high accuracy and speed of data extraction are provided by green AI algorithms, which are based on the results of scientific research by Smart Engines scientists in the field of creating lightweight neural networks. The scanning process is performed automatically on the devices themselves, without transferring data to the outside. This makes it possible to ensure the safety of personal data processing in accordance with international standards. Using the Smart ID Engine, companies can recognize document data in photos, scans, and video streams in real time. The software product toolkit is available for developers to embed in mobile, server and desktop applications.

Implementation in the Button Service

Accounting outsourcing service Button has introduced Smart Engines technology for recognizing a passport of the Russian Federation into its personnel accounting system. This was announced on November 19, 2021 by Smart Engines. Read more here.

Integration into the Console service for freelance personnel management

The Console company, which offers a freelance personnel management service, has implemented the Smart ID Engine system for recognizing passports when issuing an electronic signature to external performers. This was reported on August 17, 2021 by Smart Engines, the developer of the Smart ID Engine product. The goal of implementing the solution is to reduce the time required to identify the user by documents. Read more here.

Red OS Compatibility

The Russian developer RED SOFT and the research company Smart Engines have confirmed the correctness of the joint operation of the operating system RED OS and document recognition systems Smart ID Engine, Smart Code Engine, Smart Document Engine. This was announced on August 11, 2021 by the Red Soft company. Read more here.

Browser Recognition Technology View

On June 21, 2021, the company Smart Engines introduced industrial technologies for recognizing documents in, which browser do not imply the transfer of source, intermediate or reference data from a client device. This solution is suitable for personal devices, objects Internet of things () IoT and minimizes the risk of leaks images with passport data of customers via the Internet. More. here

Passport "book" recognition mode from different angles using AI

Smart Engines On May 31, 2021, a scientific company announced the solution of the last fundamental problem with recognition a passport RUSSIAN FEDERATION using technology (AI artificial intelligence). The Smart ID Engine software product demonstrates the recognition mode of the passport "book" from different angles and various real-time lighting in the video stream and in photos. It was the "book" that was the scientific and technological frontier, having overcome which, the task of recognizing the passport of the Russian Federation at the AI level can be considered solved, the company emphasized.

Unlike the traditional task of recognizing a scan copy, when, due to "pressing" the document to the working surface of the scanner, the passport actually turns into a flat object, recognizing a photograph of the passport requires taking into account all the geometric features of the "book" of the document. AI faces the difficult task of determining and restoring the geometry of a document in its original space from its projection onto the image plane. To solve it using artificial visual intelligence methods, Smart Engines researchers created energy-efficient architectures of low-bit neural networks with repeating Radon layers. The equivariance to projective transformations laid down in them allows you to correct promising distortions of the Russian passport both in real time in the process of recognizing the video stream and in individual photographs, the company explained.

Smart Engines is designed to automatically enter passport data in mobile applications, Internet solutions and other systems during remote service and processing of client documents in offices. The full autonomy of the recognition process in the Smart ID Engine ensures compliance with the privacy of users and allows organizations to comply with FZ-152 requirements for the security of personal data processing. Smart Engines does not collect user data to improve the quality of neural network recognition or training. High accuracy and reliability of recognition is achieved in the Smart ID Engine solely through AI algorithms, images of user documents are not transmitted in any form to third-party services for manual data extraction by verifiers.

"On the way to solving the problem of recognizing the passport of the Russian Federation, our scientists and engineers have consistently solved a number of fundamental problems related to both the peculiarities of recognizing the video stream and photographs of documents, and the specifics of the passport itself. This is the creation of technologies for recognizing the characters of rare fonts and non-standard proportions, algorithms inter-frame integration, taking into account errors in autofocus systems and the occurrence of off-scale glare on the protective film, software and hardware optimization AI for working on devices with limited performance, recognizing passports with handwritten filling, stable work in half-darkness on the verge of visibility and, finally, recognizing the passport "book" as a three-dimensional object. Of course, we will continue to work to improve the accuracy and speed of recognition, but we see the main scientific challenges in the requirements economies for creating solutions based on AI solutions to protect users and businesses from fraudulent actions with documents, "said the CEO of Smart Engines, Ph.D. Vladimir Arlazarov

"The human brain is able to recognize objects from almost arbitrary angles without spending significant resources on it. When we pick up a passport, we do not unfold it completely before reading it. We simply open the passport until we begin to clearly see the letters. In this case, the angle between the planes of the pages can still be sharp, and the image of the text on the retina is significantly distorted by the perspective. In the perception of a person, these distortions are absent. Implementing the same principle of operation of an AI-based recognition program has been a challenge for us since we showed the first version of the passport recognition system in the video stream and in photos in 2015. We were able to solve the problem of recognizing the "book" thanks to the creation of an AI model that can accurately and quickly localize and normalize flat fragments of complex three-dimensional objects in images, taking into account the laws of the prospect of the physical world, "said Dmitry Nikolaev, technical director of Smart Engines, Ph.D.

As noted in Smart Engines, the algorithmic database provides high quality and speed of recognition of Russian passport data using the Smart ID Engine software product starting from version 1.4.0. Users or visiting employees can take photos or recognize a passport on video, showing the document to the camera of the phone or tablet in the way they are comfortable. To enter passport data when serving customers in offices, you can show and photograph the document with a regular webcam. Recognition of both printed and handwritten passports is supported.

In addition to the Russian passport, Smart ID Engine allows you to extract data 210 jurisdictions of the world in more than 100 languages ​ ​ from more than 1600 types of certification documents. The product is optimized for the architectures Elbrus",," SPARC MIPS,,, and ARM x86 is compatible with,,,, operating systems iOS"," Android" MOS "Aurora"Red OS Elbrus,", and. Linux Windows macOS server A kit is supplied to developers of mobile, desktop and applications, containing SDK documentation and examples API of integration in different languages. programming

Introduction to Ventra Go Temporary Personnel Ordering Service!

To the mobile application for ordering temporary line personnel Ventra Go! introduced the Smart ID Engine software product. Smart Engines (Smart Endzhins) announced this on May 12, 2021. Read more here.

Inclusion in the register of Russian software

On March 4, 2021, Smart Engines announced the introduction of the Unified Register of Russian Programs for Electronic Computers and Databases of the Smart ID Engine software product for recognizing certification documents. According to the order of the Ministry of Digital Development of Russia dated March 1, 2021, the company's decision is included in the software class, which includes linguistic software and subroutine libraries (SDK).

Smart ID Engine allows you to extract data from documents in the video stream, from photos and images from. scanners As of March 2021, recognition of a passport of a citizen of the Russian Federation, a driver's license of the Russian Federation and more than 1,550 types of certification documents of 210 jurisdictions of the world in more than 100 languages ​ ​ is supported. The product is optimized for the architectures Elbrus",," SPARC MIPS,,, and ARM x86 is compatible with,,, MOS operating systems iOS Android",", ",", "Aurora and RED OS.Elbrus Linux Windows macOS

The software product works autonomously on a terminal device (smartphone, smart camera, terminal, computer, server), does not require a network connection and does not transfer personal data of clients for processing to third-party services or third parties for manual input. Smart ID Engine allows companies to comply with security standards for the processing of personal data. In Russia, this is FZ-152, and in the world - GDPR and CCPA.

The inclusion of Smart ID Engine in the register of domestic software confirms its compliance with the established rules and requirements of Russian legislation.

Integration of Promobot Scanner and Smart ID Engine

On February 25, 2021, it became known that the manufacturer robots Promobot and developer algorithms computer vision Smart Engines entered into an agreement to bring to the market a device for automatically scanning documents and filling out forms., Promobot Scanner Far Eastern High Technology Fund created with the participation, RUSNANO invested 200 million in Promobot in 2020. rubles The cooperation agreement between Promobot and Smart Engines is designed for three years.

As reported, the Smart ID Engine optical recognition technology is responsible for data recognition in Promobot Scanner, which allows organizations to process documents with personal and sensitive data without transferring images to external services. Read more here.

2020

Inclusion of Russian AI cases in the map

On December 15, 2020, Smart Engines announced that its development for recognizing Smart ID Engine ID documents was included in the map of Russian AI cases for sustainable development (SDGs), prepared as part of the international program "Global Challenge - Artificial Intelligence to achieve sustainable development goals."

The Smart ID Engine software product is designed for fast and safe recognition of ID cards, passports, driver's licenses. It applies the scientific achievements of Smart Engines researchers in the field of low-potential neural networks and energy-efficient AI. The project is presented in the category "Combating Climate Change," which is one of the key benchmarks of the UN report on the problems of environmental protection and sustainable development of the planet.

We are a scientific company and adhere to the principles of responsibility when creating AI technologies. For us, this is primarily high quality recognition, environmental responsibility and data processing safety. All our products are based on GreenOCR proprietary AI technology created by Smart Engines scientists as part of the Green AI approach. The new architectures of 4- and 8-bit neural networks used in it made it possible to improve the speed of recognition with improved accuracy and ensured a decrease in the carbon footprint in machine learning processes and when performing calculations, - comments the CEO of Smart Engines, Candidate of Technical Sciences, Vladimir Arlazarov.

Smart ID Engine: Recognition of the passport of the Russian Federation and 1482 certifying documents of 210 jurisdictions of the world

On November 18, 2020, Smart Engines introduced the next generation of passport recognition systems, other identity cards, bank cards, barcodes and documents with authentication and biometric verification capabilities. The company has become a single supplier of technologies for data extraction, authentication of documents with verification of "vitality" (document liveness detection) and signs of compromise (computational document forensics), face matching (face matching) for user verification. All products of this line: Smart ID Engine, Smart Code Engine and Smart Document Engine are developed in accordance with the principles of responsible AI and are designed to protect users and businesses from fraudulent actions with documents.

According to the company, Smart ID Engine is a rethink of Smart IDReader technology, and allows you to recognize a passport RUSSIAN FEDERATION and another 1,482 certifying documents of 210 jurisdictions around the world with support for 99 languages, including hieroglyphic writing. Smart Code Engine combines solutions for optical reading () scannings data bank of cards, barcodes and machine-readable area (MRZ). Smart Document Engine is a system for automatic classification, recognition and separation of details from structured, semi-structured and unstructured documents: help in the form of 2-, PERSONAL INCOME TAX balance sheet, payment order and others. The products are available for integration into mobile, desktop server applications and and work autonomously, providing safety processing personal and sensitive data.

In conditions when personal data leaks become commonplace, the protection of the user from the consequences of compromising their personal data and images of identity documents comes to the fore. narrated Vladimir Arlazarov, Smart Engines CEO, technical candidate sciences

The presented solutions received an update to the proprietary AI technology GreenOCR, which introduced an 8-bit deep computing model. neural networks The technology was created within the framework of the Green approach AI and the sustainable development program implemented under the auspices of the UN. 2nd generation GreenOCR allows you to optimize energy consumption for recognition, as well as process documents faster. smartphones Recognition performance increased by 10%, and on budget devices with limited computing power - by 30%. Thanks to Deep Visual Memory technology, modular architecture, additional algorithmic and code optimization, it was possible to reduce the size of the distribution kit while increasing the number of documents and their templates. For the passport of the Russian Federation, the distribution is reduced by 35%, for documents and ID USA the European cards - 25%, for passports around the world - 15%, for bank cards - 35% and for barcodes - 40%. The innovations reduce the carbon footprint and extend the life of mobile devices on a single charge. accumulator

An important feature was the support of recognition of Arabic writing and languages ​ ​ of the Indo-group the Iranian , which significantly expands the sales market in countries, Middle East Southeast Asia and. Africa We are talking about 21 jurisdictions with a total population of 500 million people that do not use Latin inscriptions in national documents. Arabic recognition is implemented for 73 types of documents, including passports, ID cards and driver's licenses of the following states:,, Algeria Bahrain State of Palestine,, Egypt Jordan,,,,,,, Iraq Iran Comora Yemen Qatar,,,,,,,,,,,,,,. Kuwait Lebanon Libya Mauritania Morocco UAE Oman Saudi Arabia Syria Sudan Tunisia

For November 2020, the Smart ID Engine allows you to recognize documents in the video stream, in photos and images from scanners. The recognition time for the data on the U-turn of the Russian passport on the iPhone XR is 200 ms per 1 frame, the US driver's license is about 250 ms per 1 frame and the German card ID is about 150 ms. The solution always works autonomously on the target device (smartphone, smart camera, terminal, computer, server), does not require a network connection and does not transfer client data for processing to third-party services and/or third parties for manual input. Smart ID Engine allows companies to comply with personal data security standards (FZ-152, GDPR, CCPA) and comply with regulatory requirements in terms of KYC/AML.

Users and integrators in the Smart ID Engine out of the box have automatic document type detection and compact SDK configurations (or a set of libraries) for quick data recognition in auto-selection mode without specifying the type of document for passports of 211 countries of the world, ID cards and driver's licenses of the countries of the European Union and Latin America, driver's licenses of all US states, all certification documents of the countries of the European Union and the CIS.

During recognition in the video stream, the Smart ID Engine is able to select the necessary frame with the image of the document for saving in the company's accounting system and the least damaged (most clearly and without glare) photo of the face on the document, which is extracted as a separate props. Biometric user verification in products is implemented on the basis of the own face recognition technology developed by the Smart Engines research team, which allows you to verify a face photo in a document with the owner's face in another photo, including a selfie taken by the user.

The complex methods used in the Smart ID Engine for checking the "liveliness" of documents in automatic mode determine attempts to use dummies, photocopies, as well as taking an image of a document from the screen of a computer monitor, tablet or smartphone. AI algorithms detect holographic protection elements, special visual protection elements (monogram, ornaments, etc.), check the geometry of the blank and control the behavior of the document in real observation conditions in the video stream and on individual personnel. The "vivacity" detector, according to the principle of operation, belongs to the class of "passive," that is, does not require the user to perform special actions. To recognize and check the document, it is enough to show it for a few seconds to the camera of the device or just take a picture.

Read about the Smart Document Engine and Smart Code Engine products in the corresponding articles:

• Smart Document Engine
• Smart Code Engin

Implementation in the "Nimix" mobile application

The company "Nimix," which provides a service for finding orders and performers, has introduced a technology for recognizing the passport of the Russian Federation and bank cards of the company Smart Engines into the mobile application, which was last reported on November 3, 2020. Read more here.

Introduction into the mobile application of Bank Saint Petersburg

Bank St. Petersburg has introduced Smart Engines technology for recognizing QR codes in a mobile application. This was announced on October 13, 2020 by Smart Engines. Read more here.

Integration into ELMA RPA

On August 13, 2020, Smart Engines announced that in the release of the next version of the ELMA RPA system, a built-in function of high-precision recognition of Russian passports, SNILS, 2NDFL certificates and other documents appeared. The improvement was made possible thanks to the technological partnership of ELMA and the research company Smart Engines, specializing in the development of algorithmic computer vision, machine learning and artificial intelligence. Read more here.

Introduction into Home Credit Mobile Bank

Home Credit Bank has introduced bank card recognition technology developed by the Russian research company Smart Engines into its mobile application. The solution simplifies the entry of bank card data when making transfers from card to card and replenishing an account with a mobile bank. Smart Engines announced this on August 5, 2020. Read more here.

Introduction of QR code recognition technology in the Tinkoff mobile application

As part of the expansion of cooperation between Tinkoff Bank and the research company Smart Engines, QR code recognition technology has been introduced into the mobile bank to pay for receipts and make payments. This was announced on June 17, 2020 by Smart Engines. Read more here.

Integration with VerifyMyAge User Age Verification Service

The developer's Smart IDReader document recognition technology Russian artificial intelligence Smart Engines integrated the British into a multidisciplinary platform for providing services for verifying the user's age in. This was electronic trading VerifyMyAge announced on June 15, 2020 by Smart Engines. More. here

Introduction into SDM-Bank mobile application

barcodes Russian Developer recognition technology Smart Engines was introduced in. SDM-Bank mobile application This was announced on May 27, 2020 by Smart Engines. More. here

Introduction of the Azerbaijani insurance broker Odlar Yurdu into the application

On April 24, 2020, the insurance broker Odlar Yurdu presented to users Azerbaijan an innovative multifunctional one, mobile application SigortApp which introduced the Smart IDReader document recognition technology. More. here

Red OS Compatibility

On April 17, 2020, Red Soft announced that in order to develop technological cooperation, tests were carried out for the compatibility of the multi-platform technology for automatic recognition of certification documents Smart IDReader (manufactured by Smart Engines) and the domestic operating system RED OS (manufactured by RED SOFT). The test results confirmed the correct operation of the products and are reflected in a two-sided certificate.

{{quote 'author=commented Rustamov Rustam Deputy General Director of RED SOFT' The functionality of the operating system is determined primarily by the wide profile of products compatible with it. In this sense, RED OS has already established itself as a universal environment. However, we consider special cooperation with Smart Engines. The confirmed compatibility of Smart IDReader with RED OS allows you to offer the market a solution that fully complies with the import substitution policy, }}

{{quote 'author=emphasizes the CEO of Smart Engines, Ph.D. Vladimir Arlazarov' Smart Engines develops multi-platform recognition technologies that allow customers to meet the requirements of regulators when processing personal data in various information systems. In the process of recognition using Smart IDReader, data is not transferred to external servers, is not saved, and calculations are performed completely autonomously and do not require Internet access. Cooperation with RED SOFT allows you to offer customers a safe solution for processing personal data if the use of common operating platforms of foreign manufacturers is impossible in terms of technical parameters or due to some other restrictions, }}

Integration with Ablera Serdica Suite

April 15, 2020 Ablera entered the market with the offer of the universal trained platform Serdica Suite - an advanced AI solution for business digitalization. Designed with deep understanding business processes insurance and future requirements for, IT using modern technologies and powerful, algorithms machine learning Serdica Suite automates all aspects of customer communication with the help of an intelligent virtual assistant (smart BETH). chat boat

According to the company, the development of Russian scientists from Smart Engines to recognize documents based on artificial intelligence will fully automate the process of entering user data when interacting with the platform. Read more here.

Integration with Moneza

On April 13, 2020, Smart Engines announced the conclusion of a cooperation agreement with the micro-credit company Macro (Moneza brand), part of the international financial group TWINO. The agreement involves the integration and implementation of Smart IDReader technology into the online client application of Moneza. Read more here.

Presentation of the updated version of Smart IDReader 3.6

On March 26, 2020, the company Smart Engines announced the release of the next version of artificial intelligence the Smart IDreader 3.6 document recognition system, which significantly increased the extraction accuracy, data and added the ability to check a citizen's passport for RUSSIAN FEDERATION signs of forgery. The main emphasis in its creation is on improving the security of customer data processing in remote service channels that require remote identifications and verification.

The key function of the presented updated Smart IDreader system is the ability to analyze the authenticity of the Russian passport, namely: checking the document for the presence of a correct machine-readable area (MRZ), matching the color of the pages of the passport and the color of the print print with reference values, the presence and correctness of displaying specific protection elements. Using Smart IDReader significantly reduces the risk of fraudsters using compromised documents when accessing financial, insurance, medical and other services and services that provide remote user identification.

The presented version significantly improved the recognition of two-dimensional AZTEC barcodes, which are used on receipts of the Federal Tax Service of Russia, increased the accuracy of recognition of all types of bank cards, improved algorithms for automatically determining the type of documents for streaming modes and extracting data from documents without prior indication by the user of their type.

The company's achievements in computer vision and machine learning allow the system to work steadily in photos and in video flow from the camera of mobile devices and a webcam. The next version of the SDK implements system-wide improvements in recognition algorithms that allow you to recognize a document convenient for the user without first "aiming" and in various lighting conditions. Artificial intelligence independently determines the angle of inclination and perspective, finds the document in the image and extracts the necessary fields. The working resolution is significantly increased: for confident recognition, a minimum character height of 10 pixels is enough.

The company draws attention to the fact that from March 26, 2020, Russian private companies, when purchasing licenses for the use of Smart IDReader in mobile, server and desktop applications, are provided with a discount of 40% of the base cost for the global market.

For us, as a B2B company, it is very important that our Russian clients have the opportunity to improve the quality of their services by introducing high-tech science-intensive solutions. In today's rather difficult financial, economic and social conditions, we support Russian private companies, and therefore, when concluding contracts for the use of Smart IDreader, we provide them with a discount, - comments Vladimir Arlazarov, CEO of Smart Engines, Ph.D.

You can test the capabilities of the next version by installing the free demo app Smart IDReader from Google play or the App Store.

Integration into Basis CFT Products

On February 20, 2019, Smart Engines announced that the Basis Financial Technology Center (CFT Basis) has implemented Smart IDReader document recognition technology. It is based on a technical solution that allows you to process an incoming stream of client documents. Read more here.

2019

Add support for recognizing 350 additional document types

On January 15, 2020, Smart Engines summed up 2019.

The company's flagship product, Smart IDReader technology, began to recognize Chinese, Japanese and Korean characters in 2019. Over the year, support for recognizing 350 additional types of documents was added, and thus the total number of recognized documents at the beginning of January 2020 exceeded 1100.

Implementing in Blockpass

On December 20, 2019, the developer of the KYC-identification mobile application Blockpass IDN Ltd announced the introduction of a document recognition system from Smart Engines into its eponymous application. Read more here.

Availability of Smart IDreader in "Express" notary office automation system

On December 5, 2019, the company Smart Engines announced that more than 6,500 notaries RUSSIAN FEDERATION who use the notarial workflow automation system "" in their work, Express Russian Smart IDReader passport recognition technology is available. More. here

Smart IDreader 3.3 with the ability to recognize handwritten text in the passport

On November 29, 2019, Smart Engines introduced an updated version of the Smart IDreader 3.3 artificial intelligence system, which significantly improves the accuracy of document recognition around the world, supports recognition of 1,100 types of documents and for the first time demonstrates the ability to recognize handwritten fields in identity documents.

According to the company, Smart IDreader is an embedded technology that allows you to automatically enter data from certification documents in mobile applications, Internet solutions and front-office systems.

In version 3.3, Smart Engines applied scientific advances in optimizing the character recognition process. This technology is called GreenOCR (optical character recognition technology OCR based on "green" artificial intelligence). It implements an approach aimed at reducing energy consumption both during neuronets training and end devices during the execution of operations algorithms. The technology makes it possible to implement increasingly complex recognition tasks while simultaneously reducing the "dimensions" of the used neural networks and increasing their specific performance.

One of these complex tasks that the use of GreenOCR technology allows is the recognition of handwritten spread data with 2-3 pages of a Russian passport. The transition from recognition in images (photographs and scans) of characters of printed and hand-to-hand text to processing of characters written by hand is a serious result in the development of AI, which may allow in the future to recognize handwritten text not only in the Russian passport, but also in other documents.

As of November 2019, such an indicator has become important for business, which we can conventionally designate as how many recognition will last one charge. batteries phone told Vladimir Arlazarov, CEO of Smart Engines

The breakthrough in the use of artificial intelligence in the recognition module and the transition to the CEF (carbon emission free) paradigm was made possible by reducing multiplication operations (by replacing them with addition operations) and reducing the number of input coefficients. told Dmitry Nikolaev, technical director of Smart Engines

The updated version of Smart IDreader facilitates integration processes, improves quality characteristics: increased accuracy of document recognition, added the ability to select the best photo from the video stream, updated the algorithm for cross-checking the contents of a document and its machine-readable zone (MRZ).

To capture a document image in a video stream, mobile applications implement a compact "ID Shot" module. Now users can only search and capture a document image on a mobile device, and perform the entire computational recognition process on the server.

The updated version adds more than 50 types of various identity documents, driving licenses from different countries, including documents from Argentina, Jordan, Montenegro, which were not supported in previous versions. AnyRus and AnyCIS document processing modes have become available to Smart IDreader users, allowing you to recognize more than 20 documents of the Russian Federation and more than 50 certifying documents of the CIS countries without specifying their type.

To facilitate integration processes with server solutions based on OS the family Linux , Smart IDreader SDK has added scripts for automatic assembly of modules for PHP and Python. Support for working with UiPath is also implemented. Robotic Process Automation

Smart IDReader supports hardware platforms Elbrus",,,,,," and DIVISIONAL COMMANDER SPARC MIPS ARM x86 is compatible with MOS operating systems ",,," Aurora iOS Linux Android,,,. Windows macOS Solaris

Smart IDReader has learned to detect forgeries in the dark. Video

On July 1, 2019, Smart Engines introduced an updated version of the artificial intelligence system for document recognition in the video stream and in Smart IDReader 3.0 images. In the version based on the 8-bit OCR of the second generation and the updated algorithmic identification stack, recognition of more than 650 certification documents and verification of signs of document compromise are added. The quality of recognition of the passport of the Russian Federation, MRZ, QR codes, bank cards and other certification documents has been improved. The speed of image processing has increased by an average of 25%, which is especially important for the product to work on low-cost phones.

In 2015, we showed the first solution for recognizing the passport of the Russian Federation on mobile devices and in photographs. Since then, our scientific achievements in the field computer vision have made it possible to offer the market a user experience in processing document photos and live video stream. We are talking about quick algorithms restoration of the geometry of documents in images with projective distortion and ensuring high accuracy of recognition in photographs, regardless of what lighting and what device they were made. One of our main principles is the autonomy of technology. All calculations in the recognition process are always performed on the customer's device. This can be normal smartphone if Smart IDReader is built directly into a mobile application, server desktop or PERSONAL COMPUTER self-service terminal. In any case, we offer the so-called in-house processing, when our users do not transfer information about their clients for processing to external services and can implement high standards of work safety with. personal data told Vladimir Arlazarov, CEO of Smart Engines

According to the company, users of Smart IDReader 3.0 have become available the ability to automatically check in images and in the video stream of the consistency of document data. Document verification includes reconciliation of recognized text data of the visual area of the document and the machine-readable area MRZ, if any. To determine the "validity" of the document, depending on its type, the current date is matched with the date of birth, the date of issue and the validity of the document.

The company also demonstrated the capabilities of Smart IDReader 3.0 when recognizing a passport of the Russian Federation, a foreign passport of the Russian Federation and SNILS in a video stream in unknown lighting (almost in the dark).

The updated version supports the recognition of 940 types of documents, including passports of all countries of the world, identity cards (ID cards), driver's licenses, visas, health insurance cards, etc. Now passports, ID cards and driver's licenses are recognized for each of the countries of Europe and the CIS. The composition of processed documents for Australia, Canada, China, Korea, Mexico, the USA and Japan has also been expanded.

In comparison with version 2.0, recognition of temporary identity cards, prosecutor's and lawyer's certificates has been added for Russian clients, and the forms of documents for a residence permit, military ticket and compulsory medical insurance policy have been set up. At the request of insurance companies and brokers in Smart IDReader, the composition of recognizable fields in the vehicle registration certificate (STS) has been expanded. The Russian passport has improved the quality of recognition of printed stamps with registration and information about the previously issued passport.

Smart IDReader 3.0 improves the quality of recognition of all types of bank cards, the machine-readable MRZ zone on any documents and one-dimensional/two-dimensional barcodes. To recognize MRZ, the algorithm for finding text strings has been improved. The development of barcode recognition technology was aimed at improving the quality of data extraction from AZTEC and QR, which are used on receipts of housing and communal services, the Federal Tax Service of the Russian Federation and other standard documents.

For payment solutions, as well as banking services mobile Internet acquiring , it is proposed to enter the customer's card data when paying application in or on the site with one photo. To do this, Smart IDReader server components added support for the mode of recognizing bank card data in individual images, which was previously available only when working with video.

As of June 2019, more than 35 banks and insurance companies, 18 services providers, leading telecom operators, 6 services for the sale of air/railway/bus tickets, as well as other projects with remote and exit services are users of Smart IDReader. Among them, Tinkoff,, Alfa-Bank,, Vostochny Bank,, Loco-Bank,, Post Bank,, Rocketbank,, Sovcombank,,,,, etc AlfaStrakhovanie Renaissance Insurance SK "Consent". MTS MegaFon CIAN.RU SKB Kontur OdinaKassa

Smart IDReader is based on an AI platform HIEROGLYPH developed by Smart Engines specialists and can recognize documents from more than 180 countries in more than 40 languages. The product is optimized for the architectures Elbrus",," and SPARC ARM is compatible with the MOS operating systems "" (Aurora formerly Sailfish Mobile OS RUS),,, Android"," iOS(Elbrus Linux including),,, and. Astra Linux Windows macOS Solaris

Use of Mafin insurance services in the online platform

On June 17, 2019, Smart Engines announced that the Mafin Online Insurance Services Platform recognizes documents using Smart IDReader. Read more here.

Implementation in the Soglasie SC mobile application

On May 31, 2019, Smart Engines announced that thanks to the Smart IDReader certification recognition technology, the time for registration and renewal of OSAGO policies in the updated mobile application of the Consent insurance company has been halved. On average, a client will spend from 3 to 5 minutes on buying a policy, and less than a minute on prolongation. Read more here.

Integration with Avibus

On April 30, 2019, the company Smart Engines announced that Avibus recognitions Smart IDReader certification document technology has been introduced in the system for ticketing long-distance buses. It allows you to recognize data passports a passenger using or online cash desks ordinary when smartphones selling and selling tickets on aprons, on buses at intermediate stations and at small bus stations. More. here

As part of the service Cian.ru.Ipoteka

On March 26, 2019 Smart Engines , he said that when applying for mortgage through Cian.ru Mobile Application , you no longer need to spend time filling out passports data manually - now Cian.ru recognizes the passport RUSSIAN FEDERATION automatically. Continued. here

As part of the MTS SIM kiosk

Self-service terminals for issuing SIM- cards MTS use the Russian technologies recognitions of companies Smart Engines VisionLabs that solve the problems of extracting from data documents and comparing persons when automatically selling tariffs to customers using a passport. This was TAdviser reported on March 20, 2019 by Smart Engines. More. here

2018

Smart IDReader as of December 2018 allows you to recognize a passport of a citizen of the Russian Federation, bank cards and more than 700 types of documents of more than 165 countries of the world (including, Russia,, USA China Japan, Great Britain, CIS countries, countries European Union , etc.) in the video stream (mobile phones, tablets, webcams) and in individual images (photos, scans).

Smart IDReader is SDK for embedding recognition capabilities in mobile applications, server and desktop solutions. The algorithm base of Smart IDReader is optimized for the architectures Elbrus",," SPARC MIPS,, and ARM x86 is compatible with operating systems, iOS Android Sailfish Mobile OS RUS, Elbrus, (Linux including Astra Linux Atlix), macOS and Windows. Solaris

Integration with Express Notary Office Automation System

On September 17, 2018, the company Smart Engines announced that the notary workflow automation system EXPRESS"," developed by the company TRIASOFT"," introduced the possibility of to distinguish a passport RUSSIAN FEDERATION using a regular webcam. According to the company, this will allow notaries to reduce the time of customer service by refusing the tablet scannings document and manually entering passports. data This functionality is based on artificial intelligence Smart IDReader document recognition technology. More. here

Document Seal and Stamp Recognition Technology

On December 14, 2018, Smart Engines announced the creation of print and stamp recognition technology on documents in video stream, photos and scanned images. According to the company, the technology allows you to add to mobile, server and desktop applications the ability to find seals (stamps) and extract information from them . Its first use was the use in the product of the company Smart IDReader for recognition in the passport of the Russian Federation of the stamp seal, printed stamps with registration and information about previously issued passports.

The developed technology is based on a combination of model approaches responsible for the correct localization of seals and stamps, and special algorithmic machine learning, which are used to solve high-level problems of localizing structural objects and recognizing characters in images and in the video stream. Vladimir Arlazarov, CEO of Smart Engines Ph.D.

As of December 2018, Smart IDReader allows you to recognize the code of the unit that issued the passport, not only from the text field and the machine-readable MRZ zone (if any), but also directly on the stamp seal. When processing the pages of the passport of the Russian Federation, the system allows you to find and extract test data from the registration stamps and information about previously issued documents with printed filling. This information can be used to carry out various checks and auto-fill contracts in banks, insurance companies, sharing economy projects and other services.

The ability to recognize seals and stamps in the passport of the Russian Federation on images and in the video stream is available to Smart IDReader users starting from version 2.2.0 of the system. As of December 2018, the functionality is optimized for Elbrus, KOMDIV, SPARC, MIPS, ARM, x86 architectures and is compatible with operating systems iOS, Android, Sailfish Mobile OS RUS, Elbrus, Linux, Windows, macOS and Solaris.

For December 2018, you can test print recognition by installing the Smart IDReader demo mobile application posted on Google play and the App Store. To do this, users just need to show the passport page with the printing to the camera of their smartphone or process a pre-taken photo of the document. Smart IDReader ensures data security, as it performs all calculations autonomously on a mobile device, does not store or transfer data for processing via the Internet.

Integration with Auto Expenses

On October 18, 2018, Smart Engines announced that Smart IDReader document recognition technology was integrated into the Auto Expenses mobile application. The recognition module is used to enter data of the passport of the Russian Federation when paying for bank loans, as well as to enter data from driver's licenses and STS to check traffic police fines. Read more here.

Integration with CryptoPro TC-SMEV Gateway

On October 16, 2018, the company Cryptomissile defense announced the integration of Smart IDReader document recognition technology developed in Smart Engines"." CryptoPro UTs-SMEV Gateway According to the company, the result of cooperation was the implementation data of passport recognition functionality RUSSIAN FEDERATION and SNILS in the product when issuing certificates. electronic signature More. here

Smart IDReader version 2.0

On June 21, 2018, Smart Engines introduced the next version of the Smart IDReader 2.0 artificial intelligence system for document recognition. The second version, created using deep sparse discrete neural networks, can recognize hundreds of types of official documents in the video stream and in images, typical forms of the A4 format and supports arbitrary shooting angles that are convenient for the user. The product is aimed at the markets of the Russian Federation and the countries of the former USSR.

3 years ago, we offered customers to recognize the Russian passport in mobile applications, showing the document to the phone camera. It's been a rewarding user experience and we're thrilled the market has embraced it. The second version of Smart IDReader is a story about modern standards in document recognition. Customers do not need OCR systems that recognize a passport scan in 5 seconds on a powerful computer and do not know how to process photos with easily readable text simply because the system is not taught the laws of perspective. Users want to recognize hastily taken photos in literally 1 second and perform real-time recognition in the video stream. 'Vladimir Arlazarov, CEO of Smart Engines '

The use of computational-efficient machine vision algorithms and an 8-bit computing model in the Smart IDReader 2.0 version allowed Smart Engines specialists to switch the technological barrier from recognizing A5 and V5-sized documents on mobile phones (Russian passport) to standard certification documents and arbitrary questionnaires, applications, A4 format contracts. When recognizing "large" documents in a video stream in a mobile application, fundamentally different approaches to computing are required, since, unlike server solutions, smartphone performance is limited and it is impossible to simply connect an additional "kernel" to speed up recognition.

The development of remote service channels is one of the main areas of application of document recognition technologies. Often, customers send photos when contacting, in which the documents, due to projective distortions, are non-rectangular quadrangles, and in the case of a Russian passport, the so-called "book." OCR technologies focused on working with scans, when processing such photos, can give quality at a level of 5-10% or less. Smart IDReader 2.0 is able to correct projective distortions both in photos and when working with video stream in mobile applications, offering the user to show the document to the camera as it is convenient for him. Technologically, the ability to recognize is provided almost until a person can read the document without errors.

Thanks to the algorithmic and software optimizations carried out in Smart IDReader 2.0, it was possible to achieve a double increase in recognition accuracy. This means that the number of recognition errors that fall into human verification has decreased by about 2 times compared to the first generation of the system.

In the presented version, it became possible to recognize passports of a citizen of the Russian Federation with handwritten filling. And, although the number of such documents is small relative to the total number, their processing is not only relevant in various financial services, but also another scientific challenge. To process handwritten passports, the Smart Engines solution implements automatic detection of handwriting and the ability to recognize (in addition to the document number) the gender, dates and unit number.

The results achieved by Smart Engines employees were made possible by solving a whole layer of complex scientific and technical problems in the field of computer vision and artificial intelligence. Scientific confirmation of the results obtained was reflected in 2 defended master's theses and in more than 40 articles published in rating Russian and international journals.

In addition to recognizing the passport of the Russian Federation, SNILS, driver's licenses, STS and documents with a machine-readable zone, available in the first version, Smart IDReader 2.0 can recognize 15 types of documents of the Russian Federation, 20 documents of the countries of the former USSR and more than 200 documents of the world in more than 35 languages. The addition of additional types of documents and recognition languages ​ ​ is based on the original development of Smart Engines in the field of visual intelligence - the HIEROGLYPH technology platform.

Documents of the Russian Federation

1. Internal passport of a citizen of the Russian Federation
2. Foreign passport of a citizen of the Russian Federation (old and new samples)
3. SNILS
4. Driver's license
5. Vehicle registration certificate
6. Vehicle passport
7. Diagnostic card
8. Registration Certificate (TIN)
9. Visa of the Russian Federation
10. Compulsory medical insurance policy
11. Birth certificate
12. Death certificate
13. Marriage Certificate
14. Divorce Certificate
15. Work permit of the Russian Federation
16. Residence permit of the Russian Federation
17. Military ID
18. Certificate of the Ministry of Internal Affairs officer
19. Serviceman's ID

Documents of the countries of the former USSR

1. Azerbaijan (Vehicle Registration Certificate)
2. Armenia (Passport, ID)
3. Belarus (Passport, Internal Passport, Driver's License, Vehicle Registration Certificate)
4. Georgia (Passport, ID)
5. Kazakhstan (Passport, ID, Driver's License, Vehicle Registration Certificate)
6. Kyrgyzstan (Passport, ID)
7. Latvia (ID)
8. Lithuania (ID)
9. Moldova (ID, Driver's License)
10. Tajikistan (Passport)
11. Uzbekistan (Passport)
12. Ukraine (Passport, ID, Driver's License, Vehicle Registration Certificate)
13. Estonia (ID)

From the point of view of basic functionality, the quality of recognition of embossed and non-embossed bank cards, a machine-readable area on any documents with MRZ has been improved and recognition of high-density barcodes has been implemented. The video stream, photos and scans provide support for the recognition of one-dimensional barcodes UPC-A, UPC-E, EAN-8, EAN-13, Code 39, Code 93, Code 128 and two-dimensional QR Code, Data Matrix, Aztec, PDF 417.

The algorithm base of Smart IDReader is optimized for the architectures Elbrus",," SPARC MIPS, ARM, x86 and is compatible with,,, operating systems iOS" Android Sailfish Mobile OS RUS Elbrus," (Linux including " Astra Linux Atlix"),, and. Windows macOS The solution Solaris belongs to the class of platform independent - the quality of recognition does not depend on the operating system used and the hardware platform, and the performance is determined by the available computing resources.

Integration with OneKassa service

On April 10, 2018, Smart Engines announced that the OneKassa service had introduced Smart IDReader technology for recognizing Russian passports when selling tickets on intercity buses. According to the company, buses connected to the service are equipped with a special mobile terminal that allows you to sell travel documents. The solution is used to automatically enter personal data about passengers. Read more here.

Kupibilet Application Integration

On February 21, 2018, Kupibilet announced the integration of Smart IDReader technology developed by the Russian company Smart Engines into Kupibilet mobile applications. Read more here.

2017

Testing on 5 Elbrus computing complexes

Smart Engines in December 2017 conducted comparative testing of Smart IDReader on 5 computing complexes with Elbrus processors. During the tests, the capabilities of complexes for solving computer vision problems were compared.

Testing involved 5 different devices based on Elbrus processors, including workstations and server solutions.

List of tested devices:

• Elbrus 101-RS - a compact workstation based on the Elbrus-1C + microprocessor
• Elbrus 401-PC - a personal computer based on the Elbrus-4C microprocessor
• Server Elbrus 4.4 - 4-processor server based on Elbrus-4C
• Elbrus 801-PC - a workstation based on the Elbrus-8C microprocessor
• Elbrus-8.4 - 4-processor server module based on Elbrus-8C

The Smart IDReader application was compiled for the Elbrus architecture from the source code and launched in native mode. At the same time, support for parallelization was provided for the maximum available number of threads.

The study was conducted for the following types of documents: passport of the Russian Federation, biometric passport of the Russian Federation (foreign passport), driver's license of the Russian Federation, driver's license of Great Britain, German ID-cards and a certificate of incapacity for work (sick leave).

To evaluate performance, the net recognition time of one image (scan or photo) was measured without taking into account the time the image was downloaded from the file. In this case, the document in the image could be arbitrarily rotated. The final recognition time was defined as the average of 100 images of each document.

The following are quantitative test results - the processing time of one image for two modes of operation: sequential image recognition (Table 1) and recognition with support for parallelization of calculations (Table 2). In the case where several recognition processes were started, the total time included the time to load images from the file.

The results showed that all participating devices based on Elbrus processors provide recognition time corresponding to industrial document recognition solutions. So, in the parallelization mode of calculations, the recognition time of the passport of the Russian Federation on a compact workstation Elbrus 401-RS is less than 1.5 seconds, and on the top-end Elbrus-8.4 - only 0.11 seconds. At the same time, all server solutions for tasks with a high degree of parallelism showed an acceleration of 3-4 times, noted in Smart Engines.

Joint KYC solution from VisionLabs and Smart Engines

In early July 2017, VisionLabs and Smart Engines proposed a new Know your customer (KYC) solution designed to verify new banking customers who came through digital channels without visiting the office. The novelty as a whole is an SDK for implementation on mobile devices and PCs. Face recognition is based on the VisionLabs LUNA platform, which allows you to identify and verify faces in real time. For document recognition, Smart IDReader technology is used, which implements the ability to recognize the passport of the Russian Federation not only in images, but also in the video stream on mobile phones in on-device mode. Read more about the solution here.

Integration with Passport and ID card Reading-Prim41

The Bulgarian developer of hardware and software for processing documents and ID cards, Prim41 Ltd, has chosen recognition technologies for the Russian company Smart Engines. Within the framework of the cooperation, the first delivery of 100 licenses of the library of recognition of the machine-readable area of ​ ​ documents (MRZ) for Passport and ID card Reading-Prim41 was carried out.

Smart IDReader integrated into VisitorControl

On May 17, 2017, Smart Engines announced the integration of Smart IDReader technology into the VisitorControl registration, accounting and control system of Insyres.

VisitorControl allows you to organize bandwidth mode of any complexity and is compatible with access control systems CDS (). The program has integrated solutions with CDS from Russian and foreign manufacturers, among them: Artonit,,, RusGuard PERCo"," Bastion "Kodos" Bolid, "Sigma-IS," "Kronwerk" Octagram,,, Parsec Bosch KerySystems, and other Apacs Smart^[1]

To speed up the process of registering visitors and reduce errors in manually entering data from documents in VisitorControl, it is proposed to use the additional module "Document Recognition," which allows you to register a visitor by pressing only two buttons.

The beginning of cooperation with Insyres is a great opportunity for us to offer our solution to users of all the most common access control systems presented in Russia. Vladimir Arlazarov, CEO of Smart Engines Ph.D.

On May 16, 2017, the integration of Smart IDReader for recognition of documents in the VisitorControl system was completed:

• passport of a citizen of the Russian Federation,
• all valid driver's license types,
• passports of the Russian Federation
• any documents with a machine-readable area (MRZ).

Smart IDReader allows you to extract text data and determine the type of document, find a photo and signature on the document.

Despite the fact that Russian passport recognition has been available on the market for more than 10 years, these solutions are becoming more and more effective every year for working with visitors. Our testing showed that Smart IDReader, in our opinion, is the best product in terms of the quality and speed of recognition of scans and photos of certifying documents. Valery Zakiev, Head of Insires Information Systems Development and Operation Department

Smart IDReader functionality for recognizing authentication documents in the video stream and in images will be available to users of the VisitorControl system starting from version 6.

2016: Smart IDReader

Smart IDReader is an identity identification system for identity documents.

On September 27, 2016, Smart Engines announced the release of the Smart IDReader system. At the end of 2016, the Smart IDReader document recognition program developed by Smart Engines was included in the Unified Register of Russian programs for electronic computers and databases. In accordance with the order of the Ministry of Telecom and Mass Communications of Russia, the Smart IDReader solution is included in the software class, which includes subroutine libraries (SDKs) and linguistic software.

The inclusion in the register of domestic software of the Smart IDReader program confirms its compliance with the established rules and requirements of Russian legislation. Software products included in the unified register can be purchased by state and municipal organizations, having an advantage over foreign software.

Smart IDReader is a recognition system for securely extracting data from documents on smartphones, tablets, PCs and servers. The system allows online recognition of data in the video stream, photos and scans of documents. Among the supported documents are domestic and foreign passports of the Russian Federation, SNILS, driver's licenses, STS, a standard machine-readable zone in other types of documents.

Russian Passport Recognition, (2015)

The mobile application can recognize the data of Russian documents (passport of the Russian Federation, SNILS, driver's license, STS), any passport and visa documents with a machine-readable zone (MRZ line), bank cards and driver's licenses in Great Britain.

Smart IDReader will make it easier for users of mobile applications to enter personal data manually. To do this, you need to point the mobile phone camera at the document and the system will automatically enter data in the fields of the registration form, questionnaire or application. To recognize the spread of the passport, the owner of a budget smartphone will need from 1 to 2 seconds.

The product supports a high level of security for working with user personal data - all processing is carried out on a mobile phone in real time. Smart IDReader uses only the RAM of the device, does not create copies and does not transfer data for processing via the Internet to the cloud or to a dedicated external server.

Smart IDReader is a platform-independent technology optimized for architecture and "Elbrus" ARM x86, compatible with mobile operating systems and, iOS with Android operating systems of the "" families, (Elbrus Linux including),,, and. Astra Linux Windows macOS The Solaris quality of recognition does not depend on the operating system used and the hardware platform, and the performance is determined by the availability of computing resources.

The speed of recognition on one core of a modern processor manufactured by the company Intel ~ 7 thousand documents per hour.

Technology

The iOS application is based on the proprietary SDK, which allows software developers to embed identity recognition and processing functions in desktop, Internet and mobile applications. All the technologies used in the solution, from document identification to character recognition, are the own development of Smart Engines.

Smart IDReader is a platform-independent solution optimized for Elbrus, ARM and x86 architectures, compatible with iOS and Android mobile operating systems, operating systems of the Elbrus, Linux families (including Astra Linux), Windows, macOS and Solaris.

Smart IDReader searches for documents in the image and in the video stream, determines their type and optimal processing scheme.

During operation, Smart IDReader monitors the recognition process, cross-checks the recognized data and warns the user of possible errors, thereby reducing the level of data input errors.

Vladimir Arlazarov, CEO of Smart Engines

Notes