In Veliky Novgorod tested an intelligent system of transport security SkyTrack

The SkyTrack company in March, 2018 announced completion of testing of the Russian innovation system of transport security of Skytracking Transport Security (STTS) of own development in Bus fleet in Veliky Novgorod.

Prerequisites

According to the order of the President and the Government, under the auspices of "The agency of strategic initiatives", NTI and the industry union of Neyronet in 2017 the project designed to integrate different technologies of monitoring, control of drivers and vehicles in the field of public and cargo transport started. The project included three Russian companies. One of them — the resident Skolkovo SkyTrack, the developer of solutions in the field of machine learning, neural network technologies, the video analysis.

At the time of our entry into the project we already had separate solutions and examination on processing of a video flow using neuronets. Besides, partnership with JSC GLONASS allowed us to get experience of use of technologies of geopositioning for the solution of different applied tasks. But the project of ASI became this call, he demanded consolidation of our experience and knowledge in all fields of work with data — the CEO SkyTrack Ilya Gotsenko told.

Project Progress

In 4 months to a command SkyTrack was succeeded to create and test a prototype of the SkyTracking Transport Security (STTS) system and also to be prepared for conducting field trials.

By the time of a pilot project STTS represented an intelligent system of the video analysis, processing and data visualization about a status of the driver and the vehicle using machine learning technologies and geopositioning of GLONASS, capable to perform early warning of negative incidents on transport in real time.

Thanks to active participation of ASI, his representations in Veliky Novgorod and personally the governor Andrey Nikitin of testing are decided to be carried out at transport enterprises of Veliky Novgorod to the period from November, 2017 to February, 2018.

At the first stage of the project the STTS equipment including the video camera, the minicomputer, the GLONASS transmitter in a basic complete set was installed in the driver's cabin on 5 vehicles — 4 city buses of the Chinese production and the 1st trolleybus. Then photos of drivers were brought in base that allowed to perform their identification via the video camera on points on the person before a start of motion.

On working computers of heads of SkyTrack transport enterprise unrolled the portal of monitoring and control of transport security for data mapping about incidents and analytical indicators in real time.

Work of a complex in brief represents the following process:

• Information from vehicles, including a video flow and coordinates, comes to the minicomputer, previously is processed, then SkyTrack in Moscow is transmitted through the modem to the platform of processing of data Heaven on servers.
• In Heaven data are processed using neuronets, further the result goes to the SkyTracking Transport Security portal for visualization and generation of the reporting. Incidents are fixed by a system in the automatic mode, everyone is followed by coordinates of GLONASS and the short video by the driver at the time of the incident.

Thus, the operator of the portal has an opportunity to obtain information on each incident by transport enterprises, cars and drivers. The interactive map shows movement of cars in real time.

Pilot's results

During the "pilot" project more than 200 incidents, including identification passing/not passing, derivation from the road, a dream, smoking, a conversation by the mobile phone, speeding were recorded.

Example of an incident "Decrease in attention" in the interface of the portal:

Example of an incident Smoking in the interface of the portal:

We faced at once a number of effects which complicated correct work of a complex. It was necessary "to fight" against flares on glasses of buses which were defined as the driver's person. In some situations hand-rail were interpreted as a cigarette. We more than ten times "retrained" neuronets, made radical changes to the software on the party of the vehicle, in portal and server components of a system — the project manager, the chief executive SkyTrack Maria Filisteeva told.

Work of STTS allowed to make unexpected, but pleasant opening: almost all incidents connected with violation by drivers of rules of conduct driving whether it be smoking or phone conversation, were fixed by a system only at the moments of a stop of vehicles.

As a result the "pilot" project key technology hypotheses, first of all, of a possibility of fixing of behavioural parameters of the driver using means of the video analysis and neuronets were proved. Also system operation in real time with data transmission for hundreds of kilometers with a delay was convincingly shown no more than 2 seconds.

As concluded in SkyTrack, project deliverables in Veliky Novgorod with evidence confirm advantage of application and need of implementation of the similar systems based on artificial intelligence technologies and geopositioning that will allow to reduce significantly risks of road accident with participation of public and cargo transport and also risks of the terrorist threats connected with use of large-size vehicles (buses, trucks).

Plans for development of the project

The decision on further implementation of similar complexes in federal scale is connected with need of change of the legislation, conducting additional examinations, consultations with profile departments and car makers. The project in Veliky Novgorod became one of the first steps in this direction, showed the effectiveness in terms of approbation of innovations in the field of transport security. After final summing up the project we are going to keep further development of the project in the region together with ASI and consortium of developer companies — Nikolay Kurmyshev, the deputy manager of Administration of the Governor of the Novgorod region – the head of department of Administration of the Governor of the Novgorod region on development of digital economy and information and communication technologies told about plans for the future.

The immediate task of the project is implementation of completions from all three participating companies for the purpose of creation of the integrated system integrating advantages of everyone.

SkyTrack started design key components of a complex are the device integrating the high-performance minicomputer and the modem in the protected execution. Production is going to begin within the coming 3 months.

Its integration with GAIS ERA-GLONASS within partnership with JSC GLONASS is also considered by one of the directions of development of a system.

As for STTS, Ilya Gotsenko said the following:

SkyTrack is waited by a lot of work on expansion of functionality of a system for increase in safety of movement of citizens. This initiative changed our ideas of opportunities of digital technologies in solving of tasks of transport security. We make experiments with the video camera turned from a cabin of the vehicle on the road, for fixing of abuses of regulations of a marking and other violations. Learned to obtain data from the diagnostic system of the car. There are some more disruptive ideas. Perhaps, all this work in the future will result us in partnership with car makers in projects of creation of pilotless vehicles. Who knows?.