ADAS, Advanced Driver Assistance System

How computer vision systems affect security

Undoubtedly, one of the most significant breakthroughs related to computer vision and AI has occurred in the field of video surveillance, which is an important part of physical security. Intelligent video surveillance, video analytics, biometrics have already largely surpassed the capabilities of even a professionally trained person. The computer does not lose vigilance, does not tire and is not distracted - the human factor does not affect its work. Security and video surveillance systems equipped with computer vision algorithms allow monitoring the situation inside and outside the premises, inspecting various objects, recognizing and comparing people's faces, conducting situational monitoring of the situation in public places and at transport hubs.

Main article: How computer vision systems affect security

What is ADAS

ADAS is a machine vision-based driver assistance system. The purpose of the ADAS system is to improve traffic safety by informing the driver and attracting his attention. At a minimum, this is a warning by the driver's sound or vibration signal about a likely or emerging risk that requires attention. How much - emergency independent decision-making^[1] system^[2]

ADAS are distinguished in five levels: from zero (only the driver participates in the control) to fifth (fully autonomous control), that is, a self-driving car is an extreme case of ADAS. In Russia, at the moment, due to the lack of regulatory laws, the development of any ADAS systems with a class above the third, implying automatic decision-making, is difficult. This is primarily due to the uncertainty of the "legal" status of cars with a high degree of autonomy.

Electronic rescue cards in cars

Main article: Electronic rescue cards in cars

2025: NAMI launches production of electronic assistants for cars

At the end of May 2025, it became known that the production of electronic assistants for cars was organized at the NAMI Innovative Components site (a subsidiary of FSUE NAMI) in the Samara Region. We are talking about means of ensuring security and improving manageability. Read more here.

2022:V Russia allowed the production of cars without electronic systems and airbags and part of the ERA-GLONASS functions

In May 2022, Prime Minister Mikhail Mishustin signed a decree that allows automakers to abandon the use of some electronic systems in their cars. In particular, it will be possible not to install an anti-lock system (ABS), an electronic stabilization system (ESP) and some components of the ERA-GLONASS emergency warning system.

If earlier the alert should have been triggered automatically, then manual pressing is now permissible. At the same time, until August 1, 2022, ERA-GLONASS can not be installed at all, and new cars released from August 1, 2022, the car plant is obliged to equip ERA-GLONASS at its own expense until February 1, 2023.

Russia allowed the production of cars without electronic systems and airbags and part of the ERA-GLONASS functions

In addition, automakers will be able to produce vehicles without airbags and seat belt pretensioners. Also, all environmental standards are now in effect, from Euro-0 to Euro-5, which allows the production of cars with exhaust that meet 1988 standards. The new rules do not prohibit manufacturers from producing cars of the current Euro-5 standard, but will allow them to abandon a number of sensors and control units in the fuel injection system.

Also, the noise level requirements approved by Mishustin have been reduced, some types of tests, such as side crash tests, are excluded from the list of mandatory tests.

The resolution is temporary and permissive. The validity period of the published technical regulations is set until February 1, 2023.

As Kommersant notes, the decree of the Government of the Russian Federation makes it possible for automakers to produce new cars, abandoning a number of systems that are inaccessible due to anti-Russian sanctions or due to a shortage of semiconductors. AvtoVAZ, even before the entry into force of this document, began to assemble cars without some electronic components amid their shortage.^[3]

2020

Ministry of Transport ordered bus drivers to use anti-sleep bracelets

From 2021, drivers of urban passenger transport, which seats more than eight people, will begin to use sleep prevention tools at the wheel. This became known on November 16, 2020.

As Vedomosti writes with reference to the press service of the Ministry of Transport, three devices are being developed for bus drivers that can be used both together and separately:

• "Anti-axle bracelet" on the arm, working with the use of electromyography methods (nerve conduction study);
• Non-invasive neurointerface reading brain activity;
• An artificial camera with intelligence that monitors the condition of the driver.

Ministry of Transport ordered bus drivers to use anti-sleep bracelets

According to statistics from the Ministry of Transport, one of the most common causes of road accidents is precisely that the driver falls asleep at the wheel. Such accidents account for about 20% of all accidents. To prevent such accidents, devices have been developed that monitor the condition of the driver. For example, there are headphones that record the tilt of the driver's head - they emit a sound signal when the driver nods characteristically, as well as cameras that monitor the blink frequency and movement of the eyeballs, by which you can identify the falling asleep driver.

By mid-November 2020, the Ministry of Transport is completing the development of a national standard establishing requirements for sleep prevention systems at the wheel. The definition of classification, purpose, composition and characteristics of photo and video recording tools is planned no later than the first quarter of 2021, the Ministry of Industry and Trade told the publication. Expert support in the development of the standard will be provided by the Russian Venture Company (RVC), said Elena Bizyukova, head of public relations at RVC.

Headphones that register the tilt of the driver's head - they emit a sound signal when the driver nods characteristically, as well as cameras that monitor the blink frequency and movement of the eyeballs, by which you can identify the falling asleep driver. ^[4]

The organization, the main organization in Europe in crash tests, assessed autopilots

In early October 2020, the European Committee for Independent Crash Tests of Cars (Euro NCAP) published the results of tests of cars that are equipped with driver assistance systems. We are talking about assessing the operation of the Highway Assist system. Read more here.

Announcement of an automatic parking system from Bosch and Ford

At the end of August 2020, Ford announced cooperation with Bosch, in which companies created automatic technology car parking. The system allows the car to be free maneuver and park inside the parking structure without participation driver. Read more here.

Cars in Russia will be equipped with warning sensors about traffic violations

In early March 2020, Rosstandart announced that cars manufactured in Russia will be equipped with driver warning sensors about a potential violation of traffic rules (SDA).

Vehicles will receive a system capable of recognizing signs, markings and traffic light signals using special cameras. The data obtained will be analyzed by a computer, which will then transmit the information to the driver on the screen or by an audio message.

Rosstandart announced that cars manufactured in Russia will be equipped with driver warning sensors about a potential violation of traffic rules (SDA)

It is expected that the system will recognize signs and traffic lights at a distance of 30 to 100 m and will be able to work at a car speed of up to 150 km/h.

Izvestia writes that these systems can be installed on cars, buses and trolleybuses (category M transport) and trucks (N). In addition, the sensors can be used on vehicles with autopilot.

Developers are advised to provide several levels of warning - depending on how much the driver's actions threaten traffic safety. So, in case of gross traffic violations (for example, violation of the rules of the intersection), the driver will be notified of this both visually and using audio messages and tactile effects - by vibration of the steering wheel or seat.

According to Kirill Zhanaidarov, head of the Skolkovo transport infrastructure project, the creation of devices that allow recognizing traffic lights, road signs and markings is easy to implement from a technical point of view.

At the same time, the expert believes that solving the problem of interaction between the machine and the environment will not work without investments in the infrastructure itself and the development of V2X technology (data exchange between the car and road objects). The fact is that in difficult weather conditions, the effectiveness of the systems proposed in GOST decreases sharply. And erroneous notifications will only increase the risk of an accident, Kirill Zhanaidarov explained to the publication.^[5]

2019

Drivers of cars with ADAS distract from the road 80% more often than when manually driving

On December 25, 2019, it became known that people with more experience driving cars with an advanced driver assistance system (or) are ADAS more often distracted while driving than those who have just started using it. Association researchers The American automobile (AAA) found out this: for almost two years, they studied how 150 volunteers drive. The article, as well as a brief note, are published on the AAA website.

As reported, so far unmanned vehicles are at the testing stage, but many driver assistance functions are in production cars as early as December 2019. For example, often advanced driver assistance systems (ADAS) include adaptive cruise control, in which the car independently keeps a given distance to the car in front of it, as well as a lane-keeping function. These systems were created in order to improve road safety, but there is no consensus on the advisability of their use before the creation of full-fledged unmanned vehicles that are fully responsible for driving.

On the one hand, ADAS serves as something of an extra pair of eyes: it should improve the overall safety of travel. This point of view is confirmed, for example, by statistics on the use of the Autopilot system in Tesla cars: after installing it, the frequency of emergency operation of airbags decreases by an average of 40 percent. On the other hand, if a driver drives for a long time with a system that insures him and sees with real examples that it works well enough, he can get used to it and begin to be distracted by extraneous matters more often than when driving without ADAS.

Researchers at AAA decided to test this hypothesis on real-world data from American roads obtained from the Virginia Connected Corridors (VCC) and Mixed Function Automation (MFA) studies. From data the VCC, 30 car owners with ADAS were taken, assembled from November 2016 to June 2018. Data was taken from the MFA for 120 drivers who were provided with ADAS vehicles for four weeks.

Cameras were installed in all cars, as well as sensors for collecting acceleration data and maneuvers. In addition, the data noted the ADAS state - simultaneously included lane control and adaptive cruise control.

The researchers found that drivers from the VCC sample using a car with ADAS were 80 percent more likely to be distracted by extraneous tasks while the system was running than when the car was fully manual. At the same time, among drivers from the MFA sample using a car with ADAS for not so long, such a trend was not observed. In the interaction of drivers with ADAS, thus, different stages can be distinguished: in the first weeks, drivers, for example, get used to a partially autonomous car.

All production cars equipped with ADAS require the driver to keep an eye on the road at all times, and automakers track the driver's attention in many ways. For example, Tesla Autopilot takes into account pushing the steering wheel that you can deceive with a suspended bag with trifles, while in Cadillac Super Cruise and Nissan ProPilot 2.0 attention is tracked directly in the direction of view using cameras.

The addiction to well-performing autopilot has led many self-driving car developers, such as Waymo and Ford, to skip the third level of autonomy and develop fully autonomous fourth and fifth level drones at once. This leads to the fact that during the tests, some engineers, obliged to monitor the road, are distracted or completely fall asleep, and in some cases even a second engineer does not help: sometimes both fall asleep.^[6]

Bosch Analytics

Parking assistance systems, lane tracking and preventing the driver from falling asleep while driving are only part of the functionality that buyers of new cars no longer want to do without. The popularity of equipping cars with driver assistance systems is steadily growing. "More and more buyers want a car that foresees further movement itself and helps with maneuvering," says Dr. Dirk Hoeisel, a Bosch board member. It is noteworthy that most often cars of the non-premium segment are equipped with smart parking as standard. The championship here is occupied by compact cars and middle-class models. This is evidenced by the data analyzed by Bosch on the registrations of new passenger cars. Whether we are talking about parking, parking assistant or rear-view camera, 55% of the recently registered compact and medium-sized cars in Germany are equipped with at least one of these systems as standard. At the same time, for premium cars, this figure is only about 25%. In general, 45% of new cars of all classes are equipped with some kind of parking assistant as standard.

An analysis of the results of a study conducted in Germany shows that parking assistance systems top the list of desired functionality. They are followed by automatic emergency braking systems, which help prevent an accident or mitigate its consequences, if it is inevitable. "Driver assistance systems aren't just great devices that make driving more convenient. They can save a life, "says Hoeisel. For this reason, the European Union is preparing legislation prescribing the mandatory equipping of cars with emergency braking systems. It is expected that thanks to this initiative, all new vehicle models will have to be equipped with an automatic braking system without fail, starting in 2022. The World Forum for Harmonizing Vehicle Regulations, which is part of the UN Economic Commission for Europe, has developed framework rules to implement the initiative. The forum recommends selling only passenger cars with an emergency braking system in the future in the EU and other countries. The UNECE estimates that emergency braking assistants can save thousands of lives a year in the EU.

Of all new cars registered in Germany in 2017, 54% were fitted with an emergency braking system, up from 38% in 2016. An assessment of statistics on new registered cars in 2017 also showed that in addition to parking and braking assistance systems, two more systems are gaining popularity: preventing the driver from falling asleep at the wheel and tracking the lane. Nearly half of all new cars can recognize driver fatigue, and more than one in three cars has at least one lane tracking system. In addition, just under a quarter of cars are equipped with adaptive cruise control (ACC), and 9% of newly registered cars in Germany already have a partially automated traffic control system in traffic jams. This helps drivers relax when caught in a jam by simply activating automatic following of the car in front. Such a system also controls the start and stop of the engine, acceleration and braking, movement within the lane.

It's not just in Germany that car buyers are increasingly relying on electronic assistants to make driving safer and more convenient. Parking assistants and automatic emergency braking systems are increasingly used in other European countries. For example, parking assistants are especially popular in France: 85% of cars are equipped with them - this is the highest figure for such systems. Italy completes the list with 44%. As for automatic emergency braking systems, in Belgium and Germany their share is 54%, and in the Netherlands 45% of new cars are equipped with such a system. At the same time, the share of cars equipped with this system in Italy is 30%, and in Russia - only 6%.

Driver assistance systems monitor complex situations and help avoid accidents or even save lives. That's why Bosch continues to develop an ever-expanding range of systems that improve road safety and make life easier for drivers. And as part of the continuous improvement of electronic assistants, Bosch also creates a technical base for automated driving in the future. With this experience, the company is already one of the leaders of innovation in many areas that are necessary for automated driving: radar systems, artificial intelligence, electronic control of brakes, transmission and steering.

Bosch analyzed 2017 vehicle registration statistics

Germany's Federal Motor Transport Administration (KBA) said 3.44 million new cars were registered in the country in 2017. Working with data provided by analytics firm JATO Dynamics, Bosch verified which driver assistance systems are introduced in new cars in Germany, France, Spain, the UK, Italy, Belgium, the Netherlands and Russia. Bosch has been conducting research into the use of driver assistance systems since 2013.

Japan and EU make automatic braking system mandatory for new cars

In mid-February 2019, 40 countries, including Japan European ones, states agreed to adopt a developed UN technical regulation on the use of automatic braking systems for cars. From 2020, such electronic assistants will begin to be equipped with more and more new passenger cars and small commercial vehicles.

We are talking about a system that, while the vehicle is moving, controls the situation around it and stops the car if there is a risk of an accident. In particular, the technology takes emergency braking in case of danger of hitting a pedestrian, colliding with another car or some object on the road. Timely response is achieved through sensors and cameras, as well as a control unit in which data processing is carried out.

40 стран, включая European Union Japan, agreed to make automatic braking systems mandatory for new passenger cars and low-tonnage trucks and pickup trucks

The system of automatic deceleration and complete stop of the car will operate at speeds up to 60 km/h and must be installed on all new cars sold in countries that have approved UN technical regulations. Owners of previously purchased cars will not have to equip their transport with this assistant.

First, the innovation will come into force in Japan (in 2018, 4 million cars were sold there) - this will happen in 2020. In the European Union, where in 2018 sales of new vehicles exceeded 15 million units, the requirement will begin to operate in 2022. China and the United States did not sign this regulation by February 2019.

According to the UN Economic Commission for Europe (ECE), the countries that supported the initiative with the auto braking system confirmed their intentions to reduce the number of accidents. More than 9,500 people died on EU roads in 2016. The European Commission believes that the emergency braking system will be able to save more than 1,000 lives annually.^[7]

2018: Parking assistance system and emergency auto-braking system at peak of popularity

"There is a clear trend: in the near future it will be as natural to have a car with electronic assistants as with a radio and ESP," Bosch board member Dr. Dirk Hoeisel commented in the spring of 2018, referring to the results of Bosch analytics based on data on registration of new cars in 2016. Parking assistance, lane tracking and emergency braking systems are becoming increasingly popular, according to statistics. Parking assistance systems - from simple sensors to a fully automatic assistant - are included in the equipment of 62 percent of new cars registered in Germany in 2016. The second most popular is emergency braking systems, which warn the driver about the danger of a collision and automatically reduce the speed up to a complete stop. So, every third new car registered in 2016 (38%) was equipped with an automatic braking system. At the same time, it is included in the list of standard equipment of more than a quarter of these cars. In third place in the rating is the control of the driver's condition. This device was included in the equipment of 37 percent of new passenger cars registered in 2016. And the popularity of lane tracking systems is growing most intensively. The number of new registered cars equipped with this system doubled in 2016 compared to the previous year. Another interesting surge in growth has to do with adaptive cruise control (ACC). In 2013, cars equipped with this system barely gained 4 percent of all newly registered in Germany, and in 2016 adaptive cruise control appeared in almost one in five cars (19%).

Driver assistance systems are increasingly part of standard equipment

Parking assistance, emergency braking and lane tracking systems are among the most popular electronic assistants in Germany, the United States, the Netherlands, Belgium and France. Parking assistants are even more popular in France than in Germany, with 67 percent of new passenger cars registered in that country in 2016 equipped with such a system. At the same time, in most cases - in 63 percent of new cars registered in France - it is included in the standard equipment. In Belgium and the Netherlands, 39 percent of new cars are equipped with an automatic emergency braking system: this is the highest percentage in Europe. The Bosch analytical study for the first time included Italy and Russia. In these countries, the popularity of driver assistance systems is relatively small compared to others. Nevertheless, 18 percent of new passenger cars registered in Italy in 2016 are equipped with driver assistance systems. In Russia, the share of such cars so far is only 6 percent. Cars equipped with an emergency braking system accounted for the same 6 percent.

Bosch is growing faster than the driver assistance systems market

Electronic systems help drivers in difficult and critical road situations. These assistants are an important step towards the accident-free and stress-free mobility of the future. If all cars in Germany were fitted with an automatic emergency braking system, it would prevent up to 72 per cent of rear-end collisions. The number of cars equipped with an emergency braking system is constantly growing. For Bosch, one of the largest suppliers of components, this means a growing market. "The market has already grown about 20 percent over the past time, but Bosch is growing even faster," says Gerhard Steiger, president of Bosch Chassis Systems Control. In 2019, the company's sales towards driver assistance systems will exceed the mark of two billion euros. The previous mark - one billion euros - was passed in 2016. Currently, technological progress is on its way to autonomous driving. The results of Bosch's analytical studies indicate that the first partially automated driving function, a traffic assistant in a traffic jam, is already on the market. The action of this electronic assistant allows you to automatically repeat the movement of the car following in front. The system independently drives the car, accelerates and stops it, and also maneuvers within the lane. Traffic Assistant is included in the list of equipment of approximately half of new cars registered in Germany and equipped with an adaptive cruise control system. In total, the number of such cars is 9 percent of all cars that have passed state registration for the first time.

Bosch analytics based on 2016 new passenger car registration statistics

In 2016, 3.4 million new cars were registered in Germany. Based on statistics on registration of new vehicles collected by the German Federal Automobile Transport Administration (KBA) for 2016, as well as data (for 22.03.2017) provided by business experts IHS Markit, Bosch specialists analyzed all segments of the passenger car market. The results of the analysis demonstrate the equipment of serial models with driver assistance systems - as standard or additional equipment. The study also shows which of the systems are currently available on the market. Bosch has been conducting e-assistant market analytics since 2013.

2014-2016

Bosch estimates that one in five of the roughly three million passenger cars registered in Germany in 2014 were equipped with such systems. At the same time, in 2013, assistance systems were installed only in every tenth new car.

Only in Germany could it be possible to prevent up to 72% of accidents related to a collision with a car from behind and in which people were injured if all cars were equipped with an automatic emergency braking system. As a result of studies of emergency situations, Bosch revealed that the traffic support system in the selected lane can prevent up to 28% of accidents in which people were injured due to the fault of drivers who accidentally left their lane. ^[8]

Technical requirements for most modern cars

The increased safety provided by driver assistance systems is one of the reasons for their growing popularity. In particular, the automatic emergency braking system is evaluated in the ratings of the European program for assessing the safety of new cars Euro NCAP. As of 2016, new vehicles must be equipped with a pedestrian avoidance system if the automaker is to achieve the highest rating of 5 stars. Due to changes in test standards and due to constant cost reduction, more modern cars are equipped with sensors that monitor the parameters of the surrounding space. Bosch's sales figures are also affected by this trend, with sales of radar systems and video sensors doubling in 2015.

One sensor assists multiple driver assistance systems

Bosch is a participant in the 77 GHz radar market. In 2016, the production of a 10 millionth sensor of the radar system is expected. The development of MRR - a mid-range radar - allowed Bosch to make the technology more accessible to the market. For example, such a radar is used in the VW Polo and Golf models, which indicates its availability even for the small and compact car segment. A single sensor can support multiple driver assistance systems. In addition to the emergency braking system, the MRR sensor works for adaptive cruise control (ACC). The ACC automatically supports the driver's chosen speed and programmed safe distance to the vehicle in front. In combination with the collision prevention system, ACC can reduce the number of emergency braking on highways by up to 67%. In 2014, 8% of new cars were equipped with ACC, which is twice as much as Bosch data a year earlier.

Every fourth new passenger car knows how to determine when the driver is tired

The number of new cars equipped with a road sign recognition system, as well as a driver's sleepiness recognition system is growing - both indicators increased by 2% compared to 2013. So, six percent of all cars registered in 2014 can recognize certain road signs on the road using a video camera. Next, the information is displayed in the form of symbols on the dashboard, which helps drivers understand the difficulties of navigating road signs. In 2014, a system that determines the degree of driver fatigue was installed in one in four new cars. With the help of the steering wheel angle sensor and electric power steering, the Bosch system analyzes the driver's behavior to identify the first signs of sleepiness. The system immediately registers abrupt steering maneuvers and, taking into account additional parameters such as the duration of the trip and the time of day, determines the degree of sleepiness. Before the driver can sleep, warns him to stop for rest.

Parking assistance systems are the most common in new cars

The headlight control system automatically turns on the high beam headlights when moving outside settlements, until some vehicle is found in front or in the oncoming lane. She also constantly controls the operation of the front headlights. Systems that only regulate low light were not included in the latest study, causing the number of vehicles with built-in headlight control systems to decrease. In 2014, the system was introduced in only 13% of new registered cars. Bosch first included a parking assistance system in the research. It uses ultrasonic sensors that give sound signals that inform the driver about the distance between the vehicle and parking obstacles, as well as rear-view cameras and parking assistants. These assistants control steering when parking, while the driver is only responsible for acceleration and braking. In 2014, more than half of newly registered cars (52%) in Germany were equipped with parking assistance systems, showing the greatest popularity of these systems in new cars, according to a Bosch study.

Different countries with the same preference in driver assistance systems

Parking assistance systems are very popular outside Germany as well. In 2014, one in two new cars (50%) in Belgium, the Netherlands, as well as 19% of new passenger cars in the UK were equipped with such systems. Automatic emergency braking systems are even more popular in Belgium than in Germany, with one in four newly registered cars supporting a braking system when an obstacle is detected. In the Netherlands, 17% of new cars are provided with such a system, in Spain - 11%, in the UK ‒ 5%. 14% of cars in Belgium, 11% of ‒ in the Netherlands, 20% of ‒ in Spain, 6% of ‒ in England were equipped with a system to support traffic in the selected lane in 2014.

Notes