Driver Assistance and Safety Systems ADAS, Advanced Driver Assistance System

How computer vision systems affect security

Undoubtedly, one of the most significant breakthroughs related to computer vision and AI occurred in the field of video surveillance, which is an important part of physical security. Intelligent video surveillance, video analytics, biometrics have already largely exceeded the capabilities of even a professionally trained person. The computer does not lose vigilance, does not tire and is not distracted - the human factor does not affect its work. Security and video surveillance systems equipped with computer vision algorithms allow you to monitor the situation inside and outside the premises, inspect various objects, recognize and compare the faces of people, carry out situational monitoring of the situation in public places and at transport hubs.

Main article: How computer vision systems affect security

What is ADAS

ADAS is a machine vision based driver assistance system. The goal of the ADAS system is to improve traffic safety by informing the driver and attracting his attention. At a minimum, this is a warning by the driver's sound or vibration signal about a likely or emerging risk that requires attention. As a maximum - emergency independent decision-making by^[1]

ADAS is distinguished by five levels: from zero (only the driver participates in the control) to the fifth (fully autonomous control), that is, an unmanned vehicle is an extreme case of ADAS. In Russia, at the moment, due to the lack of regulatory laws, the development of any ADAS systems above the third class, implying automatic decision-making, is difficult. This is primarily due to the uncertainty of the "legal" status of cars with a high degree of autonomy.

Electronic rescue cards in cars

Main article: Electronic rescue cards in cars

2022: Russia allowed the production of cars without electronic systems and airbags and part of ERA-GLONASS functions

In May 2022, Prime Minister Mikhail Mishustin signed a decree that allows automakers to refuse to use some electronic systems in their cars. In particular, it will be possible not to install an anti-lock system (ABS), an electronic stabilization system (ESP) and some components of the ERA-GLONASS emergency warning system.

If earlier the alert should have been triggered automatically, now manual pressing is allowed. At the same time, until August 1, 2022, ERA-GLONASS can not be installed at all, and new cars released from August 1, 2022, the car plant must equip ERA-GLONASS at its own expense until February 1, 2023.

In Russia, they allowed the production of cars without electronic systems and airbags and part of the ERA-GLONASS functions

In addition, automakers will be able to produce vehicles without airbags and pre-tensioners of seat belts. Also, all environmental standards are now in force, from Euro-0 to Euro-5, which allows you to produce cars with exhaust that meet 1988 standards. The new rules do not prohibit manufacturers from producing machines of the current Euro-5 standard, but will allow them to abandon a number of sensors and control units in the fuel injection system.

Also, the document approved by Mishustin reduced the requirements for noise levels, some types of tests, such as side crash tests, were excluded from the list of mandatory ones.

The order is temporary and permissive. The term of the published technical regulation is set until February 1, 2023.

According to Kommersant, the decree of the Government of the Russian Federation makes it possible for automakers to produce new cars, abandoning a number of systems that are inaccessible due to anti-Russian sanctions or due to a shortage of semiconductors. AvtoVAZ, even before the entry into force of this document, began to assemble machines without some electronic components amid their lack.^[2]

2020

Ministry of Transport obliged bus drivers to use bracelets against sleep

Since 2021, drivers of urban passenger transport, which seats more than eight people, will begin to use sleep prevention tools behind the wheel. This became known on November 16, 2020.

As they write Sheets"" with reference to the press service, Ministry of Transport three devices are being developed for bus drivers, which can be used both together and separately:

• A "nason bracelet" on the arm, working using electromyography methods (nerve conduction study);
• Non-invasive neurointerface reading brain activity;
• A camera with artificial intelligence that controls the condition of the driver.

Ministry of Transport obliged bus drivers to use bracelets against sleep

According to statistics from the Ministry of Transport, one of the most frequent causes of an accident is precisely that the driver falls asleep at the wheel. Such accidents account for about 20% of all accidents. To prevent such accidents, devices have been developed that monitor the condition of the driver. For example, there are headphones that record the tilt of the driver's head - they emit a sound signal when the driver is characteristically "nodding," as well as cameras that monitor the frequency of blinking and the movement of eyeballs, from which you can identify the falling asleep driver.

By mid-November 2020, the Ministry of Transport is completing the development of a national standard establishing requirements for sleep warning systems while driving. The definition of the classification, purpose, composition and characteristics of photo and video recording facilities is planned no later than the first quarter of 2021, the Ministry of Industry and Trade added. Expert support in the development of the standard will be provided by the Russian Venture Company (RVC), said Elena Bizyukova, head of the public relations service of the RVC.

Headphones that record the tilt of the driver's head - they emit a sound signal when the driver is characteristically "nodding," as well as cameras that monitor the frequency of blinking and the movement of eyeballs, from which you can identify the falling asleep driver. ^[3]

Home in Europe according to crash tests, the organization rated autopilots

In early October 2020, the European Committee for Independent Crash Tests of Cars (Euro NCAP) published the results of tests of cars that are equipped with driver assistance systems. We are talking about evaluating the performance of the Highway Assist system. More details here.

Announcement of automatic parking system from Bosch and Ford

At the end of August 2020, Ford announced a collaboration with Bosch, in which companies created automatic technology car parking. The system allows the car to be free maneuver and park inside the parking structure without participation driver. More details here.

Cars in Russia will be equipped with warning sensors for traffic violations

In early March 2020, Rosstandart announced that cars produced in Russia will be equipped with driver warning sensors about a potential violation of traffic rules (SDA).

Vehicles will receive a system that can recognize signs, markings and traffic lights using special cameras. The obtained data will analyze the computer, which will then transmit the information to the driver on the screen or with an audio message.

Rosstandart reported that cars produced in Russia will be equipped with driver warning sensors about a potential violation of traffic rules (SDA)

It is expected that the system will recognize signs and traffic lights at a distance of 30 to 100 m and will be able to operate at a car speed of up to 150 km/h.

Izvestia writes that these systems can be installed on cars, buses and trolleybuses (transport of categories M) and trucks (N). In addition, sensors can be used on vehicles with an autopilot.

Developers are advised to provide several levels of warning - depending on how much the driver's actions threaten traffic safety. So, in the case of gross violations of traffic rules (for example, violation of the rules of passage of the intersection), the driver will be notified about this both visually and with the help of audio messages and tactile action - by the vibration of the steering wheel or seat.

According to Kirill Zhanaidarov, head of the Skolkovo transport infrastructure project, the creation of devices that allow you to recognize traffic lights, road signs and markings is easy to implement from a technical point of view.

At the same time, the expert believes that it will not be possible to solve the problem of interaction between the machine and the environment without investing in the infrastructure itself and the development of V2X technology (data exchange between the car and road objects). The fact is that in difficult weather conditions, the effectiveness of the systems proposed in GOST is sharply reduced. And erroneous notices will only increase the risk of an accident, Kirill Zhanaidarov explained to the publication.^[4]

2019

Drivers of cars with ADAS are distracted from the road 80% more often than with manual control

On December 25, 2019, it became known that people with more experience driving cars with an advanced driver assistance system (Advanced Driver Assistance System, or) ADAS are more often distracted while driving than those who have just begun to use it. This was found out by The American automobile association researchers (AAA): for almost two years they studied how 150 volunteers drive. The article, as well as a brief note, are published on the AAA website.

As reported, so far unmanned vehicles are at the testing stage, but many functions of helping the driver are in production cars as early as December 2019. For example, often advanced driver assistance systems (ADAS) include adaptive cruise control, in which the car independently keeps a given distance to the car in front of it, as well as a lane retention function. These systems were designed to improve road safety, but there is no consensus on the advisability of using them before the creation of full-fledged unmanned vehicles fully responsible for driving.

On the one hand, ADAS serves as something like an additional pair of eyes: it should improve the overall safety of travel. This point of view is confirmed, for example, by statistics on the use of the Autopilot system in Tesla cars: after its installation, the frequency of emergency airbags decreases by an average of 40 percent. On the other hand, if the driver drives with his insurance system for a long time and sees on real examples that it works quite well, he can get used to it and begin to be distracted by extraneous matters more often than when driving without ADAS.

Researchers from the AAA decided to test this hypothesis on real data from American roads obtained as part of the Virginia Connected Corridors (VCC) and Mixed Function Automation (MFA) studies. From VCC, data were taken on 30 car owners with ADAS, collected from November 2016 to June 2018. From the MFA, data were taken on 120 drivers who were provided with cars with ADAS for four weeks.

Cameras were installed in all cars, as well as sensors for collecting acceleration and maneuver data. In addition, the ADAS state was noted in the data - both lane control and adaptive cruise control.

The researchers found that drivers from a sample of VCC using a car with ADAS were 80 percent more likely to be distracted by extraneous tasks during system operation than by fully manual control of the car. At the same time, among drivers from a sample of MFA using a car with ADAS not so long, such a trend was not observed. In the interaction of drivers with ADAS, thus, different stages can be distinguished: in the first weeks, drivers, for example, get used to a partially autonomous car.

All production cars equipped with ADAS require the driver to constantly monitor the road, and automakers track the driver's attention in various ways. For example, Tesla Autopilot takes into account pressing the steering wheel, which can be tricked by a suspended bag with trifles, while in Cadillac Super Cruise and Nissan ProPilot 2.0 attention is tracked directly in the direction of view using cameras.

Getting used to a well-functioning autopilot has forced many unmanned vehicle developers, such as Waymo and Ford, to skip the third level of autonomy and develop completely autonomous drones of the fourth and fifth levels at once. This leads to the fact that during the tests some engineers who are obliged to monitor the road are distracted or completely fall asleep, and in some cases even the second engineer does not help: sometimes both fall asleep.^[5]

Bosch Analytics

Parking assistance systems, lane tracking and warning of driver falling asleep at the wheel are only part of the functionality that buyers of new cars no longer want to do without. The popularity of equipping cars with driver assistance systems is steadily growing. "More and more buyers want a car that itself anticipates further movement and helps maneuver," says Dr. Dirk Hoisel, a member of Bosch's board of directors. It is noteworthy that most often cars not at all premium segments are equipped with smart parking as a standard configuration. The championship here is occupied by compact cars and middle-class models. This is evidenced by data analyzed by Bosch on the registration of new cars. Whether we are talking about parking, parking assistant or rear-view camera, 55% of compact and medium-sized cars recently registered in Germany are equipped with at least one of these systems in the standard configuration. At the same time, for premium cars, this figure is only about 25%. In total, 45% of new cars of all classes are equipped with some kind of parking assistant in the standard configuration.

Of all new cars registered in Germany in 2017, 54% were equipped with an emergency braking system, compared with 38% in 2016. An assessment of statistics on new registered cars in 2017 also showed that in addition to parking and braking assistance systems, two more systems are gaining popularity: preventing the driver from falling asleep at the wheel and tracking the lane. Almost half of all new cars can recognize driver fatigue, and more than one in three cars has at least one lane tracking system. In addition, just under a quarter of cars are equipped with adaptive cruise control (ACC), and 9% of recently registered cars in Germany already have a partially automated traffic control system in traffic jams. This helps drivers relax when getting into a congestion, simply by activating automatic following the car in front. Such a system also controls the starting and stopping of the engine, acceleration and braking, movement within the strip.

Not only Germany are car buyers increasingly relying on electronic assistants to make driving safer and more convenient. Parking assistants and automatic emergency braking systems are increasingly used in other European countries. For example, parking assistants are especially popular in: France 85% of cars are equipped with them - this is the highest indicator for such systems. Ends the list Italy with 44%. In the case of automatic emergency braking systems Belgium , 54 per cent are in Germany Netherlands and 45 per cent of new vehicles are equipped. At the same time, the share of cars equipped with this system Italy in is 30%, and in - Russia only 6%.

Driver assistance systems monitor complex situations and help avoid accidents or even save lives. This is why Bosch continues to develop an ever-expanding range of systems that improve road safety and make life easier for drivers. And as part of the continuous improvement of electronic assistants, Bosch also creates a technical base for automated driving in the future. With this experience, the company is now one of the leaders in innovation in many areas that are necessary for automated driving: radar systems, artificial intelligence, electronic brake control, transmission and steering.

Bosch analyzed vehicle registration statistics for 2017

The German Federal Road Transport Administration (KBA) reported that in 2017, 3.44 million new cars were registered in the country. Working with data provided by the analytical company JATO Dynamics, Bosch checked what driver assistance systems are presented in new cars in Germany, France, Spain, Great Britain, Italy, Belgium, the Netherlands and Russia. Bosch has been conducting research on the use of driver assistance systems since 2013.

Japan and EU make automatic braking system mandatory for new cars

In mid-February 2019, 40 countries, including Japan and European states, agreed to adopt the UN technical regulation on the use of automatic braking systems for cars. From 2020, all new cars and small commercial vehicles will begin to be equipped with such electronic assistants.

We are talking about a system that during the movement of a vehicle controls the situation around it and stops the car if there is a risk of an accident. In particular, the technology takes emergency braking in case of danger of hitting a pedestrian, colliding with another car or some object on the road. Timely response is achieved through sensors and cameras, as well as a control unit in which data is processed.

40 стран, включая European Union Japan, agreed to make automatic braking systems mandatory for new cars and light-duty trucks and pickups

The automatic deceleration and full stop system will operate at speeds up to 60 km/h and should be installed on all new cars sold in countries that have approved the UN technical regulation. Owners of previously bought cars will not have to equip their transport with this assistant.

First, the innovation will come into force in Japan (2018 million cars were sold there in 4) - this will happen in 2020. In the European Union, where in 2018 sales of new vehicles exceeded 15 million units, the requirement will begin to operate in 2022. China and the United States did not sign this regulation by February 2019.

According to the UN Economic Commission for Europe (UNECE), countries that supported the initiative with an auto-braking system have confirmed their intentions to reduce the number of accidents. In 2016, more than 9,500 people died on EU roads. The European Commission believes that the emergency braking system will be able to save more than 1 thousand lives annually.^[6]

2018: Parking assistance system and emergency braking system at the peak of popularity

"There is a clear trend: in the near future, having a car with electronic assistants will be as natural as with a radio receiver and ESP," commented Bosch board member Dr. Dirk Hoisel in the spring of 2018, referring to the results of Bosch analytics based on data on the registration of new cars in 2016. According to statistics, parking assistance, lane tracking and emergency braking systems are becoming increasingly popular. Parking assistance systems - from simple sensors to a fully automatic assistant - are included in the equipment of 62 percent of new cars registered in Germany in 2016. The second most popular are emergency braking systems that warn the driver of the danger of a collision and automatically reduce speed up to a complete stop. So, every third new car registered in 2016 (38%) was equipped with an automatic braking system. At the same time, it is included in the list of standard equipment of more than a quarter of these cars. In third place in the rating is driver condition control. This device was included in the equipment of 37 percent of new cars registered in 2016. And the most intensively growing popularity of lane tracking systems. The number of new registered cars equipped with this system doubled in 2016 compared to the previous year. Another interesting surge in growth is associated with adaptive cruise control (ACC). In 2013, cars equipped with this system barely gained 4 percent of all newly registered in Germany, and in 2016, adaptive cruise control appeared in almost one in five cars (19%).

Driver assistance systems are increasingly part of standard equipment

Parking assistance, emergency braking and lane tracking systems are among the most popular electronic assistants in Germany, the USA, the Netherlands, Belgium and France. Parking assistants in France are even more popular than in Germany: 67 percent of new cars registered in this country in 2016 are equipped with such a system. Moreover, in most cases - in 63 percent of new cars registered in France - it is included in the standard equipment. In Belgium and the Netherlands, 39 percent of new cars are equipped with an automatic emergency braking system: this is the highest percentage in Europe. For the first time, Italy and Russia were included in the Bosch analytical study. In these countries, the popularity of driver assistance systems is relatively small compared to others. Nevertheless, 18 percent of new cars registered in Italy in 2016 are equipped with driver assistance systems. In Russia, the share of such cars is only 6 percent. Vehicles equipped with an emergency braking system accounted for the same 6 percent.

Bosch develops faster than the driver assistance market

Electronic systems help drivers in difficult and critical road situations. These assistants are an important step towards a trouble-free and stress-free future. If all cars in Germany were equipped with an automatic emergency braking system, this would prevent up to 72 per cent of rear impact accidents. The number of cars equipped with an emergency braking system is constantly growing. For Bosch, one of the largest component suppliers, this means market growth. "Over time, the market has already grown by about 20 percent, but Bosch is growing even faster," says Gerhard Steiger, president of Bosch Chassis Systems Control. In 2019, sales of the company in the direction of driver assistance systems will exceed the mark of two billion euros. The previous mark - one billion euros - was passed in 2016. Currently, technological progress is on the way to autonomous driving. The results of Bosch's analytical studies suggest that the first function of partially automated driving, the traffic assistant, is already on the market. The action of this electronic assistant allows you to automatically repeat the movement of the car in front. The system independently drives the car, accelerates and stops it, and also maneuvers within the lane. The Traffic Traffic Assistant is on the equipment list of approximately half of the new vehicles registered in Germany and equipped with an adaptive cruise control system. In total, the number of such cars accounts for 9 percent of all cars that first passed state registration.

Bosch analytics is based on statistics on the registration of new cars for 2016

In 2016, 3.4 million new cars were registered in Germany. Based on statistics on the registration of new vehicles collected by the German Federal Road Transport Administration (KBA) for 2016, as well as data (for 22.03.2017) provided by IHS Markit business experts, Bosch experts analyzed all segments of the passenger car market. The results of the analysis demonstrate the equipping of serial models with driver assistance systems - as standard or additional equipment. The study also shows which systems are currently available on the market. Bosch has been conducting e-assistant market analytics since 2013.

2014-2016

According to Bosch statistics on the registration of new cars, one in five of the approximately three million cars registered in Germany in 2014 was equipped with such systems. At the same time, in 2013, assistance systems were installed only in every tenth new car.

Only in Germany could it be possible to prevent up to 72% of accidents related to a collision with a car behind and in which people were injured if all cars were equipped with an automatic emergency braking system. As a result of researches of emergencies by the Bosch company it was revealed that the system of support of the movement on the chosen strip can prevent up to 28% of road accident, in which because of the drivers who accidentally moved down from the strip suffered ^[7]

Technical requirements for most modern cars

The increase in safety provided by driver assistance systems is one of the reasons for their growing popularity. In particular, the automatic emergency braking system is rated in the ratings of the European program for assessing the safety of new cars Euro NCAP. Since 2016, new vehicles should be equipped with a pedestrian collision prevention system if the automaker seeks to get the highest rating of 5 stars. Due to changes in test standards and due to the constant reduction in cost, more and more modern cars are equipped with sensors that monitor the parameters of the environment. This trend also affects Bosch sales: the number of sales of radar systems and video sensors in 2015 doubled.

One sensor facilitates the operation of several driver assistance systems

Bosch is a member of the 77 GHz radar market. In 2016, the production of a 10 million radar sensor is expected. The development of MRR - a mid-range radar - allowed Bosch to make this technology more accessible to the market. For example, such a radar is used in VW Polo and Golf models, which indicates its availability even for the segment of small and compact cars. A single sensor can support multiple driver assistance systems. In addition to the emergency braking system, the MRR sensor works for adaptive cruise control (ACC). The ACC automatically supports the driver's chosen speed and programmed safe distance to the car in front. In combination with the collision prevention system, the ACC can reduce the number of emergency braking on motorways to 67%. In 2014, 8% of new cars were equipped with ACC, which is twice as much as Bosch data a year earlier.

Every fourth new car knows how to determine when the driver is tired

The number of new cars equipped with a recognition system for road signs, as well as a recognition system for drowsiness of the driver is growing - both indicators increased by 2% compared to 2013. Thus, six percent of all cars registered in 2014 can recognize certain road signs on the road using a video camera. Further information is displayed in the form of symbols on the dashboard, which helps drivers understand the difficulties of navigating road signs. In 2014, a system that determines driver fatigue was installed in every fourth new car. Using a steering angle sensor and an electric steering amplifier, the Bosch system analyzes the driver's behavior to identify the first signs of drowsiness. The system immediately registers sharp maneuvers of the steering wheel and, taking into account additional parameters, such as the duration of the trip and the time of day, determines the degree of drowsiness. Before the driver manages to fall asleep, he warns him to stop for rest.

Parking assistance systems are the most common in new cars

The headlamp control system automatically turns on the driving beam headlamps when driving outside settlements until a vehicle is found in front or in the oncoming lane. She also constantly controls the operation of the front headlights. Systems that regulate only the passing beam were not included in the latest study, as a result of which the number of cars with integrated headlamp control systems decreased. In 2014, the system was introduced in only 13% of new registered cars. Bosch first included a parking assistance system in the research. It uses ultrasonic sensors that provide sound signals that inform the driver of the distance between the vehicle and obstacles during parking, as well as rear vision cameras and parking assistants. These assistants control the steering during parking, while the driver is responsible only for acceleration and braking. According to Bosch research, in 2014, more than half of the new registered cars (52%) in Germany were equipped with parking assistance systems, which indicates the greatest popularity of these systems in new cars.

Different countries with similar preferences in driver assistance systems

Parking assistance systems are very popular outside Germany. In 2014, every second new car (50%) in Belgium, the Netherlands, as well as 19% of new cars in the UK were equipped with such systems. Automatic emergency braking systems in Belgium are even more popular than in Germany: one in four newly registered cars supports a braking system when an obstacle is detected. In the Netherlands, 17% of new cars are provided with such a system, in Spain - 11%, in the UK ‒ 5%. In 2014, 14% of cars in Belgium, 11% ‒ in the Netherlands, 20% ‒ in Spain, 6% ‒ in England were equipped with a system to support traffic in the selected lane.

Notes