Yandex Database (YDB)

Yandex Database (YDB) is a distributed fail-safe database NewSQL developed at Yandex. According to developers, it can be an alternative to existing solutions in the following cases:

• In systems that require support for ACID transactions between tables with uneven time load;
• In systems requiring processing and storage of a large amount of data;
• When developing a new product, for which already at the design stage a large load is expected with a high probability (thousands of requests per second to the database) and the requirement of strict consistency;
• As a backend for databases with poorly predictable load.

2022: Disclosure of DBMS sources

On April 20, 2022, Yandex announced the posting of the YDB database management system (Yandex Database) into open access. Code, as well as documentation, SDK tools, and all database solutions are provided under an open Apache 2.0 license. The documentation is published in the GitHub repository.

{{quote 'Opening the project creates an interesting win-win situation for everyone. The community, on the one hand, has the opportunity to use the unique developments in which Yandex invested hundreds of man-years, get acquainted with the code, freely launch and develop solutions based on YDB, "Yandex said on Khabra. }}

Yandex revealed the sources of its DBMS

Another reason for the discovery of DBMS sources in the company was called a strong increase in user variability. Yandex will be able to receive feedback from the world community and improve the product. The company added that it is necessary to eliminate the barrier for users who are interested in technology, but stop for fear of closure or the inability to use it on their equipment or in their clouds.^[1]

We are confident that the rapid development of technology that we have seen in recent decades would not have been possible without the use of open source. The availability of technologies facilitates their diffusion and encourages interest in them. For example, the Internet can no longer be imagined without databases such as MySQL, PostgreSQL or ClickHouse. By publishing the YDB code, we continue to follow the principles of openness and share with all the achievements that we have spent almost a decade on. Now the technology that allows Yandex to scale quickly and move forward will be available to everyone under the free Apache 2.0 license., "Said Alexei Bashkeev, CEO of Yandex Cloud.

It is noted that by April 2022, Yandex has been using the YDB system for more than five years, projects in it host the teams Alice"," Taxi"," Market"," Metrics"" and other services. YDB has almost 500 projects. You can expand to your own or third-party servers - including Yandex Cloud in or others. The cloud services company noted that YDB works on standard iron, it can be deployed everywhere using the operator or Kubernetes manually, while the code of most systems of leading cloud providers is closed, and some of these products are tied to specialized equipment. According to the developers, YDB DBMS can handle millions of requests per second.^[2]

Yandex systematically uploads open source to its key technologies. So, in the public domain is a library that machine learning CatBoost is used Search in other Yandex services. In 2016, the company published source code - ClickHouse high-performance analytical. database management systems

2020: General availability in Yandex.Cloud

On September 23, the new Yandex Database Management System (YDB) became publicly available. Yandex began to offer it as a service in regular and server-free versions on its Yandex.Cloud cloud platform.

The Data Base belongs to the class of NewSQL solutions, which was conceived as a DBMS for cases when there is not enough performance or functionality of classical DBMS, says Alexei Bashkeev, head of the Yandex.Cloud platform. In Yandex itself, they encountered this many years ago. Therefore, the company developed and began to use this DBMS, he explained. Now this system is used in Yandex.Search, Yandex.Cloud, voice assistant Alice, Yandex.Collections, Yandex.Messenger, on the site "Авто.ру"

For external users since the announcement in 2019, YBD has been available in Yandex.Cloud in a non-commercial preview mode on request. Alexey Bashkeev told TAdviser that she was then made available in the cloud to test the demand for these solutions. According to him, several hundred companies showed interest.

One of the main types of demand that we felt was large implementations, where the same capacities or approaches of standard DBMS are lacking and something else is wanted. At the same time, we saw that the market for worthless solutions is also growing. Therefore, we added this opportunity to the YDB, "he explained to TAdviser.

Yandex Database has left the preview stage "(image - Yulia Bedrosova's studio)"

The server-free software interface of YDB is compatible API with the popular server-free Amazon DinamoDB solution. This will significantly expand the applicability limits of YDB, calculated in the company., The operating Oleg Koverznev director of Yandex.Cloud, says that the company is not in vain ensuring the compatibility of its DBMS with the global database, which is already widely used. Now the company is doing the most to lower the threshold for entering this technology, he added.

Rather, we are counting not on 1-2 large implementations, but on hundreds, thousands of small projects that will grow and develop on the basis of this technology, "says Koverznev.

According to Alexei Bashkeev, YDB is a long-term investment. The company will adjust further development plans for YDB depending on how much demand for it will see, the head of the Yandex.Cloud platform added.

The company recalled that Yandex, like Mail.ru, also has an open source solution - DBMS ClickHouse, which has long been represented in the cloud.

YDB has become publicly available as part of a major update of Yandex.Cloud services. In addition to it, the company introduced a number of new services for data storage and management.

Notes