RSS
Логотип
Баннер в шапке 1
Баннер в шапке 2
2024/10/17 13:19:34

Russian DBMS market: achievements, drivers and prospects. TAdviser 2024 review

.

2024/09/30
Image:Субд logo.png

Review General Partners:

 

The history of import substitution of system software began in Russia long before the start of a special military operation. Since the mid-2010s, the state has consistently adopted documents obliging companies with state participation and credit and financial organizations to switch to domestic software, including system software.

The interim outcome of their implementation in May 2024 was summed up by the chairman of the cabinet of ministers Mikhail Mishustin. He announced that Russia has achieved approximately 50% import substitution for major software products. In other words, the process is underway.

Domestic developers of system software consider the state to be an engine of import substitution and ask it not to slow down. Read about the achievements of 2023, the problems that have yet to be overcome, and plans for the future of DBMS market participants in Russia in the new TAdviser review.

1 Growing Market

The positions of Russian developers of database management systems significantly improved at the end of 2023. As shown by a study by the CSR, published in May 2024, in relation to 2022, their market share increased from 66% to 82%, and revenue, on average, increased by almost 49%. At the end of 2023, the Russian market for DBMS and data processing tools, according to analysts, reached 67 billion rubles, and by 2030 its volume could reach more than 234 billion rubles.

Indeed, many Russian DBMS manufacturers have achieved great success in 2023. Market leader - Postgres Professional increased revenue by 86.7% to 8.2 billion rubles. Arenadata Group showed an increase of 36.3% to 3.4 billion rubles. Sber Tech showed revenue growth in the direction of DBMS almost 2.8 times to 2.1 billion rubles.


The largest DBMS developers in Russia
*
by revenue from implementation/delivery of own DBMS

Company name Revenue from implementation/delivery of own DBMS for 2023, RUB million, incl. VAT Revenue from implementation/delivery of own DBMS for 2022, RUB million, incl. VAT Revenue dynamics 2023/2022,% What DBMS is being developed by the company Largest customers in Russia
1 Postgres Professional (1)8187438686.7Postgres ProRosatom , PFR, Gazprom, Russian Railways, PSB, Transneft, Rosselkhozbank, Rosagroleasing, Federal Treasury
2 Arenadata Group3417250736.3 [[ADH - Arenadata HadoopArenadata Hadoop]] (ADH), Arenadata DB (ADB), Arenadata QuickMarts (ADQM), Arenadata Postgres (ADPG), PicodataVTB, OTP Bank, Alrosa, PSB, Norilsk Nickel, FESCO
3 Sber Tech2118760178.7 [[Sber Tech: Platform V PangolinPlatform V Pangolin]], Platform V DataGridn/a
- VK Tech(2)1358n/an/a Tarantool DB| |, Tarantool Graph Tarantool Column Store DB VK Data Platform,, Cloud Storage ,|VTB|, Alfa Bank, DIT, Moscow Megaphone
4 Diasoft1237.4n/an/a [[Diasoft Digital Q.DatabaseDigital Q.DataBase]]Moscow Exchange Group, major financial institutions - Diasoft clients
5 Tantor Labs (part of Astra Group)294.677282.6DBMS Tantor [[RusHydroRusHydro]], Warton
6 RELEX86.154.957.0 [[RELEX: DBMS LinterLINTER]] BASTION, LINTER STANDARD, LINTER SoQoLCentral Bank, Goznak, Morins-Agat Concern
7 Red Soft42.836.218.2 [[Ed. DatabaseDBMS Red Database]]FSSP of Russia
Sum16 741

* Rating prepared on the basis of questionnaires completed by companies (unless otherwise indicated)
(1) Revenue from financial statements for 2022-2023. Excluding VAT
(2) Company added without assignment of position as data provided after publication of rating

Other Notable Market Participants * *
Yandex[[Yandex Database (YDB)YDB]]Yandex
TData[[RostelecomRostelecom]], T2 Mobile , Tatneft, Evraz, Fplus Holding, Sheremetyevo International Airport, Mirandas Media

* * Companies did not provide revenue data

 

! Interviews with experts

Five differences of this DBMS developer Oleg
Bartunov, CEO Postgres Professional

 

About working with data in the context of mining processes Denis Erofeev,
Director of the Business Process Development Department of
Polyus

 

We have a system product that is equally in demand in all industries Sergey Zolotarev,
Founder and Director of Strategic Development
of Arenadata

 

The future lies in comprehensive DBMS, where each tool is tailored to its task Mikhail Izyumov,
Director of the Competence Center for DBMS
of Jet Infosystems

 

2 Development of Russian vendors

Such impressive results were achieved by Russian DBMS manufacturers thanks to serious and painstaking work on the functionality of their software products.

Postgres Professional presented a record number of fundamentally new solutions developed in response to customer requests in 2023. Among the most important − the Built-in High Availability (BiHA) built-in failover cluster, the Postgres Pro Enterprise Manager graphical database management platform, and the new distributed relational DBMSs Postgres Pro Shardman, which, while maintaining transactional integrity, ensures the functioning of high-performance clusters with tens and hundreds of TB of data. In addition, an intelligent query optimization system was created, integration with Citus for OLAP loads was added, and the range of functions for lightweight migration with Oracle was significantly updated.

The solutions of the Arenadata vendor have been widely developed. In 2023, the company launched a new tool for monitoring and managing Apache Kafka connectors as part of the Arenadata Streaming (ADS) product, called the Arenadata Streaming Command Center (ADSCC). During the same year, Arenadata Streaming included support for Astra Linux and Red OS operating systems. In addition, Arenadata developers have released a new version of the Apache Hadoop-based distribution, adapted for corporate use, Arenadata Hadoop (ADH). The distribution was replenished with the new Apache Impala service - a distributed SQL query execution system in the Hadoop ecosystem.

Arenadata DB (ADB) and Arenadata QuickMarts (ADQM) received Russian FSTEC certificates of conformity. At the same time, Arenadata DB became the first certified analytical, distributed DBMS in Russia, built on an open source MPP system.

The Arenadata development team also presented users with a new version of the industrial-grade distributed fault-tolerant DBMS - Picodata 23.12.0. Among the key innovations: the availability of distributed SQL in the interactive console, support for working with global and charded tables; implemented request authorization based on access control lists (ACLs). In addition, in 2023 there was a tool for employee collaboration with data - Arenadata Catalog. Its main product line has been expanded with a number of features expected by customers and very important for corporate data warehouses.

Another domestic vendor, the Red Software company, which is now preparing to release the release of the RED Database 5.0 DBMS, was actively involved in the development of the functionality of this software product in 2023. As a result, it has an algorithm for compressing records, a package for working with BLOB, table spaces, compiled query cache, partial indexes, external connection pool, query and stored procedure profiler, task scheduler, time zone support, external tables, JSON support. A migrator and a tool for monitoring RED Monitor database servers were also developed.

Diasoft 2023 brought the fruits of work on the import-independent DBMS PostgreDB as part of the Digital Q.DataBase platform. A few years ago, it created a DBMS fork on PostgreSQL open source software. The company took the program code under responsible ownership and adapted it for use with Diasoft application solutions. In 2023, the first pilot projects for transferring customers to PostgreDB were completed and new large customers appeared. Thus, Diasoft was selected by the Moscow Exchange Group as the preferred supplier of DBMS.

Also, this software manufacturer created a partner network, completed several begun load tests with leading manufacturers of domestic IT equipment (YADRO, Aquarius, Graviton) and conducted pilot tests of the PostgreDB DBMS at the technological sandbox site of the FinTech Association.

The past year is considered a breakthrough in Orion Soft. In the third quarter of 2023, it introduced a built-in highly available fault-tolerant (HA) cluster, which is in great demand on the market. At the end of the year, she released the MVP of the new version of the DBMS - Proxima DB Advanced. It implements the ability to deploy highly available failover clusters in various configurations directly from the web interface, and a proprietary UI has appeared - another new functionality for the market.

Release 3.0 in 2023 appeared in the DBMS for In-Memory computing - Tarantool (part of the VK Tech ecosystem). It implements a new architecture for building cluster storage. In this release, you can configure clusters of any type and complexity through a single failover configuration module. For the convenience of managing Tarantool clusters, the Tarantool Cluster Manager graphical interface has been developed.

In 2023, it became a boxed product of Tarantool DB, developed on the basis of the NoSQL in-memory DBMS platform with Redis and IPROTO access protocols, it has the ability to easily install and configure a cluster through integration with CI/CD tools.

Two new databases based on the Tarantool platform were also released: the in-memory column DBMS for real-time transactional and analytical data processing Tarantool Column Store and the Tarantool Graph DB graph-vector database.

The first solution allows you to perform analytics instantly on the newest data, as well as reduce the cost of transferring and copying transactional data to DWH. Tarantool Column Store helps the business work with financial and production data, consolidate it, speed up analytical queries and generate real-time reporting.

The second solution is a high-speed storage of graphs and vectors for analyzing real-time relationships between data. Data Base is designed to solve a wide range of business tasks: from reducing risks during financial transactions to increasing customer loyalty. Tarantool Graph DB can analyze graphs with more than 7 billion connections and 100 million vertices.

Another useful novelty from the manufacturer for working with data is the distributed message queuing system Tarantool Queue Enterprise. It allows you to create different queue scenarios according to your business needs, increases system resiliency and scalability, and allows you to perform asynchronous operations.

For Sber Tech, one of the key events was the launch of Platform V Kintsugi. This is a graphical tool developed from scratch for maintaining DBMS. Now Kintsugi is an independent product, it works not only with Platform V Pangolin DBMS, but also with any relational DBMSs based on PostgreSQL and preserving the principles of backward compatibility.

In 2023, Platform V Pangolin developers focused on functionality designed to improve maintainability, sought to make it easier for administrators and end users to maintain the database: enable early detection of potential problems, minimize diagnostic time, lower the entry threshold for newcomers to the PostgreSQL world of accompaniment and automate routine operations. The implemented updates made it possible to generate even more detailed reports on the analysis of the history of DBMS activity, use new useful tools for monitoring, debugging, controlling functions and procedures, and much more.

To date, the total cost of ownership of Platform V Pangolin is significantly lower than that of popular Western relational DBMSs with the same functionality. The difference can be more than 10%, according to user cases. Firstly, the cost of the product itself is lower than that of foreign vendors. Secondly, the labor costs of specialists are lower. For example, the company "First Bit," which transferred 7,000 employees to this product, reported a decrease in labor costs, as well as the fact that with the implementation of DBMS, the number of incidents decreased by 30%.

In 2023, Tantor Labs (part of the Astra Group) focused on developing the functionality of original products, making progress here. By strengthening the performance and security of the system, introducing new administration and monitoring tools, the company managed to significantly expand the range of application of its DBMS.

File:Aquote1.png
We have integrated improvements into Tantor in scaling performance on multi-core servers, new storage methods, high availability and resiliency, such as support for Patroni clusters, "said Vadim Yatsenko, CEO of the company.
File:Aquote2.png

In addition, the first version of the Tantor XData database machine was implemented. This solution should be a new step in the development of the Tantor ecosystem and open up new niches for working with data in the Astra Group.

Of the notable projects of Tantor Labs during this period: the transfer of the corporate data warehouse of one of the leading financial institutions of the Russian Federation (as soon as possible and with minimal customer costs), the acquisition of PJSC RusHydro DBMS and the company's platforms for its information systems, a number of migration projects from foreign DBMSs, such as Oracle, to the Tantor DBMS.

Dmitry Lemesh, Nexign Product Manager, spoke about the key advantages of Nexign Nord that have crystallized over the years of working on this DBMS:

File:Aquote1.png
Nexign is a high-load application software vendor, and therefore we have a good understanding of the requirements for high-performance databases. We offer our Nexign Nord product to the market, open-source DBMS with advanced capabilities and support. Nexign Nord is a completely Russian development, independent of external suppliers and registered in the Unified Register of Domestic Software. It provides import substitution of foreign systems, including Oracle Database and Microsoft SQL Server, and also allows you to reduce the total cost of ownership (TCO) by up to 10 times.
File:Aquote2.png

According to the expert, the development of Nexign Nord has been underway since 2021, and the reference point is the needs of large enterprise companies and medium-sized businesses. The product supports key features for systems of this class (built-in connection puller, failover cluster, flexible password policy management, 1C support, etc.).

File:Aquote1.png
In addition, we offer functionality that simplifies the development of extensions for the database, allows you to perform background periodic tasks and conduct advanced monitoring and logging, "said Dmitry Lemesh. - Nexign Nord does not have unnecessary modules that are not in demand among customers, and this allows us to maintain a relatively low license cost compared to competitors.
File:Aquote2.png

! Current products

 

 

 

3 Joining Forces

More than half of the success of the DBMS in the market is ensured by its compatibility with application software. Understanding this, Russian manufacturers are active in looking for partners and collaborations with them.

The past 2023 was rich in examples of successful cooperation between different types of vendors. For example, Postgres Professional and Skala^r have developed a new version of the Database Machine Skala^r MBD.P. based on the certified Postgres Pro Enterprise DBMS. Due to architectural approaches, the peak performance of PACs has increased by 60%, to 65,000 transactions per second, and provides a database with a capacity of up to 150 TB.

File:Aquote1.png
In addition, we have significantly expanded the Postgres Pro compatibility map - now it has about 300 solutions, including all the most popular OS and applied software, − says Ivan Panchenko, co-founder and deputy general director of Postgres Professional. - Postgres Pro DBMS officially supports the Elbrus processor platform (e2kv4 and e2kv5). Processors on the ARM platform are supported (including Baikal and Kungpeng). The plans include support for RISC-V and Loongson platforms.
File:Aquote2.png

Postgres Professional has also been releasing special versions of Postgres Pro for 1C for a long time, which are most adapted for working with the platform and include a significant number of optimizations.

Orion soft continued to work on the compatibility of its DBMS with application software. In 2023, these were the software products of its partners, such as Cyberprotect and 1C. Orion soft also sought the internal integration of Proxima with its other products (zVirt, Nova, Cloudlink, Term) so that customers could use an ecosystem of products optimized with each other with unified technical support.

Sber Tech interacted with developers of other classes of system and application software, expanding, for example, the list of supported OSs. Among them are Platform V SberLinux OS Server, RedOS and AstraLinux. As a result, at the moment the Platform V Pangolin DBMS supports 10 operating systems.

In addition, in 2023, test tests began on the interaction of the 1C: Enterprise platform with the Platform V Pangolin DBMS: the tests were successful and, for certain scenarios, the performance and performance were increased by 15% relative to the DBMS analogues.

Red Soft paid great attention to the development of the Firebird developer community. In 2023, she organized and hosted the FIREBIRD CONF 2023 conference. According to Roman Simakov, director of the department for the development of system products "Red Soft," it was decided to hold this event annually, including in 2024. Also, this DBMS manufacturer attracted many new members to the Firebird community and found partners for joint projects.

Tantor Labs is engaged in the active development of the user and developer community around its DBMS. According to Vadim Yatsenko, success in this direction is confirmed by active feedback and the growth of the participant base at the company's forums and events. In addition, collaborations with developers of various system and application software allowed Tantor Labs to integrate solutions into a wider range of IT infrastructures. For example, "1C" became the exclusive distributor of the DBMS edition of "Tantor Special Edition 1C" by agreement of the parties.

File:Aquote1.png
The question of collaboration, − notes Sergey Zolotarev, co-founder and director of strategic development at Arenadata, − is now very relevant for the market, since for years the emerging technological stack of applied and system software products has been destroyed. And we see a request from our clients to create the same Russian stack.
File:Aquote2.png

According to him, Arenadata has been paying close attention to cooperation with technological partners for more than two years, primarily with leading developers of BI systems, in order to jointly test and integrate solutions among themselves, in order to provide customers with a single proven solution based on products from different vendors.

File:Aquote1.png
We are also actively working to port our products to Russian operating systems. As part of solving this problem, we have built close technological cooperation with several of the largest vendors of the Russian Linux OS, − he added.
File:Aquote2.png

Diasoft in 2023 developed partnerships with industry software manufacturers (for example, Astra Group, BASEALT, SearchInform, Iskra Technologiya and others). Its DBMS also promotes a number of large IT solution providers: Softline, SysSoft.

Other participants in the review also cooperate with leading system integrators. For example, the company "FORCE - Development Center" has accumulated experience in working with PostgreSQL forks for a number of products from Arenadat, Tarantool DBMS. According to Sergei Kondakov, its director of software development technologies, the company has partnerships with vendors of these products.

File:Aquote1.png
We used some of the products in our custom developments, including within the framework of government contracts, and for a number of products, for example, PostgreSQL DBMS, we have been providing technical support services to our customers for several years, − he said.
File:Aquote2.png

IT solution providers devote a lot of time to a detailed study of the capabilities and limitations of DBMSs of different domestic suppliers and are actively accumulating expertise in this area.

! Current projects

 

4 Who chooses Russian?

State companies and companies with state participation, entities critical information infrastructure () CUES are obliged to switch to Russian ON in order to comply with the requirements of Decree of the President of the Russian Federation No. 166 of 30.03.2022. But, apparently, not everyone will have time by the date indicated in the document.

Credit and financial institutions have repeatedly applied to the Central Bank of the Russian Federation with a request to extend the period of complete and final transition to Russian software. This spring, the Association of Russian Banks sent a letter to the profile Deputy Prime Minister, the Bank of Russia, as well as a number of other departments with a proposal to give credit and financial institutions the opportunity to use foreign software after January 1, 2025 and to provide for import substitution in this industry, balanced by compensating measures, during the transition period.

At the same time, import substitution of system software in Russian banks is still underway. This is confirmed by such manufacturers of domestic DBMS as Postgres Professional, Arenadata, Diasoft, Orion Soft and Red Software. So, according to Sergei Zolotarev, the largest customers of Arenadata are representatives of the financial sector, retail, telecom and the public sector.

File:Aquote1.png
In recent years, we have noticed the largest increase from industrial enterprises, since for them work with data becomes no less relevant than for organizations from the above sectors, − he notes.
File:Aquote2.png

Diasoft also receives requests from financial market participants, and besides them - from the oil and gas, engineering, energy industries, as well as from the retail sector. This was told by Nikolai Makarevich, director of the Data Economics direction, a member of the board of this company.

And Orion Soft has an absolute leader among customers, according to Liubov Rodionova, the leader of the Proxima DB Orion soft product, the financial sector. She also shared that companies from the energy industry and the agro-industrial complex showed interest in industrial DBMS based on PostgreSQL.

Potential customers from a variety of industries showed interest in the Red Database DBMS. Roman Simakov, director of the department for the development of system products "Red Soft," names among them finance and insurance, medicine, mechanical engineering and metalworking, metallurgy, as well as the oil and gas industry, communications and telecom, transport.

Alexander Vinogradov, head of Tarantool, says that this platform is used in the banking sector, retail, telecom and some other industries, where the efficient creation of high-load applications and the transition to a microservice architecture are required.

File:Aquote1.png
In addition to the public sector, banking and large industrial enterprises, in 2023, the company from retail and fintech showed increased attention to our product, - said Mikhail Semenov, product leader of Platform V Pangolin (Sber Tech).
File:Aquote2.png

While large banks with state participation are fighting to postpone the complete transition to Russian software, including systemic, many commercial credit and financial organizations are already switching to DBMS from ERRP.

File:Aquote1.png
This year, we began to receive requests from private companies much more often, − stated Ivan Panchenko from Postgres Professional and added that an increase in interest is observed from banks and oil and gas companies.
File:Aquote2.png

According to him, many large customers of Postgres Pro, following the results of pilot projects, decided to scale it to new information systems, including KII facilities.

Tantor Labs said that in 2023 the company managed to conclude a large number of contracts with partners from various industries, to expand the geography of the presence of Tantor DBMS (at least 25 regions of Russia). The company's products and efforts were appreciated by PJSC RusHydro. Companies from the fuel and energy complex, the financial, industrial and retail sectors showed significant interest in Tantor DBMS. There was also high demand from organizations engaged in business analytics and robotization of processes.

5 Import substitution of DBMS goes, but slowly

It would seem that such a wide interest of companies from different industries, coupled with the noticeable positive sales dynamics reported by domestic manufacturers, should indicate a high rate of import substitution of foreign database management systems. However, some market participants note that today they are at the beginning of a long journey and are making arguments in favor of their point of view.

The thing is that replacing a foreign DBMS with a Russian one does not bring profit to private companies, and therefore is not a priority for them, Nikolai Makarevich believes. In addition, translating application software, mostly adapted to work with Oracle and MS SQL DBMS, to an import-independent DBMS is a difficult and time-consuming task.

File:Aquote1.png
Many procedures and business logic of a number of processes are specific to the DBMS of Western vendors and cannot be automatically transferred to the DBMS based on PostgreSQL, − he states.
File:Aquote2.png

Unlike replacing operating systems, import substitution of DBMS requires refactoring existing databases from end users, which in turn entails refactoring applications. And this is a resource-intensive and entailing certain business risks, adds Sergey Kondakov, director of software development technologies at FORCE-Development Center.

File:Aquote1.png
In our region, in my opinion, import substitution is proceeding at a very restrained pace. On the one hand, we have created products that replace the solutions of the largest Western suppliers. And I think this is a great merit of the Arenadata team. But on the other hand, many more clients have not fully begun projects to import substitution of Western systems for Russian products, − says Sergey Zolotarev.
File:Aquote2.png

The pace of import substitution, says Liubov Rodionova, leader of the Proxima DB Orion soft product, in addition to the incompatibility of Russian application and system software based on PostgreSQL, was influenced, firstly, by expectations of extending the terms of import substitution of foreign software, and secondly, the lack of specialists in working with domestic database management systems.

At the same time, import substitution demonstrates positive dynamics, notes Ivan Panchenko from Postgres Professional. According to him, independent research confirms that in eight out of ten cases, customers choose Postgres Pro for import substitution. However, a large market share still uses Oracle and Microsoft products.

According to Vadim Yatsenko, General Director of Tantor Labs, the level of import substitution of DBMS in 2023 reached 20-25% and continues to grow at a high rate.

According to Dmitry Lemesh, product manager at Nexign, companies that still use foreign DBMSs mainly support them with the help of internal development teams or former employees of Western vendors, which does not guarantee the possibility of prolonged operation of these solutions. In addition, the maturity and reliability of the systems offered by Russian vendors is constantly increasing, and product safety requirements are being tightened.

File:Aquote1.png
We expect that the reduction in the position of foreign vendors will continue and achieve the projected goal of 1% by 2030, − the expert shared.
File:Aquote2.png

Optimism is inspired by the events that are observed today in the Russian market for database management systems, comments Roman Simakov.

File:Aquote1.png
At the moment, the DBMS market is in the phase of active development. Leaders are already visible, but it is worth noting that the situation is very mobile. Now a competitive environment has been created that has a positive effect on domestic development, − he said.
File:Aquote2.png

Also, the expert proposes to record various professional events for developers of applied and system software and cooperation of some of the Russian suppliers, including Red Software, with educational organizations in the training of personnel and the development of competencies of system software developers.

6 Looking for drivers for 2024

CSR analysts predict for this and next years the accelerated development of the Russian data storage and processing market − with an increase of 40% or more. In their opinion, it is in 2024-2025 that import substitution processes will reach their peak. Solutions of domestic manufacturers will reach maturity, respectively, the demand from customers will also grow significantly.

And what ways do market participants see to speed up import substitution? According to Sergei Zolotarev, the best driver for the transition of companies to the Russian DBMS will be a noticeable increase in the number of successful projects of such migration.

File:Aquote1.png
The specifics of migration from DBMS of foreign manufacturers to DBMS included in the Unified Register of Russian Software is the need to transform the data scheme. And it entails making changes to the application code, as well as the need to rewrite the code of the database-level business logic, − explains Sergey Kondakov.
File:Aquote2.png

At the same time, according to him, in the case of highly loaded databases, the need to transform data schemes is often associated not only with the use of different types of data and/or the specifics of their storage in the database, but also with the use of hardware and software systems. Problems of transferring stored code to the Russian platform are solved both thanks to the special functionality of the DBMS Oracle (Postgres Professional offers such a solution for stored code), and using special code migration tools (for example, Convertum, etc.).

Another factor is Nikolai Makarevich − these are measures of legislative regulation and support for import substitution by the state. Roman Simakov has a similar position: strengthening the role of the state in the IT market and restricting access to foreign software and equipment are the drivers of market development.

Software manufacturers expect the state to consistently follow the announced course, support client companies introducing Russian software products, as well as further steps to stimulate demand for domestic software and restrict access to foreign software.

As the general director of Tantor Labs Vadim Yatsenko said, the main drivers of import substitution of DBMS in 2024-2025 will be strengthening state support for domestic developments, increasing business awareness of the advantages of using Russian solutions, the emergence of new services and solutions, such as DBaaS and software and hardware complexes, as well as the continuation of the sanctions policy that stimulates the transition to domestic software.

In addition to regulatory requirements, according to Liubov Rodionova, global technological trends can positively affect the processes of companies' transition to Russian DBMS: firstly, a multiple increase in information volumes in the coming years; secondly, the revision of the architectural approach to solving information storage problems is the growing popularity of microservice architecture and, as a result, the crushing of storage, information systems and data for specific application purposes. Well, Liubov Rodionova considers the third driver to be increased competition between Russian DBMS manufacturers.

File:Aquote1.png
Private companies may become a new driver of import substitution, the interest of which was previously only formed. According to our estimates, the active phase of their migration will begin in the next year or two due to the obsolescence and growing security risks of previously purchased foreign software, − said Ivan Panchenko, co-founder of Postgres Professional.
File:Aquote2.png

And in general, increasing the profitability of a business as a potential customer could stimulate end-users of the DBMS market to invest more in updating their IT solutions, notes Sergey Kondakov.

File:Aquote1.png
The main driver of this year is the desire to fulfill the Decree of the President of the Russian Federation No. 166 "On measures to ensure the technological independence and security of the critical information infrastructure of the Russian Federation."[1] −" said Mikhail Semenov, leader[2] the product Platform V Pangolin ("Sber Tech"). − Russian state-owned companies and companies with state participation are obliged to completely switch to domestic DBMS from 2026. This is already followed by challenges for developers: to ensure the convenience of maintaining your product and the development of tools that will simplify the transition to domestic software.
File:Aquote2.png

Equally important, according to the expert, is the fact that Russian DBMSs are becoming more mature and competitive, and most of them take into account high corporate standards of reliability, performance and safety. Large companies are increasingly sharing successful experience in introducing solutions from domestic manufacturers, as a result of which the business has an increased level of confidence in Russian developments.

7 Identifying stumbling blocks

In the meantime, the Russian segment of database management systems of the data storage and processing market is in its infancy.

File:Aquote1.png
More than 30 forks have already been registered in the Unified Register of Russian Programs for Computers and Databases, PostgreSQL while the main players are only being determined, competitive mechanisms have not yet been formed, as well as clear market requirements for DBMS, − states. Nikolay Makarevich
File:Aquote2.png

Liubov Rodionova looks at the question more philosophically. From her point of view, the main rival for the development of Russian DBMS is time.

File:Aquote1.png
Still, we have to catch up with a foreign product that has existed on the market for not the first decade, "she says.
File:Aquote2.png

At the same time, Liubov Rodionova, using the experience of Orion soft, was convinced that the need for a dynamic release of demanded functionality with good performance, taking into account the growing competition, keeps the team in good shape.

File:Aquote1.png
We need time for the successful development of products, − agrees Roman Spivakov.
File:Aquote2.png

According to him, domestic DBMS developers need a demand for their products and, no less important, feedback from users of their solutions (both customers and developers), on the basis of which the product functionality is developed and improved.

Postgres Professional considers personnel, or rather their shortage, to be the main difficulty in the development of the DBMS industry.

File:Aquote1.png
For years, Russia has raised generations of specialists working for Oracle from the university bench and brought up in the best vendor lock-in principles, when the user is placed in a comfortable environment of well-complemented products, − says Postgres Pro co-founder Ivan Panchenko. - And Postgres-based DBMSs have a completely different device, which takes time to study and adapt to. Therefore, it is important to solve the problem systematically and starting from the basic level - to train the community to work with Postgres, to implement appropriate educational programs in universities.
File:Aquote2.png

The lack of qualified personnel and appropriate expertise in the market was confirmed by the general director of Tantor Labs Vadim Yatsenko. In addition, he noted that to fully integrate IT products into corporate IT landscapes, it is necessary to ensure compatibility with a wide range of application systems, business applications and software monitoring and administration tools, and companies still have a lot of work to do in this area.

From the position of the system integrator, the import substitution processes of DBMS are restrained by economic factors. Among them, Sergey Kondakov calls the high cost of the transition associated with the need for refactoring databases and, as a result, making significant improvements at the level of business logic of applications. The risks associated with replacing years-old application code also affect the concerns of foreign software owners.

8 TAdviser study: experience and prospects of Russian DBMS use in large organizations > > >

According to the results of the TAdviser study on the features of import substitution of DBMS based on in-depth interviews conducted in May 2024, the main difficulty in this direction lies in the large amount of necessary refinement of application systems, which keeps the commercial sector from immediate transition. A complete replacement here can be expected after 2030. For state organizations and large companies with state participation, which were forced to act more quickly, the transition should be completed in 2026.

Experts are skeptical about the versatility of ready-made hardware and software systems that are able to close certain specific problems, but do not solve all problems. There is still a alertness to domestic cloud DBMS, which is associated with cost and quality aspects.

On a five-point scale, the maturity of our DBMSs is rated within the market as "satisfactory." Most of the questions from experts are about the scalability and performance characteristics of Russian systems.

9 Catch up and overtake


The desire of the leaders of the Russian DBMS development to constantly be "in good shape," reacting as quickly as possible to customer requests, has a positive effect on the functionality and quality of their software products.

So over the past few years, in the Postgres Pro DBMS, following the results of close communication with customers, more than 100 functions have been introduced to ensure high performance and reliability. Thanks to them, this database management system works in installations up to 150 TB with simultaneous connection of over 10,000 users. At the same time, the performance of the system in some cases can be several times higher than the performance of PostgreSQL.

File:Aquote1.png
We are not just keeping pace with the foreign market, but in some aspects we are creating solutions unique to the Postgres world. Our developers introduced BiHA (Built-in High Availability), their own system for managing the Postgres Pro failover cluster. Unlike external solutions that pose high security risks, BiHA is integrated directly into the database engine. In addition, Postgres Professional specialists were the first in the world to develop 64-bit transaction counters for Postgres, which solve the problem of overflowing the transaction meter on high-load systems - and then shared this solution with the community. Also, the Postgres Professional team has created the world's first Postgres intelligent system for fixing and stabilizing problematic request plans, "said Ivan Panchenko.
File:Aquote2.png

According to him, one of the most important advantages of Postgres Pro not only in the Russian, but also in the world market is the project team. The high level of its expertise is evidenced by the 1st place in Russia and the 2nd in the world in terms of contribution to open PostgreSQL.

File:Aquote1.png
Thanks to such expertise, at the request of customers, we introduce into DBMS the functions necessary for business that significantly increase performance, reliability, scalability and - which is especially important for CII objects - DBMS security, the expert −.
File:Aquote2.png

File:Aquote1.png
Today, we are certainly equal to competitors in terms of technical and functional capabilities, as well as performance and fault tolerance. And this was a key requirement for the product, − says Sergey Zolotarev, co-founder and director of strategic development at Arenadata. − We still had a certain technological gap in the field of manageability and usability of the product, because, according to our customers, this was not a high priority. But now these characteristics are becoming critical as an increasing number of companies switch to Arenadata products. Therefore, we have made a significant breakthrough in terms of the development of management and monitoring systems. Also, taking into account the massive introduction of our products, we have actively invested in the creation of detailed technical documentation.
File:Aquote2.png

Stress testing of Diasoft software confirms that 86% of operations are performed on its PostgreDB in the same way as on MS SQL, or faster; the operating time of 9% of operations is uncritically lower than on MS SQL Server, states Nikolai Makarevich. To solve the problems of scaling the system in connection with the increase in the load on DBMS, Diasoft, together with large customers, has developed and implements its own approach of extended sharding.

To ensure a seamless transition to the new DBMS, Diasoft provides a service for converting data, including code created by clients, from MS SQL to PostrgeDB - a special converter was developed for this.

According to Liubov Rodionova, none of the forks based on PostgreSQL will be able to compare with Oracle Database in performance in the foreseeable future.

File:Aquote1.png
If we talk about functionality and usability, we are close to Oracle, and in some aspects - no worse than it, thanks to the presence of intuitive UI, graphical monitoring, an extensive number of capabilities for managing users, databases, built-in backup tools, extensions, etc., − she notes.
File:Aquote2.png

In terms of the basic functions of the DBMS "Red Database" is not inferior to software products of this class from international suppliers. Since the starting points for the development of the product are the needs of customers, the domestic vendor Red Software focuses on improving the performance, resiliency, scalability of its DBMS.

In addition, Red Software creates a comfortable environment for developers using Red Database − supports drivers for popular frameworks and programming languages.

File:Aquote1.png
We provide a developed PSQL stored procedure development language, which is very similar to the PL/SQL language for Oracle, and it will not be difficult for many Oracle developers to learn and use it. We support nested routines and program packages, exception handling. We have unique means of managing transactions and save points, − said Roman Simakov.
File:Aquote2.png

There are built-in developed monitoring and administration tools in the DBMS from Red Software.

10 General directions of movement

Despite the fact that each domestic manufacturer of software products for storage and processing of data has its own strategy of technological and product development, in which it lays its own vision of the future, the direction of movement of different participants in this market largely coincide.

In terms of technology, most participants in this review have plans for horizontal scaling and charring. Sergey Kondakov explains their relevance by the fact that there are still few Russian servers on the market with a large number of processor cores.

File:Aquote1.png
If we talk about specific products, then it is worth calling extensions that allow you to scale the DBMS horizontally. PostgreSQL This solution is offered by the company, Postgres Professional the product is called. Postgres Pro Shardman There is also a freely distributed Citus software that solves a similar problem, − we are ready to provide technical support for it. For large-scale analytical storage in data lakes, the optimal solution with horizontal scaling will be, the Arenadata DB expert − comments.
File:Aquote2.png

The plans of the Red Soft company − to add charring functionality to its DBMS. Orion Soft has similar plans.

File:Aquote1.png
Integration of charding mechanisms and its automation, preservation of fault tolerance when using it - all this will allow the business to create databases with an increased storage volume, − explains Liubov Rodionova.
File:Aquote2.png

Diasoft, according to Nikolai Makarevich, has developed and is implementing its own extended sharding approach to solve the problems of scaling the system in terms of load on Diasoft DBMS together with large customers.

Both companies plan to develop monitoring and management modules as part of their DBMS. But if Red Software needs a monitoring function to create comfortable conditions for application software developers, then Orion Soft is convinced that it will reduce system maintenance time and reduce the requirements for technical skills of users.

Almost all participants in the review develop and improve tools to simplify the migration of customers from foreign software products to their DBMS. For example, Postgres Pro is convinced that such a transition should be seamless for companies.

File:Aquote1.png
The architecture of Oracle, Microsoft SQL Server and PostgreSQL-based DBMS is very different, so converting code can take a long time. To make this process easier and faster, we at Postgres Professional have developed several solutions: support for embedded Oracle system packages, our own utility for automatic conversion of ora2pgpro code, transferring parameters to a script in psql, associative arrays and hash collections (an analogue of PL/SQL tables in Oracle), simplifying work with large database objects: BFile and Superfile technologies, − notes Ivan Panchenko.
File:Aquote2.png

Cloud technologies deserve a separate mention. By the way, the CSR report predicts an increase in the use of DBMSs designed for consumption from the cloud in the long term.

Arenadata is already preparing for this growth.

File:Aquote1.png
Now we are actively looking at the presence and development of our products on the sites of cloud providers, − says Sergey Zolotarev.
File:Aquote2.png

Working in the clouds is one of the key areas for Postgres Professional.

File:Aquote1.png
Postgres Pro DBaaS is a solution for private and public clouds, including for hosting fault-tolerant and scalable clusters. The service will facilitate the work of database administrators in the cloud era and help save resources by maintaining the convenience of database management, says Ivan Panchenko, co-founder of Postgres Professional.
File:Aquote2.png

Also, most of the review participants are already solving the problem of overcoming the "personnel hunger." Thus, the Red Software company, according to Roman Simakov, cooperates with educational organizations, helps in the training of personnel who know how to work with Russian software, sees positive trends in the development of the competencies of system developers.

Orion soft plans to develop Proxima DB training, cooperate with both private educational centers and state universities in order to stimulate students' interest in PostgreSQL-based DBMS and the desire to move in this direction.

Postgres Professional already has an internship program for students from leading universities in the country. In addition, she conducts the only certification of PostgreSQL specialists in the country.

11 Brief on the plans and prospects for the development of Russian DBMS

Postgres Professional in 2024 continues to develop the capabilities of the graphical database management platform - Postgres Pro Enterprise Manager (PPEM). PPEM will receive integration with various mechanisms for diagnostics, control and performance tuning, as well as other features of the Postgres Pro DBMS. In addition, the team continues to work on partitioning, tools to simplify migration, the development of a fault-tolerant horizontally scalable OLTP cluster and backup tools. Other areas of Postgres Professional's work include the development of artificial intelligence and machine learning functions and an increase in the number of supported solutions.

Arenadata improves the security of its data collection and storage platform and brings it in full compliance with the requirements of the regulator in terms of FSTEC certification and support for Russian operating systems.

Diasoft expands and strengthens the team of specialists involved in the development of DBMS and the implementation of projects for its implementation among customers in order to transfer their clients to the import-independent DBMS PostgreDB and its mass distribution.

Orion Soft is moving to the 17th version of the PostgreSQL kernel, increasing the comprehensive security of its database, and automating update and migration processes.

Red Software adds support for geometric data types, heterogeneous queries, schemes to its DBMS, as well as support for the ROW data type, optimizer improvements, the ability to work with live indexes, and table partisanization. In 2025, it will release the release of DBMS RED Database 6.0.

Platform V Pangolin (Sber Tech) specialists intend to invest more efforts in the development of open source in the Russian Federation and actively interact with free software developers. Together with 1C, they plan to create a competence center to promote initiatives to switch to Russian solutions and an import-substituted technological stack. Partners will continue to develop cooperation in testing various configurations of 1C products and Platform V Pangolin DBMS.

For Tantor Labs, one of the most important areas is the production of Tantor XData data machines, which is being carried out together with a long-standing and reliable partner - Aquarius. In terms of sales, Tantor Labs sets itself an ambitious goal: to increase the volume of commercial implementations several times compared to 2023 (despite the fact that the company's revenue in 2023 increased almost 4 times). In 2024, one of the key priorities of the company will remain to increase the level of automation of the processes of migration and conversion of databases from foreign DBMS to Tantor. The plans are to release a specialized converter that will allow you to simplify and speed up the process of such transitions as much as possible. Also, specialists will continue to expand the possibilities for integration with other classes of enterprise software.

1 In conclusion

The readiness of Russian DBMS to solve complex problems was confirmed during successful projects.

Postgres Professional spoke at once about several large migration cases among domestic companies. Among them is the transfer of the Unified Industry Document Management System (UOSDO) from Rosatom State Corporation. Specialists managed to transfer data accumulated over more than 13 years of EDO in the nuclear industry in 3 days. Within the framework of the project, a fault-tolerant and disaster-tolerant database cluster was implemented, and the migration itself passed without losses and interruptions in work. Now the system employs more than 110 thousand users, the current EOSDO base on Postgres Pro is about 20 terabytes, the volume of content is more than 300 terabytes.

Arenadata has developed a migration scenario for one of the important components of the SAP product ecosystem - SAP BW and implemented three similar projects in 2023. Among them − the introduction of a new business data analysis system for Unilever. Within the framework of the project, the task of restructuring the customer's IT landscape and finding import-substituting analogues for the corporate data warehouse and BI system was solved.

In the same year, the Western data store in one of the banks was transferred to the Tarantool Column Store solution for building an anti-fraud system. Being built into the anti-fraud system as a high-speed analytical storage, TCS made it possible to store over 5 TB of data with 1000 + attributes (columns) and conduct analytical calculations in real time.

Another interesting project − from the team VK Tech − the implementation of a new architecture of the authorization system Mos.ID using the platform. Tarantool It provided the customer with the ability to maintain a high load on services and quickly scale. By storing the most demanded data in RAM, city services connected to the Mos.ID authorization system instantly gain access to the necessary information and are able to withstand more than 10,000 requests per second. The transition to a new architecture made it possible for Mos.ID to quickly, flexibly and quickly respond to infrastructure changes - adding one virtual machine with four instances takes only 30 minutes. And the deployment time of new SUDIR clusters (the main Mos.ID element) was reduced by 1 hour.

Domestic software products in the field of data processing and storage have confirmed that they can solve large-scale and complex problems. And this, in general, is just the beginning.

- See also

Notes