BFT-Holding has deployed data storefronts for the Ministry of Finance of the Russian Federation

2024: Data Mart Implementation

BFT-Holding implemented data marts for the Ministry of Finance of the Russian Federation. Now user departments of the National Data Management System (NSMS) can receive operational access to information about capital construction projects, executors of state (municipal) services and other information. BFT-Holding announced this on April 2, 2024

The State Integrated Information System for Public Finance Management "Electronic Budget" (GIIS "Electronic Budget") is the main information system of the Ministry of Finance of Russia, consisting of many subsystems, modules and individual components. The specified information system contains information about participants in the budget process, state (municipal) works and services, procurement and expenditure management within the framework of budgetary obligations, as well as other information. Employees of federal and regional executive bodies responsible for the budget processes of their organizations work with the information stored in the GIIS "Electronic Budget" - data consumers.

To reduce the number of requests for data from GIIS to its own information systems coming from consumer departments, the Ministry of Finance of the Russian Federation decided to create data storefronts in order to reduce the burden on basic resources and more quickly provide responses to user requests. With an estimated average response time of 60 seconds, the real average response time was 0.408 seconds, the maximum response time was 0.76 seconds; with a planned average load of 150 requests per second, the showcase holds a load of more than 410 requests per second, and the maximum load was 2330 requests per second.

The project was carried out by JSC "Main Scientific Innovative Implementation Center" together with specialists of BFT-Holding. As a result, consumers were provided with access to the following data storefronts of the Ministry of Finance of Russia, created within the framework of this project:

1. "Capital Construction Facilities, Consolidated Budget Signature, Regulatory Reference Information."
2. "Information on agreements (agreements) on the provision from the federal budget (budgets of the constituent entities of the Russian Federation, local budgets) of subsidies, budget investments, interbudgetary transfers, reporting on them."
3. "Information on passports of government programs."
4. "Register of performers of state (municipal) services in the social sphere in accordance with the social certificate for obtaining state (municipal) services in the social sphere."

BFT-Holding implemented data storefronts of the Ministry of Finance of Russia, using as a solution the standard replicated software "NSD Data Showcase."

During the project, a data loading subsystem was implemented and configured with the development of a data loading component that extracts data from external sources, transforms them, cleans them and then loads them into the data store (a relational database and a file store are created where document images are stored). Access to data is carried out through the interagency electronic interaction system SMEV 4 through regulated requests to the tables of data marts. The built monitoring subsystem allows responsible employees of the ministry to monitor the work of data marts, obtain statistics, and promptly respond to possible failures. The specified subsystem ensures completeness, consistency and connectivity of data entering the storefronts and allows providing consumers with information that fully corresponds to the data located in the storage facilities of the Electronic Budget GIS.

A feature of the project was the "historical," that is, accumulated for the entire storage period, loading data into data storefronts from the information system of the Ministry of Finance of Russia. Thus, about 3 million documents were uploaded to the data window "Information on agreements (contracts) on the provision of subsidies, budget investments, interbudgetary transfers from the federal budget (budgets of the constituent entities of the Russian Federation, local budgets), interbudgetary transfers, reporting on them," that is, all approved agreements on the provision of subsidies since the implementation of this component in GIIS "Electronic Budget."

The structure of data on data storefronts is quite complex in terms of attributive composition and relationships between database tables: within the framework of the project, more than 100 tables and 2,000 attributes were made to display data on the storefronts of the Ministry of Finance of Russia. Therefore, a database has been created and a data store S3 has been used to make it easier for consumers to access the required information. The relational database stores flat tables that contain data with a basic set of attributes sufficient for analysis, and the S3 data store contains XML files with a full set of attributes for deeper detail with reference to data from the tables. This architectural approach allows data consumers to simplify the analysis of the information received.

In total, about 16 million historical records were uploaded for all data storefronts.