RSS
Логотип
Баннер в шапке 1
Баннер в шапке 2

Modus ETL Enterprise Storage Management

Product
Developers: Modus BI (BiAI Pro)
Last Release Date: 2021/07/21
Technology: BI ^ Data Quality

Content

Main articles:


Modus ETL is a Russian solution designed to manage ETL and Data Quality Management processes. It allows you to collect data from many sources, provides processes for verification, standardization, categorization and transformation of data.

Modus ETL enables you to build and manage enterprise data warehousing on,, DBMS MSSQL PostgreSQL or. Vertica

Provides fast connection of data sources through ready-to-use integrations with 1C, SAP, Oracle, various DBMS, Excel files, and other Web services.

The solution is implemented on the 1C: Enterprise 8.3 platform. Open-source code with the ability to independently modify the product 1C developers.

Works on servers under management OS Windows and. Linux

Modus ETL is included in the unified register of Russian software and is certified "1C: Compatible!."

2021

Add Workflow Interface

In the updated release of Modus ETL 1.5, the Workflow interface appeared, which is a more functional and convenient alternative to setting up script steps in the form of a table. This was announced on July 21, 2021 by Modus BI.

Modus ETL develops in the concept of low-code, which implies the ability to configure ETL operations in the visual interface without the need to write code.

The WorkFlow interface allows you to design data processing scenarios:

  • placing the steps on the canvas and linking the steps to each other to transmit data and/or control between the steps;
  • setting up data processing rules for the step using ready-made templates (wizards) and rules for collecting statistics and checking data quality.
  • when the execution script is started, the interface displays the execution of the script, saves the execution log and data statistics for later analysis.

In addition, the data processing script steps can be executed in parallel, allowing for flexibility of configuration and greater performance.

Example of parallel execution of script steps in Workflow:

Also, Modus ETL 1.5 implemented an updated application design: color styles were changed and the interface was significantly redesigned for greater usability.

Key Data Quality Management Capabilities

  • Regulatory Reference Information Management
  • reporting in reference terms
  • transforming primary data into a target model
  • calculation of key performance indicators

Modus ETL Data Warehouse Management
Modus ETL Architecture

2017

Certificate "1C: Compatible!"

In 2017, the product "Modus: Enterprise Data Warehouse Management (ETL)" received a certificate "Compatible! Program system 1C: Enterprise. "

Features and capabilities of the program

Modus: Enterprise Data Warehouse Management (ETL) is designed to build and manage an enterprise data warehouse (CCD), automated data collection from various data sources, including data quality management tools.


(Data are current as of April 2017)

Data Collection Management:

  • Using "1C: Enterprise" as a source (including 1C: Fresh), database data (MS SQL, Oracle), web services, MS Excel files ;
  • Possible data receivers: external sources "1C: Enterprise," MS SQL databases;
  • The ability to configure and save data collection rules, including settings for a specified data source;
  • Ability to load data into multiple threads (multithreading);
  • Ability to download scheduled data, including visualization of the data download schedule;
  • Ability to visually design a query in SQL 1C/;
  • Ability to visualize the metadata structure of the 1C: Enterprise database;
  • Data Processing Management:
  • Ability to configure data transformation rules - SQL/1C scripts;
  • Ability to store up-to-date data and data change history (data version) in one table;
  • Set up data versioning rules: defining key fields and calculating hash sums;
  • Set up validation and data cleanup rules (use of pre-built templates)
  • Set up data consolidation rules

Other features:

  • The ability to combine data upload rules and data transformation scenarios into packages and set up a schedule for running packages;
  • Data loading and transformation process logic subsystem;
  • The ability to notify by e-mail of system events;
  • The ability to write an arbitrary algorithm (AddOn) when loading and processing data;
  • Plug-in connectivity for data processing processes;
  • By implementing the Data Analyst (WS Analytics) workplace system.

Handisoft: Enterprise Data Warehouse Management (ETL) is not a standalone configuration, it requires an installed 1C : Enterprise 8.3 platform (version 8.3.8 or later).

The configuration "HandySoft: Enterprise Data Warehouse Management (ETL)" was developed using the functionality "1C: Libraries of standard subsystems."