RT.Streaming Data Transport and Conversion Tool

The main articles are:

• Data management
• ETL (Extract Transform Load)

RT.Streaming import-independent is a tool for transporting and converting data. The product allows you to unload, process and load data in such a way as to minimize the load on both sources and other storage receiver system.

2022: Opportunities and Features

As of July 2022, RT.Streaming allows:

• work with different technologies of sources and receivers (from relational databases to streaming data);
• load data in different ways event (real time), batch (according to the regulations), near realtime
• automate data retrieval in the desired format with scheduled transformations using different conditions and customizable business logic
• connect to the source system according to the configured rules at times of low load
• store data before shipment to the receiver system

RT.Streaming includes 3 open-source components for solving ETL problems:

• Kafka - working with streaming data, data buffering, support for several download sources at the same time;
• NiFi - visual interface, loading data in batch and streaming modes;
• AirFLow - working on a schedule, configuring complex processes and algorithms.

Combining multiple tools into a single product allows you to solve any data upload/conversion and upload tasks, regardless of which systems are in the company and which tasks are being solved.

Among the features of the product, the developers noted the following:

• 1. Import-independent product registered in the register of domestic software;
• 2. Use of a secure repository with source code and support for domestic operating systems;
• 3. Automation of service functions: installation, configuration of the cluster, monitoring of health and incident resolution (mechanisms for administration and problem solving);
• 4. Support in 24x7 mode. Geographically distributed support team and full set of technical and operational documentation in Russian;
• 5. Flexibility of use. The product is available in two options: cloud and on-premieses;
• 6. User-friendly interface. Simple organization of development and testing.

RT.Streaming can be useful in any task where it is necessary to automate the processes of loading, converting and uploading data from many sources according to complex algorithms and rules.

The product can be used in conjunction with RT.ClusterManager.