Eurasian Bank (Kazakhstan) (ATI Pro: BI.Qube)

2018: Creating an Operational Data Warehouse (ODS)

Realizing the value of quick decisions, as well as the need for consolidation data from existing sources in a mode close to real time for use by channels, remote maintenance"" Eurasian Bank decided to add information operational (ODS) to the system architecture. data warehouse

Based on the results of the analysis producers and ODS platform providers, the platforms were selected In-memory MS SQL Server as DBMS having almost linear scalability and able to withstand high transactional loads, and, Attunity Replicate as a replication service, data allowing, without creating an additional load, to reflect all changes occurring on the source systems to the target data warehouse. IT Pro experts have carried out a full cycle of work, ranging from deploying platforms, configuring source systems and implementing replication tasks that deliver data to ODS with the necessary transformations and minimal delay, to fine-tuning the target architecture to maximize the performance of typical types of requests in multithreaded mode.

As a result, all the target criteria for the success of this project were achieved:

• Using direct reading of ORACLE logs to reduce the load on source DBMSs
• direct replication of PostgreSQL without the use of intermediate databases;
• Data transformation during replication with minimal latency
• Replication of data to SQL Server 2016 tables hosted in RAM
• using In-Memory Range & Hash - Indexes to speed up specific requests of consumer systems;
• Store change history using Temporal Tables.

The resulting solution shows a high data refresh rate and client query performance. Time-sensitive tasks to be solved:

• consolidate information from the ABS and front office in a few seconds;
• create a financial profile of the client at the request of the call center operator;
• In close to on-line mode, track changes in object statuses (requisitions, limits, delays, etc.)
• provide a source of operational information to the security service and the anti-fraud system.