Customers: Zhilstroysberbank ZhSSBK (Otbasy Bank, HCSBK) Almaty; Financial services, investments and auditing Contractors: iT Pro (IT Pro) Product: iT Pro: BI.QubeSecond product: Microsoft SQL Server Third product: Attunity Replicate Project date: 2019/09 - 2020/03
|
Content |
2020: Development and implementation of the Operational Data Processing System (ODS)
The original goal of the project was to optimize time the response of on-line channels. Due to the appeal for data directly ABS to Colvir from Internet bank mobile bank and the response time for the end user was several tens of seconds. Due to continuous replication of data from source systems, and the targeted optimization of ODS response time for on-line channel requests, it was necessary to reduce the response time to several seconds. During the project, the composition of tasks significantly expanded - at ODS it was decided to implement push notifications, operational ones, analytical dashboards and expand the composition of consumer systems.
As a result, the goal of the project was to provide operational access to the data of all systems bank both in terms of obtaining single values for the objects of interest, and the ability to build operational " analysts on the fly."
Project uniqueness
2 aspects make the project unique:
- The narrow distribution of online data processing (ODS) systems in the CIS and the Republic of Kazakhstan in particular. In the Russian Federation, we can talk about about a dozen such projects in a fairly narrow segment - large financial organizations. In the Republic of Kazakhstan, it is known about two similar projects.
- Heterogeneous composition of sources and consumers working on Oracle, MS SQL, PostgreSQL, MySQL DBMS. In addition, ODS data consumption was also implemented through web services.
Implementation features
During the project, it was necessary not only to implement replication from sources, but also to partially transfer the logic of the sources to ODS, while optimizing performance. It was necessary to integrate ODS into the existing IT landscape so that it did not negatively affect existing systems. Including, choose the best replication method to minimize the burden on accounting systems without losing replication speed. To control the correctness of the logic of ODS operation, an extensive set of methods and procedures (more than 100) was implemented, providing automated reconciliation of ODS and accounting systems. Technologically, when developing and filling the ODS data model, the data were combined from different sources, new attributes were created according to conditions, summary representations were formed, intermediate calculation of the results of some complex functions was made and materialization was made, de-publishing was carried out.
Project Description
During the project, data was replicated from 10 source systems on different DBMSs, more than 400 tables in total. Hundreds of stored procedures and dozens of views, more than a hundred web services, were developed, migrated and optimized on ODS. More than 6 OLAP cubes and 11 visual dashboards have been implemented. During the working period, tens of millions of records are replicated for a lag of no more than 10 seconds. Push notifications for 9 different events are sent.
The following results have been achieved for ZhSSB operations:
- In the Internet Bank, the speed of obtaining information during authorization: previously it was up to 40 seconds, now 5-8 seconds;
- Dashboards with operational information are used by more than 1000 employees, they see operational information on deposits, tributaries, including through the agency network;
- Bank accounting systems, such as CRM and real estate portal, receive information from ODS, this gives higher efficiency, and allows you to unnecessarily load ABS.
- On its own infrastructure, ZhSSB has implemented the sending of both operational, event-based, and scheduled, scheduled push notifications.
From the point of view of operational analytics, visual control tools are implemented for:
- Monitoring of waiting times and customer service and monitoring of terminal downtime;
- Monitoring of the network of consultants and monitoring of office service assessments;
- Call center call monitoring, operator performance assessments, video banking operator performance monitoring.
Business users, as the main ones, note the following advantages from the implementation of ODS:
- Improving the quality and efficiency of management decisions;
- Significantly reduce on-line response time;
- Gamification of the process of work of consultants: competitive aspects.
In terms of IT and architecture, it should be noted that:
- New opportunities have emerged through prompt access to information;
- The architecture of the created ODS is completely open and scalable, and allows you to add sources, consumers, new objects to the data model, dashboards, etc.
Therefore, we consider the goal set at the beginning of the project to ensure prompt convenient access to all information of interest, fully achieved.
Project geography
The project is used by all structural units of ZhSSB presented in all regions of the Republic of Kazakhstan. Operational performance analytics is used by several thousand consultants and their managers.