'Airplane'uses LakeHouse concept to manage data

2024: Building an analytical data platform based on the LakeHouse concept

The Airplane Group built a data analytics platform based on the concept of LakeHouse, the latest generation of architectures that envisions a hybrid data model and combines the virtues of classic DWHs with the flexibility of Data Lake. This solution was implemented in 2024, it is completely built on the open source stack and allows the company to apply the most modern approach to working with Big Data. The company announced this on September 19, 2024.

This concept makes it possible to process data more quickly than other technologies, saving time on additional loading cycles. The architecture and approaches of the LakeHouse concept extend traditional data analytics, combining Data Lake's flexibility with a clear storage structure. This allows you to optimize data capture and transfer pipelines, and within the framework of a single analytical platform, serve both requests for ready-made storefronts and the ability to work directly with cleaned quality data in Data Lake. As of September 2024, more than 120 master systems and data sources were connected to the analytical platform, LakeHouse includes more than 10 thousand objects with the implementation of 300 wide storefronts at ClickHouse.

Aircraft is interested in monetizing data and effectively applies the LakeHouse concept to provide a data-driven approach and put the data value chain into practice. A significant technical advantage of this concept is the isolation of storage from calculations across different clusters, which facilitates scaling. An important aspect for Aircraft is also the ability to process a variety of different types of data, including images, video, audio, JSON structures and text. The LakeHouse architecture allows support for workloads ranging from algorithmic machine learning to SQL queries and distributed computing. They require different implementation technologies, but all rely on one single repository, which allows us to provide a single version of the truth of the data. Thus, the LakeHouse concept perfectly correlates with the ideas of digital transformation and finds effective application in the "Airplane," - said Olga Svitneva, director of the "Airplane" group.

The "airplane" works daily with large data arrays of various types. The specifics of the construction industry initially involve the processing of a large stream of information: financial statements for several dozen legal entities, customer orders with additional functions, sales, forecast and risk assessment, etc.

The use of Big Data provides an opportunity to carry out effective data analytics, apply modern approaches in industrial operation, which in turn allows you to make forecasts, timely change promotion strategies, increase the level of customer service and the quality of services provided by the company.