Mail.Ru Cloud Big Data

Main articles:

• Defining Business Intelligence
• Big Data
• Data management
• PaaS - Platform As A Service

Mail.Ru Cloud Big Data is a service within Mail.Ru Cloud Solutions based on Apache Hadoop and Apache Spark, which allows you to take data processing to the cloud. Thanks to this, big data analysis is carried out quickly, and the company saves on the creation and maintenance of infrastructure, according to the Mail.ru Group.

2021: Launch Hadoop 3.0 as an Arenadata-based service

Mail.ru Cloud Solutions July 21, 2021 announced the launch of Hadoop 3.0 as a service based on the Arenata solution.

The service opens up opportunities for working with big data and guarantees security, functionality and high performance. New platform users will be able to test the solution for free within three months.

Hadoop is an open solution for storing and analyzing big data. Based on it, the Mail.ru Cloud Solutions platform provides ready-made assemblies that allow you to quickly create enterprise data warehouses (DWH) and Data Lake up to several PB in volume, as well as extract, convert and load data (ETL) coming from different sources.

Combined with a suite of big data technologies, Data Science and Data Engineer will provide a ready-to-use solution for extracting and analyzing any type of data that will form the basis for predictive models and rapid training of ML models, including high-performance computing (HPC). The provider bears financial guarantees for the availability of the service, is engaged in its administration and updating to the latest versions.

Arenadata Hadoop will become one of components of an ecosystem of cloud services Mail.ru Cloud Solutions for the work with big data focused on requirements of large business. The enterprise version of the solution has more functionality at the level of access policies, as well as high availability: it provides automatic recovery of the cluster after a fall, as well as its auto-scaling as the volume of data grows. An additional advantage of the service on the MCS platform is the support of the Russian developer - the company Arenata.

The platform uses a close-to-open version of Hadoop, which eliminates users' dependence on the vendor. Arenatata Hadoop is based on Hadoop 3.0, which allows you to increase storage efficiency by 50%, provide improved memory for high-load applications and scale to one hundred thousand nodes. Arenata Hadoop is registered in the state register of domestic software.

Arenadata Hadoop Enterprise features serious security settings and high-load functionality, as well as the ability to automatically scale. Companies now do not need to think about whether to connect more disks for storing and processing information: the cluster will automatically expand if necessary, "says Dmitry Lazarenko, product director of Mail.ru Cloud Solutions.

Within the framework of the Arenatata Hadoop solution on the MCS platform, each cluster is charged only by the amount of disk space, the number of cores does not affect the cost of the solution. The user pays according to the Pay-As-You-Go model, which implies payment as resources are consumed. Mail.ru Cloud Solutions and Arenata will advise on migration and complex architectural solutions. In addition, new platform users can get free access to Arenatata Hadoop for three months, leaving an application on the Mail.ru Cloud Big Data solution page.

The advent of the cloud service, which has at its core the latest version of Hadoop, is good news for the market. Such a solution can greatly simplify the lives of development teams and companies specializing in big data analysis and machine learning. We plan to test the service in order to assess the prospects for its use for our projects, "said Rustam Kildiev, technical director of Innodata, a Russian developer of solutions in the field of big data management and customer experience.

In July, 2021 Mail.ru Cloud Solutions declared expansion of cooperation with the Russian developer of the platform of collecting and data storage of Arenadata and opened access to the distributed analytical DBMS with DB Cloud of the version of Enterprise opened kodomarenadata which is also available to the free test for three months. The solution allows you to create an enterprise information store with almost unlimited scalability.

2020: Integration with OnCloud.ru

On December 21, 2020, it became known that Onlanta and the Mail.ru Cloud Solutions platform entered into an agreement on a strategic partnership in the field of multi-cloud services. Company collaboration will allow customers to manage complex infrastructure projects using the resources of providers through a single "entry point" with end-to-end information security and SLA. Users of the cloud service OnCloud.ru now have additional capacities and components of the Mail Cloud Solutions platform: Managed Kubernetes, Database as a Service, IoT platform, Big Data Platform. More details here.

2018: Launch

On July 10, 2018, Mail.ru Group, as part of the Mail.Ru Cloud Solutions infrastructure, introduced a scalable PaaS service for companies that collect and analyze big data - Mail.Ru Cloud Big Data.

As you know, big data analysis allows you to solve a wide range of problems: from credit scoring, analyzing the company's operational activities and distributing the transport load to the search for minerals, conducting research in the field of medicine, sociology, astronomy. However, to efficiently handle large amounts of information, huge computing power is required: many expensive servers that will serve specially hired professionals. Not every business needs its own infrastructure to work with big data.

Mail.Ru Cloud Big Data is an alternative to expensive local big data infrastructure. Instead of purchasing equipment that will be used several hours a week and require constant spending on maintenance, the company can use the cloud infrastructure for rent, Mail.ru Group emphasized.

With Apache Hadoop and Apache Spark open source platforms, you can quickly and accurately process huge amounts of data from heterogeneous sources. So, Hadoop is optimal for indexing websites, research (data lake). In turn, Spark - for streaming and real-time data analysis: segmentation of site visitors, fraud detection, transport monitoring.

If necessary, compute resources scale from a pair of servers to hundreds and back in a few minutes. At the same time, the company pays only for those resources that it consumes: Mail.Ru Cloud Big Data has a second-by-second charging.

At the same time, there is a private network with Hadoop components and other services in the client IT system to create a hybrid cloud, as well as migrating applications for Hadoop from the Amazon and Azure cloud without changing the code.

According to the developers, Mail.Ru Cloud Big Data offers are designed to provide a cloud platform where any company can create its own infrastructure and solve resource-intensive tasks for data analysis in enterprise applications, indexing sites, financial analysis, scientific research and computing, as well as machine learning.