NetApp Spot Wave

Main article: IT Service Management (ITSM)

Wave simplifies and automates the cloud infrastructure for Spark with Kubernetes as a scheduler. From installation and configuration to provisioning, management and dismantling, Wave uses the artificial intelligence-based Spot engine to continuously optimize Spark clusters, choosing the best infrastructure for an application based on its real-time requirements.

2021: Launch Spot Wave

On March 18, 2021, NetApp, an international manufacturer of cloud data management software, announced the launch of a Spot Wave solution based on NetApp technologies, as well as support for Microsoft Azure based on Kubernetes using the Spot Ocean solution. Together, these products offer customers solutions to create an even simpler, scalable, and more efficient infrastructure for cloud applications.

Wave automatically creates, deploys, scales, and optimizes cloud applications based on Apache Spark and Kubernetes, helping reduce infrastructure and cloud debris costs by 90%. Companies using Wave as a key product will be able to even more quickly and conveniently deploy the environment for Spark applications, as well as pay more attention to the use of data. At the same time, Wave will ensure the constant optimization of their infrastructure in terms of volume, performance and cost.

The Wave, which is based on Spot artificial intelligence, uses the same proven technology as Spot Ocean. Wave Features:

• Value optimization. Wave enables Spark jobs to run in a container-based infrastructure using intelligent spot, requested, and protected instances. This enables customers to reduce the cost of cloud infrastructure by 90%.
• Server-free infrastructure and automatic scaling. The built-in auto-scaling feature helps you match the size and volume of your Spark calculation to your workload requirements. This increases application performance and efficiency.
• Set up calculations in Spark and monitor. Wave can continuously change the Spark configuration for certain calculations, based on an analysis of Spark requirements.

Companies are rapidly introducing Kubernetes to make cloud applications even faster and more flexible, both for individual services and applications that work with big data, "said Amiram Shachar, vice president and CEO of Spot by NetApp. - Ensuring the optimal cost, performance and volume of infrastructure for its efficient operation takes companies a lot of resources and time. Spot Wave and Ocean solutions solve this problem by offering a server-free experience based on Spark, which ensures continuous optimization of the infrastructure.

NetApp also announces that Ocean, Spot's unsure container solution that underpins Spot Wave, will now support the Microsoft Azure Kubernetes Service (AKS). Previously, Ocean supported the AWS ECS (Elastic Container Service), EKS (Elastic Kubernetes Service) and Google's GKE (Google Kubernetes Engine) services.

Wave takes advantage of the opportunities that we like at Ocean, which allows it to pay special attention to the work of applications with big data, "says Gal Aviv, technical director of Fyber. - Integration of Spark applications into Wave offers many possibilities. This solution is valuable in that it allows you to perform calculations using existing tools and contributes to the creation of the necessary infrastructure for the operation of heavy ML applications.

NetApp and Spot by NetApp have extensive experience with Kubernetes and interaction with the Kubernetes community. With its investment in NetApp and Spot by NetApp in Kubernetes, NetApp offers solutions and capabilities to create the application-centric infrastructure and data management that companies need to run critical cloud applications.