Hortonworks Data Platform (HDP)

2017: Integration with IBM storages

On March 16, 2017 IBM also Hortonworks announced work on availability of the Hortonworks Data Platform platform to solutions IBM Elastic Storage Server (ESS) and IBM Spectrum Scale. The reached agreement will lead to certification of Hortonworks HDP on Power and Hortonworks HDP processors based on x86 with the solution IBM Spectrum Scale.

Availability of Hortonworks HDP on POWER8 platform for customers of IBM provided a wide choice at determination of the platform for the Hadoop distribution kit. The agreement will allow them to attract investments into storage systems of IBM for deployment of applications on processing of Big Data based on Hadoop. Besides, under the agreement the existing users of Hortonworks HDP will get access to the alternative solution of a corporate system of storage for workloads of Hadoop and Spark – IBM Spectrum Scale.

Representation of interaction of IBM Spectrum Scale, (2017)

The agreement presents a service package of IBM Storage and the corporate solution of Software Defined Storage certified for Hortonworks.

Certification of HDP will lead to growth of trust to the platform among potential customers of IBM. Users will have an opportunity to operate applications of Hadoop using programmatically the defined solutions for information storage. Customers of IBM will be able to use corporate storage, analytical applications of Hortonworks for data processing. Having selected the centralized or distributed architecture of deployment, the organization will be able to increase business performance using data management, backup, information security and the systems of hybrid cloud data storage.

Each organization becomes digital. Thanks to this agreement IBM will submit the powerful platform, both for expansion of scales of use of data, and for cognitive applications. This start shows to our partners commitment of IBM to assistance to growth and business development of customers and also to simplification of their transformation in questions of use of the available data. Ad Walsh, head of IBM Storage and Software Defined Infrastructure

This agreement develops our relations with IBM and supports invariable focus of the company on the value of the client and conducting successful business. Thanks to examination of Hortonworks and technology of storage of IBM the certified offers will help users to accelerate implementation of modern applications for data processing. Chris Sullivan, senior vice president of the Global Channels and Alliances direction of Hortonworks company

The main HDP properties for IBM Elastic Storage Server (ESS) and IBM Spectrum Scale:

• efficiency of storage – unlike HDFS which creates three copies of each unit of data IBM ESS uses the code of redundancy, eliminating need of creation of a set of copies and increasing profitability of storage.
• the hybrid storage allows to expand storage on the local systems using a cloud and offers a set of benefits due to economy, safety features, availability.
• performance – as an optimal, parallel solution of storage of ESS has performance.

2016: Hortonworks Data Platform 2.5

In August the Hortonworks company offered Hortonworks Data Platform 2.5, based on Hadoop with a set of expansions from deep data analysis and access control to data to security and the complete management of data.

Apache Atlas for the management of data and Apache Ranger (the security technology using dynamic classification) are integrated into new HDP 2.5; also the latest Apache Ambari technology which simplifies installation, the protected configuring, administration and support of HDP is included.

2014: Hortonworks Data Platform 2.1

In April, 2014 the company released the new version of the Hadoop distribution kit, having added new technology of SQL queries to increase the speed and scale of requests to Hadoop. Hortonworks Data Platform 2.1 includes Apache Hive 0.13, a fruit of an initiative of "Stinger" of the Apache Software Foundation group aiming to accelerate accomplishment of SQL queries and to give opportunities of interactive requests in scale petabyte.

HDP 2.1 introduces also Apache Falcon technology for improvement of integrated management of data within Hadoop, Apache Knox technology for defense of perimeter, the mechanism of processing Apache Storm for improvement of stream processing in real time and search Apache Solr technology.