IBM InfoSphere DataStage

IBM InfoSphere DataStage allows to integrate large volumes of data between numerous data sources and target applications. IBM InfoSphere DataStage represents the main module of an integration framework of data InfoSphere Information Server which supports universal data access of a local network, cloud infrastructure, a mobile network and also to the structured and unstructured data. Use of the solution Huawei FusionInsight implemented based on Hadoop, Oozie, and other solutions for work with Big Data together with IBM InfoSphere DataStage helps the enterprises to maximize business value using technology of Big Data.

The product IBM InfoSphere DataStage supports extraction, conversion and transfer of large volumes of data which can have both simple, and very complex structure. DataStage is capable to work as with the data arriving at the moment time and with the data which arrived earlier on a regular or planned basis. DataStage allows the companies to solve large-scale business challenges, thanks to a possibility of high-performance processing of large volumes of data.

Taking into account need of processing of continuously growing amounts of data, processing in severe conditions of real time and batch processing at constantly reduced temporary windows, DataStage uses possibilities of side-by-side execution of tasks and with ease is scaled with the broad range of hardware platforms: from systems with symmetric multiprocessing (SMP) and SMP clusters to servers with hundreds of processors and support of architecture of calculations with mass parallelism (MPP). At increase in number of processors or servers, it is not required to recompile tasks, at the same time are reconfigured only a few lines in the file.

DataStage supports almost unlimited number of diverse data sources and direct systems in a uniform task, including:

• Text files
• Difficult structured XML-data
• Enterprise level business systems from the companies SAP Siebel Oracle, {{PeopleSoft]]
• Practically any DBMS, including management systems for partitioned databases (which contents are physically separated between different computers), such as Oracle, IBM DB2 UniversalDatabase (with function of separation of data and without it), IBM Informix, Sybase, Teradata and the Microsoft SQL Server
• Web services
• Applications from different suppliers of BI applications
• The software for message handling and integration of corporate applications, including InfoSphere MQ and other products

2015: The solution IBM InfoSphere DataStage underwent certification of Huawei on compatibility with Big Data

On March 26, 2015 Huawei announced that the solution IBM InfoSphere DataStage received ^[1] after integration and testing for compatibility with the solution Huawei FusionInsight. The result showed that customers can implement solutions for work with Big Data with the minimum efforts by integration of the solutions Huawei FusionInsight and IBM InfoSphere DataStage now.

Notes