IBM Data Platform

2017

The platform is upgraded

On December 18, 2017 IBM presented solutions of the Watson Data Platform platform, including cataloguing and data scrubbing.

Additions are focused on developers and information processing specialists. They will be able to analyze and prepare corporate data, irrespective of their structure and a location, for use in applications with elements of artificial intelligence. The simplified access and ensuring security policy will allow to be connected and communicate in public and private cloud environments.

IBM expanded functionality of Watson Data Platform, the integrated packet of tools, services and data on the basis of IBM Cloud. The platform allows data processing, developers and business commands specialists to receive valuable data which are most important in their work. Besides, the solution provides the simplified access to such services as machine learning, AI and the analyst.

As a part of expansion:

• Data Catalog and Data Refinery technologies, they integrate information arrays which are stored in different formats in a cloud as in the existing systems, and third-party sources. They also use machine learning for processing and cleaning of these data for implementation in AI-applications.
• an opportunity to use metadata from Data Catalog and Data Refinery for a marking and control of policy of data management of the customer. Thus, working teams can easier identify risks in the course of exchange of confidential information.
• Access to Analytics Engine for separation of the data warehouse from information which is contained in it. Such approach allows to analyze data and to load them into applications with maximum speed. As a result developers and data processing specialists can exchange and use large volumes of information.

Technologies for implementation of AI

At the beginning of November, 2017 IBM provided the technologies for the cognitive Watson — Data Catalog and Data Refinery platform designed to simplify implementation of the artificial intelligence (AI) in the corporate software.^[1]

IBM Watson will simplify implementation of AI in the corporate software

Using the presented solutions which found application in Watson Data Platform, data processing specialists can analyze and prepare information which the companies, for use in AI-applications use. At the same time it is unimportant what structure these data and where they are stored, developers claim.

As explained integrate data of a different format which are placed in a cloud, the local or third-party systems in IBM, Data Catalog and Data Refinery. Thanks to use of mechanisms of machine learning these data are processed and "cleaned" for further implementation in AI programs.

According to forecasts of analysts of IDC, by 2018 about 75% of developers will embed elements of artificial intelligence in the applications. Working in this direction, programmers should solve problems with understanding of data which become complicated and stored in different places. Such data should be processed constantly and safely for normal work of software. The provided technologies of IBM are just intended for the help to developers in accomplishment of such tasks.

2016: Project DataWorks

Project DataWorks is an integration framework of these any types for decision making systems based on AI.

On November 8, 2016 IBM announced Project DataWorks start - the project of the Watson direction representing the first in the industry cloud platform of the processing and data analysis integrating all data types and supporting decision making using artificial intelligence.

Project DataWorks makes easier processes of data collection for heads and information analysis, systematization specialists, management and data security provision. It, in turn, will allow them to receive necessary insights for the purpose of cognitive transformation of business of the companies.

Screenshot of the software window, (2016)

Project DataWorks supports intellectual deployment in IBM Cloud of products on the basis of data with use of machine learning and the Apache Spark platform.

The platform provides a computing environment for joint work in IBM Cloud of specialists in data processing and business users of any profile.

Representatives of business and highly skilled professionals in the field of data processing use untied tools and services for work with data that as a result it is difficult to control, integrate and regulate. And as information is not static, the enterprises should constantly and often manually upgrade the models and products for data processing to receive the most relevant valuable data.

Project DataWorks integrates all data and insights on a single platform. Data processing specialists will be able to work together on the integrated platform in the mode of self-service, exchanging the general data sets and models in the safe mode.

Project DataWorks is available on Bluemix, a cloud platform of IBM Cloud. It will help to review model of joint work of specialists in data processing by means of a number of key innovations, such as Apache Spark, IBM Watson Analytics and IBM Data Science Experience.

Using the project of the organization will be able: automate deployment of data assets and data handling units using cognitive machine learning and Apache Spark; collect data from all sources with a speed from 50 Gbps:

• • corporate databases,
  • Internet of Things,
  • sources of stream transfer,
  • meteorological data
  • social networks;

• it is effective to use an open ecosystem as a part of which more than 20 partners and technologies Confluent, Continuum Analytics, Galvanize, Alation, NumFOCUS, RStudio, Skymind and others.

Project DataWorks relies on basic cognitive capabilities - cognitive machine learning. It allows to accelerate processes, since detection of the models given before deployment, and will help users to receive unavailable to them insights earlier.

We endure a turning point in the field of data processing and analytics. We know that customers spend up to 80% of the time for data preparation, regardless of an assigned task. The same occurs, even when they are ready to take advantage of modern AI and machine learning. Project DataWorks will help to cope with this task, having integrated by means of cognitive opportunities all data sources on a single platform thanks to what users will be able to prepare more quickly data for extraction of insights and decision making. Bob Pichiano, senior vice president of IBM Analytics

The platform is developed on the basis of the approach used by The Weather Company (IBM) company. This approach is intended to help the user to receive the valuable data having an impact on daily decision making both for business, and for buyers. As a part of the platform flexible architecture of data, fast processing of multiple sources of information, including Internet sources.