Developers: | RedSys (Redsis) |
Technology: | BI |
Rapid information technology development which concerns as information space and personal devices of users, and production and infrastructure generates increasing number of information, both user, and technical. Data, from social networks and the websites, from sensors – in the majority of the industries amounts of data demand serious approach to their storage, processing and use from devices of users. Production and petrogas the sector power retail banks distribution, public institutions – all these industries need review of a paradigm of use of more and more increasing amount of data.
At the same time data become not just a set of information, but also an asset which on the one hand requires resources on the contents, with another – the most effective use.
Features of such data are:
- Large volumes of storage (tens and hundreds terabyte and above);
- The big entering flows (hundreds and more than a megabytes daily);
- Heterogeneity of information (texts, audio, video, graphics, e-mails).
Existence of any of these three factors leads to existence in the organization of the term Big Data. Storage and processing of such data cannot be performed by classical DBMS fully. Work with Big Data of classical DBMS has shortcomings:
- the cost of use of licenses softwares will be rather high – as a rule pricing is connected with amounts of data;
- search of necessary information and difficult calculations at large volumes in relational DBMS are complicated;
- from the moment of emergence of information until its receiving, the analysis and decision-making there passes a lot of time;
- the powerful equipment is required;
- permanent increase in information volume requires proportional increase in costs for its storage and processing.
RedSys offers tool kit for storage and processing of large volumes of information. The tool kit includes products of the known vendors, products for the solution of specialized tasks and products with the open code.
It is possible to carry to solutions of the known vendors:
- program-hardware complexes IBM Netezza Oracle Exadata SAP ;
- specialized solutions, for example, for distribution and an oil and gas sector – WeDo Technologies (experience VimpelCom), KadMe;
- the systems of search and the analysis of diverse information based on the product HP Idol (experience of REA).
As an alternative RedSys suggests to use technologies of a distributed database on the basis of the platform with the open code Hadoop (the project in Rostelecom). Such solution has impressive advantages:
- it is constructed of a large number (to tens of thousands) nodes, on the basis of rather cheap equipment;
- each node is the server and storages and data processings;
- data processing is conducted in the massive and parallel mode;
- an opportunity to obtain necessary information in the online mode;
- data are stored in several copies (usually in three) and failure of a node or does not conduct two to data loss;
- a system is almost beyond all bounds scaled.
If the organization is not ready to resolute actions yet, Redsis are ready to optimize the existing storage system and reportings (experience of RPF).
Correctly processed and stored data are a basis for the further analysis and predictive analytics.
The systems of analytics and visualization are provided by a wide line of both import, and domestic goods: QlikView, Tableau, Prognoz Platform, Oracle, IBM Cognos, BI SAP BO. They will allow to keep track quickly of the state of affairs in the company, to carry out the plan-fact analysis.
The systems of predictive analytics are provided by a line of the import software (IBM SPSS, IBM Ilog, SAS), the Russian software (Prognoz Platform), own development (RS: Reliability), software of open access (R, Python). They allow to prevent breakdowns of the equipment, to increase efficiency of work with clients and suppliers.