Multipetabyte DWH on the basis of software of Raidix is implemented in the Center of computing sciences of RIKEN institute
Customers: RIKEN (Rikagaku Kenkyūsho) Contractors: Raidix, Core Micro Systems Product: Raidix DWHProject date: 2017/01 - 2018/10
|
Content |
2018: Increase in total amount of memory of DWH
On November 27, 2018 the Raidix company reported that in the Center of computing sciences of RIKEN institute (Japan) multipetabyte DWH on the basis of Raidix software is implemented. The total volume of DWH is 65 PB, including 51.4 PB of useful memory.
The project was implemented in partnership with Core Micro Systems company and consists of 11 clusters of high availability which involve 6,512 disks on 10 TB everyone. A system stores data of high-performance computing infrastructure of HPCI (High Performance Computing Infrastructure) based on SINET (The Science Information Network) — a backbone network for exchange of scientific data between the Japanese universities and scientific centers. For November, 2018 SINET integrates about 850 institutes and the universities, creating great opportunities for information exchange in researches which mention nuclear physics, astronomy, geodesy, seismology and computer sciences.
System deployment was separated into two stages and was executed by engineers of Core Micro Systems who gradually increased the volume of DWH. The first phase of implementation was complete in August, 2017 when capacity reached 18 PB, the second phase was complete in October with increase in total amount of memory of DWH to 51 PB. Active project stage took 12 months of joint work of Core Micro Systems and a command of Raidix; system testing and observation of its effectiveness the next 12 months proceeded.
Technical requirements provided high access rate to data and a preset value of net volume of DWH that is necessary for full functioning of computing environment. Results of testings completely matched project values. The command of Raidix constructed the scalable DWH joint with the Gfarm file system, and added functional characteristics of software.
The solution for data storage, according to integrator, will allow to use effectively possibilities of computing environment for solving of tasks in the knowledge-intensive industries.
2017: Implementation of DWH
On April 6, 2017 the Raidix company announced data storage system implementation for high-performance computing in the Japanese institute of the physical and chemical researches RIKEN (Rikagaku Kenkytssho).
Project Progress
DWH based on Raidix HPC technology provided reliable infrastructure for resource-intensive researches and flexibility of expansion of a system in a type of the growing amounts of data.
Within the project engineers of Raidix turned on function of automatic write-through in the software. Using this functionality Raidix performs write-through bypassing a cache, thereby reducing risk of data loss and degradation of performance in the high-loaded systems.
The intellectual algorithm is automatically applied to consecutive loadings while data of accidental record are forwarded to a cache. Write-through allows to increase the speed of work with information in the field of HPC more than by 30%.