Main articles:

• Hyper-Converged Infrastructure (HCI)
• Supercomputers

Supercomputer Govorun is a hyperconvergent complex for high-performance computing with 100% liquid cooling.

2022: Supercomputer Applications

According to information as of April 2022, computational resources SHD supercomputer and Govorun are used to accelerate complex theoretical and experimental research in the field of high-energy physics, nuclear physics and condensed media physics, including for the implementation of the NICA megaproject for the creation JINR of an acceleration complex on the basis of a special state of matter in laboratory conditions, in which our universe was in the first moments after the Big Bang - quark-gluon plasma. The implementation of this mega project began in 2013, the commissioning of the acceleration complex is planned to be carried out in 2022.

2020: 11th line in the Top50 ranking of the most powerful supercomputers in Russia and the CIS

On March 31, 2020, the 32 edition of the Top50 rating of the most powerful supercomputers in Russia and the CIS became known. Hyperconvergent supercomputer "Govorun" takes 11th position. More details here.

2019: Theoretical Peak Performance - 860 Double Precision Flops

In 2019 supercomputer JINR , it was modernized. The updated system has a combined theoretical peak performance of 860 TFLOPS of double accuracy, while being a hyperconvergent software-defined system.

The use of a hyperconvergent approach made it possible to create supercomputer a high-speed for Govorun - Storage System the speed of a parallel file system for reading/writing information exceeds 300 GB/s. The achievement of such indicators was made possible only due to the introduction of integrated software and hardware solutions, PCK since the use of standard technologies for building stand-alone SHD ones would require a ten times more expensive solution.

The introduced on-demand storage solution allows the Govorun supercomputer to generate a specific storage system for each task running on the supercomputer with the required properties, such as (volume and speed, file system type, lifetime, reliability and security level), which would also be impossible if the standard approach to building storage for high-performance computing systems.

2018

The results of operation of the first stage of the supercomputer

The operation of the first stage of the N.N. Govorun supercomputer made it possible to conduct a number of complex resource-intensive calculations in the field of quantum chromodynamics on lattices to study the properties of hadron matter at high energy density and baryon charge and in the presence of super-strong electromagnetic fields, qualitatively increase the speed of simulation of collision dynamics of relativistic heavy ions, made it possible to accelerate the process of generation and reconstruction of events for experiments in the NICA framework project, carry out calculations of radiation safety of experimental installations, significantly accelerate research in the field of radiation biology and other scientific and applied problems solved in the NPS. The results of these scientific studies have been published in more than 50 leading world scientific publications.

Performance, Architecture, Purpose

According to information for March 2018, the supercomputer JINR named after N.N. Govoruna is a heterogeneous system with a theoretical peak performance of about 1 Pflops, which is located in the Laboratory of Information Technology (LIT) of the Joint Institute for Nuclear Research (JINR) in Dubna near Moscow.

Architecture

The supercomputer consists of two parts. The first part is formed from modules created by a Russian company PCK on the basis of. processors Intel Universal computing cabinets "" with RSK Tornado high energy density and a precision liquid cooling system balanced for constant operation with a high-temperature coolant (up to + 63 ° C at the entrance to the computing cabinet) are installed. In accordance with the conditions of equipment placement for NPF, the optimal operation mode of the computing cabinet was chosen at a constant coolant temperature of + 45 ° C at the entrance to the computing units (with a peak value of up to + 57 ° C).

There are 40 2-processor servers based on Intel Skylake (Intel Xeon Gold 6154) and 20 servers based on Intel Xeon Phi 7290.

The second part of the supercomputer consists of Nvidia Volta graphics processors and is designed to solve problems related to artificial intelligence and machine learning.

The "" -based management and monitoring system ON RCS BASIS provides availability, fault tolerance, and ease-of-use computing based on high-performance computing DCS solutions. It allows you to manage both individual nodes and the entire solution, including infrastructure components. All elements of the complex (computing units, power supplies, hydroregulation modules, etc.) have an integrated control module, which provides wide opportunities for detailed telemetry.

The cabinet design allows you to replace computing units, power supplies and hydroregulation units (provided that redundancy is applied) in hot-swap mode without interrupting the system operability. Most system components (such as compute nodes, power supplies, network and infrastructure components, etc.) are software-defined components that simplify and accelerate both initial deployment and maintenance, as well as subsequent system upgrades.

The main feature of the system, according to the scientific secretary of the LIT Dmitry Podgayny, is that it is a heterogeneous system, while homogeneous ones are mainly used in the world - consisting only of central processors (without accelerators) or processors with accelerators, but of one kind. The JINR supercomputer uses two types of graphics accelerators and processors.

Appointment

The project aims to radically accelerate complex theoretical and experimental research in the field of particle physics, nuclear physics and condensed medium physics, including the implementation of the NICA acceleration complex, created on the basis of the NPSI to recreate in laboratory conditions the special state of matter in which our Universe was in the first moments after the Big Bang - quark-gluon plasma.

Supercomputer JINR named after N.N. Govorun will allow:

• perform resource-intensive, massive-parallel calculations for solving problems in the field of lattice quantum chromodynamics for studying the properties of hadron matter at high energy density and baryon charge and in the presence of super-strong electromagnetic fields;
• qualitatively increase the efficiency of simulation of collision dynamics of relativistic heavy ions,
• provide ample opportunities to investigate the properties of highly correlated systems in the field of physics of new materials,
• develop and adapt software for the NICA megaproject to advanced computing architectures,
• create a hardware and software environment for high-performance computing and modeling complex scientific tasks,
• Train IT professionals in all necessary areas.

Scientists from other institutions with which the JINR collaborates will also be able to use the supercomputer.^[1]

Start

On March 27, 2018, at the Laboratory of Information Technologies (LIT) of the Joint Institute for Nuclear Research (JINR), a supercomputer was launched, named after the director of the Laboratory of Computer Engineering and Automation of the JINR in 1988-1989. Nikolay Nikolaevich Govorun (corresponding member of the USSR Academy of Sciences, professor, doctor of physical and mathematical sciences), whose name has been inextraced by the international research organization of this intergovernmental information technology since 1966.

The N.N. Govorun JINR supercomputer is a joint project of the N.N. Bogolyubov Laboratory of Theoretical Physics (LTF) and the Laboratory of Information Technology, supported by the Directorate of the JINR. It was implemented with the participation of specialists from the RSK group of companies and Intel Corporation.

According to representatives of the JINR, the supercomputer is a natural development of the heterogeneous platform HybriLIT, while providing a noticeable increase in its performance. The theoretical peak performance of the computing complex is estimated at 1 Pflops in single precision or about 500 Tflops in double precision.

The system includes a high-density energy-efficient solution "RSK Tornado" based on Intel server technologies with direct liquid cooling, developed by specialists of the Russian group of companies RSK. Operation in the "hot water" mode for this solution made it possible to apply the year-round free cooling mode (24x7x365), using only dry cooling towers operating at ambient temperature up to + 50 ° C, as well as completely get rid of the freon circuit and chillers. As a result, the average annual PUE of the system, reflecting the level of energy efficiency, is less than 1.06. Thus, less than 6% of all electricity consumed is spent on cooling, the NPSI said.

The core of the computing nodes were Intel server products: powerful 72-core Intel Xeon Phi 7290 server processors, Intel Xeon Scalable processor family (Intel Xeon Gold 6154), Intel Server Board S7200AP and Intel Server Board S2600BP, Intel SSD DC S3520 family SSD with SATA in M.2 form factor and Intel SSD DC BV1 high-speed SSD with NV1 interface

The Intel Omni-Path Advanced Switching Technology is now used for high-speed data transfer between compute nodes in the NPSI supercomputer complex. providing up to 100 Gb/s of non-locked switching speed, based on the 48-port Intel Omni-Path Edge Switch 100 Series with 100% liquid cooling that, according to representatives of the JINR, provides high efficiency of the cooling system in hot water mode and low total cost of ownership of the system.

The installation and launch of the heterogeneous supercomputer named after Nikolay Nikolaevich Govorun in the LIT JINR was carried out in the year of the 60th anniversary since the start of operation of the first Ural-1 computer at our institute in 1958. Now our scientists and research teams have at their disposal a powerful tool that will radically accelerate comprehensive theoretical and experimental research in the field of nuclear physics and condensed medium physics, "commented Vladimir Vasilievich Korenkov, director of the JINR Information Technology Laboratory.

Notes