Swarm64 Hybrid Transaction Acceleration Processing

2020

Representation of Hybrid Transaction Acceleration Processing

On February 11, 2020 it became known that the company Swarm64 provided to Russia the solution Hybrid Transaction Acceleration Processing with support of a programmable accelerator Intel of Arria 10 FPGA for acceleration DBMS of page open code PostgreSQL. The company showed 80-fold performance improvement of a system with an accelerator in benchmarks of TPC-H and gave an example of acceleration of high-frequency operations on the stock exchange, received using this solution.

The solution Hybrid Transaction Acceleration Processing (HTAP) is based on use of the Intel® Arria® 10 FPGA accelerator which undertakes structurization of data arrays and complex calculations, such as time series analysis and search queries using meta characters. At the same time computing powers of server processors are released, and CPU gets access to already created results. Such optimization increases performance of the operating infrastructure and allows to expand the computing capacity of DPCs without increase in number of servers.

In TPC-H benchmark imitating the high-loaded scenarios of work of DBMS, for example high-frequency trade at the exchange, execution of "heavy" requests (Q6) in PostgreSQL in the set temporary interval without the termination of transactions and at 25-35 times – writing rate was succeeded to accelerate the companies by 80 times. Results were received on the HPE ProLiant DL380 server based on the Intel Xeon processors Gold 8268 c by use of a fixed memory of Intel Optane DC and NVMe SSD. The combination in use of PLIS accelerating reading and data analysis, and a fixed memory of Intel Optane in the AppDirect mode allowed to keep high-frequency record in the database in parallel with transaction and analytical transactions.

In the solution Swarm64 Data Accelerator allowed to maintain writing rate of trade operations at the level of 12 million transactions per minute and, at the same time, accomplishment of 5000 analytical operations per second on the basis of the data available to the analysis. Trading data registered in a format of tables Postgres in a fixed memory of Intel Optane DC in the App Direct mode. In parallel reading, change and rewriting of information in the analytical tables Swarm64 optimized for hardware acceleration on Intel Arria 10 FPGA was continuously performed.

Solution potential big. The accelerator on FPGA can be used in banking sector, industrial Internet of Things (performance is sufficient for Real-time of analytics), retail, medicine to the analysis of arrays of laboratory and statistical data and also in science, for example, in astrophysics, studying accumulations of galaxies and working with data arrays in hundreds terabyte, considers Mikhail Tsvetkov, the technical director of Intel in Russia

System configuration

Data are relevant for February, 2020

• HPE ProLiant DL380:
• 2* Xeon Gold 8268 (2.9GHz/24-core/205W)Intel
• 12*32GB RDIM-2666
• 12*128GB Intel Optane DCPMM DIMMs (100% in App Direct mode)
• 1*Intel Arria 10 PAC
• 2*200GB (for OS) SATA SSD
• 2*3.2TB NVMe SSD ∙ OS – RHEL 7.7