| Title |
D-RDMALib: InfiniBand-based RDMA Library for Distributed Cluster Applications |
| Authors |
(Laewon Jeong) ; (Myeong-Seon Gil) ; (Yang-Sae Moon) |
| DOI |
https://doi.org/10.5573/JSTS.2023.23.6.341 |
| Keywords |
InfiniBand; remote direct memory access; high-speed distributed processing; distributed cluster; big data processing |
| Abstract |
RDMA (Remote Direct Memory Access) is a recent communication protocol that allows for the maximum utilization of the performance of InfiniBand, a high-speed network device based on Data Processing Units (DPUs). However, the existing RDMA development method incurs a high implementation complexity, which makes it difficult to apply to a multi-node environment. To solve these problems, we propose D-RDMALib, an efficient and easy-to-use RDMA library suitable for distributed cluster environments. As an effective development tool, D-RDMALib can reduce the implementation difficulty of applying RDMA to distributed multi-node environments. It also improves the accessibility of InfiniBand and RDMA technologies with high entry barriers. In this paper, we demonstrate the efficiency of D-RDMALib by 1) verifying the successful operation of many-to-many communication in distributed nodes, and 2) evaluating the performance by implementing PageRank-based on D-RDMALib. We believe that our work is a novel technique that can be easily applied to existing distributed processing environments as well as to emerging ultra-high-speed in-network technologies such as Quantum InfiniBand. |