Abstract
Get/Put Key-Value Stores (KVSes) rely on replication protocols to enforce consistency and guarantee availability. Today’s modern hardware, with manycore servers and RDMA-capable networks, challenges the conventional wisdom on protocol design. In this paper, we investigate the impact of modern hardware on the performance of strongly-consistent replication protocols.
First, we create an informal taxonomy of replication protocols, based on which we carefully select 10 protocols for analysis. Secondly, we present Odyssey, a framework tailored towards protocol implementation for multi-threaded, RDMA-enabled, in-memory, replicated KVSes. We implement all 10 protocols over Odyssey, and perform the first apples-to-apples comparison of replication protocols over modern hardware.
Our comparison characterizes the protocol design space, revealing the performance capabilities of different classes of protocols on modern hardware. Among other things, our results demonstrate that some of the protocols that were efficient in yesterday’s hardware are not so today because they cannot take advantage of the abundant parallelism and fast networking present in modern hardware. Conversely, some protocols that were inefficient in yesterday’s hardware are very attractive today. We distill our findings in a concise set of general guidelines and recommendations for protocol selection and design in the era of modern hardware.
First, we create an informal taxonomy of replication protocols, based on which we carefully select 10 protocols for analysis. Secondly, we present Odyssey, a framework tailored towards protocol implementation for multi-threaded, RDMA-enabled, in-memory, replicated KVSes. We implement all 10 protocols over Odyssey, and perform the first apples-to-apples comparison of replication protocols over modern hardware.
Our comparison characterizes the protocol design space, revealing the performance capabilities of different classes of protocols on modern hardware. Among other things, our results demonstrate that some of the protocols that were efficient in yesterday’s hardware are not so today because they cannot take advantage of the abundant parallelism and fast networking present in modern hardware. Conversely, some protocols that were inefficient in yesterday’s hardware are very attractive today. We distill our findings in a concise set of general guidelines and recommendations for protocol selection and design in the era of modern hardware.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 16th European Conference on Computer Systems EuroSys'21 |
| Publisher | Association for Computing Machinery (ACM) |
| Pages | 245–260 |
| Number of pages | 16 |
| ISBN (Print) | 9781450383349 |
| DOIs | |
| Publication status | Published - 21 Apr 2021 |
| Event | 16th ACM EuroSys Conference on Computer Systems - Virtual Conference, Edinburgh, United Kingdom Duration: 26 Apr 2021 → 28 Apr 2021 https://2021.eurosys.org/ |
Conference
| Conference | 16th ACM EuroSys Conference on Computer Systems |
|---|---|
| Abbreviated title | EuroSys 2021 |
| Country/Territory | United Kingdom |
| City | Edinburgh |
| Period | 26/04/21 → 28/04/21 |
| Internet address |
Keywords
- Fault-tolerant
- Replication
- Consistency
- Availability
- Throughput
- Latency
- Linearizability
- RDMA