Abstract / Description of output
Today’s cloud based online services are underpinned by distributed key-value stores (KVS). Such KVS typically use a scale-out architecture, whereby the dataset is partitioned across a pool of servers, each holding a chunk of the dataset in memory and being responsible for serving queries against the chunk. One important performance bottleneck that a KVS design must address is the load imbalance caused by skewed popularity distributions. Despite recent work on skew mitigation, existing approaches offer only limited benefit for high-throughput in-memory KVS deployments. In this paper, we embrace popularity skew as a performance opportunity. Our insight is that aggressively caching popular items at all nodes of the KVS enables both load balance and high throughput – a combination that has eluded previous approaches. We introduce symmetric caching, wherein every server node is provisioned with a small cache that maintains the most popular objects in the dataset. To ensure consistency across the caches, we use high-throughput fully-distributed consistency protocols. A key result of this work is that strong consistency guarantees
(per-key linearizability) need not compromise on performance. In a 9-node RDMA-based rack and with modest write ratios, our prototype design, dubbed ccKVS, achieves 2.2× the throughput of the state-of-the-art KVS while guaranteeing strong consistency.
(per-key linearizability) need not compromise on performance. In a 9-node RDMA-based rack and with modest write ratios, our prototype design, dubbed ccKVS, achieves 2.2× the throughput of the state-of-the-art KVS while guaranteeing strong consistency.
Original language | English |
---|---|
Title of host publication | Proceedings of the Thirteenth EuroSys Conference |
Publisher | ACM |
Number of pages | 15 |
ISBN (Electronic) | 978-1-4503-5584-1 |
DOIs | |
Publication status | Published - 23 Apr 2018 |
Event | European Conference on Computer Systems (EuroSys) - Porto, Portugal Duration: 23 Apr 2018 → 26 Apr 2018 http://eurosys2018.org/ |
Conference
Conference | European Conference on Computer Systems (EuroSys) |
---|---|
Country/Territory | Portugal |
City | Porto |
Period | 23/04/18 → 26/04/18 |
Internet address |