Edinburgh Research Explorer

Right-sizing Server Capacity Headroom for Global Online Services

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Related Edinburgh Organisations

Open Access permissions

Open

Documents

https://ieeexplore.ieee.org/document/8416332
Original languageEnglish
Title of host publication2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS)
Place of PublicationVienna, Austria
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages645-659
Number of pages15
ISBN (Electronic)978-1-5386-6871-9
ISBN (Print)978-1-5386-6872-6
DOIs
Publication statusPublished - 23 Jul 2018
Event38th IEEE International Conference on Distributed Computing Systems - Vienna, Austria
Duration: 2 Jul 20185 Jul 2018
http://icdcs2018.ocg.at/

Conference

Conference38th IEEE International Conference on Distributed Computing Systems
Abbreviated titleICDCS 2018
CountryAustria
CityVienna
Period2/07/185/07/18
Internet address

Abstract

We present a capacity planning case study showing a significant opportunity for improving the utilization of a large, low-latency, highly available online service containing 100K+ servers spanning 9 geographic regions. Analyzing 30 PB of traces over 90 days we devised a new iterative black-box capacity planning model using the discovered relationships between workload, utilization, and quality. We verified the model on 1,000s of servers showing capacity reductions between 20% and 40% with effectively no impact on workload latency, availability, or the capacity required for disaster recovery. These results are confirmed experimentally by shrinking production server pools to cause the remaining servers to run at higher utilization, and using data from real-world large scale unplanned failures. Finally, we show examples of using our model for offline regression analysis to detect critical issues before their deployment.

Event

38th IEEE International Conference on Distributed Computing Systems

2/07/185/07/18

Vienna, Austria

Event: Conference

Download statistics

No data available

ID: 57260499