Fine-grained latency and loss measurements in the presence of reordering

Myungjin Lee, Sharon Goldberg, Ramana Rao Kompella, George Varghese

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Modern trading and cluster applications require microsecond latencies and almost no losses in data centers. This paper introduces an algorithm called FineComb that can estimate fine-grain end-to-end loss and latency measurements between edge routers in these data center networks. Such a mechanism can allow managers to distinguish between latencies and loss singularities caused by servers and those caused by the network. Compared to prior work, such as Lossy Difference Aggregator (LDA), that focused on switch-level latency measurements, the requirement of end-to-end latency measurements introduces the challenge of reordering that occurs commonly in IP networks due to churn. The problem is even more acute in switches across data center networks that employ multipath routing algorithms to exploit the inherent path diversity. Without proper care, a loss estimation algorithm can confound loss and reordering; further, any attempt to aggregate delay estimates in the presence of reordering results in severe errors. FineComb deals with these problems using order-agnostic packet digests and a simple new idea we call stash recovery. Our evaluation demonstrates that FineComb can provide orders of magnitude better accuracy in loss and delay estimates in the presence of reordering compared to LDA.
Original languageEnglish
Title of host publicationProceedings of the ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
PublisherACM
Pages329-340
Number of pages12
ISBN (Print)978-1-4503-0814-4
DOIs
Publication statusPublished - 1 Jun 2011

Fingerprint

Dive into the research topics of 'Fine-grained latency and loss measurements in the presence of reordering'. Together they form a unique fingerprint.

Cite this