High-resolution measurement of data center microbursts

Citations Over TimeTop 1% of 2017 papers

Abstract

Data centers house some of the largest, fastest networks in the world. In contrast to and as a result of their speed, these networks operate on very small timescales---a 100 Gbps port processes a single packet in at most 500 ns with end-to-end network latencies of under a millisecond. In this study, we explore the fine-grained behaviors of a large production data center using extremely high-resolution measurements (10s to 100s of microsecond) of rack-level traffic. Our results show that characterizing network events like congestion and synchronized behavior in data centers does indeed require the use of such measurements. In fact, we observe that more than 70% of bursts on the racks we measured are sustained for at most tens of microseconds: a range that is orders of magnitude higher-resolution than most deployed measurement frameworks. Congestion events observed by less granular measurements are likely collections of smaller μbursts. Thus, we find that traffic at the edge is significantly less balanced than other metrics might suggest. Beyond the implications for measurement granularity, we hope these results will inform future data center load balancing and congestion control protocols.

Related Papers

• → Microsecond folding experiments and simulations: a match is made(2013)54 cited
• → Probing emission of a DNA-stabilized silver nanocluster from the sub-nanosecond to millisecond timescale in a single measurement(2022)20 cited
• → The counterreceptor binding site of human CD2 exhibits an extended surface patch with multiple conformations fluctuating with millisecond to microsecond motions(1997)44 cited
• → Measurement of Nuclear Isomeric Half-Lives in the Range from One Microsecond to Ten Milliseconds(1959)23 cited