InterFS
Citations Over Time
Abstract
Resource under-utilization is a common problem in modern data centers. Though researchers have proposed consolidation techniques to improve utilization of computing resources, there still lacks an approach to mitigate particularly low utilization of storage capacity in clusters for online services. A potential solution is to "interplant" a distributed storage system together with the services on these clusters to leverage the unused storage. However, avoiding performance interference with existing services is an essential prerequisite for interplanting. Thus, we propose InterFS, a POSIX-compliant distributed file system aiming at fully exploiting the storage resource on data center clusters. We adopt intelligent resource isolation, peak load dodging, and region-based replica placement schemes in InterFS. Therefore, it can be interplanted with other resource-intensive services without interfering with them, and amply fulfill the storage requirements of small-scale applications in the data center. Currently InterFS is deployed in 20,000+ servers at Baidu, providing 80 PB storage space to 200+ long-tailed services.
Related Papers
- → Modeling Impact of Power- and Thermal-Aware Fans Management on Data Center Energy Consumption(2015)9 cited
- → Application for modern energy efficient data center(2014)3 cited
- → Introducing Energy Efficiency Metrics for Server and Data Centers(2011)2 cited
- → Goals and Solutions of Data Allocation in Data Center(2022)1 cited
- → Host and Network Optimizations for Performance Enhancement and Energy Efficiency in Data Center Networks(2012)