Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks

Citations Over TimeTop 10% of 2013 papers

Abstract

SUMMARY Applications running on leadership platforms are more and more bottlenecked by storage input/output (I/O). In an effort to combat the increasing disparity between I/O throughput and compute capability, we created Adaptable IO System (ADIOS) in 2005. Focusing on putting users first with a service oriented architecture, we combined cutting edge research into new I/O techniques with a design effort to create near optimal I/O methods. As a result, ADIOS provides the highest level of synchronous I/O performance for a number of mission critical applications at various Department of Energy Leadership Computing Facilities. Meanwhile ADIOS is leading the push for next generation techniques including staging and data processing pipelines. In this paper, we describe the startling observations we have made in the last half decade of I/O research and development, and elaborate the lessons we have learned along this journey. We also detail some of the challenges that remain as we look toward the coming Exascale era. Copyright © 2013 John Wiley & Sons, Ltd.

Related Papers

• → Extending Little’s Law to single order throughput times(2017)23 cited
• → Use of collapsible pipelines for joint work with main oil product pipelines(2020)1 cited
• → Study of the throughput of WLAN according to channeling and density of AP(2012)1 cited
• → Evaluation of AHS throughput using SmartCap(1997)6 cited
• → Selection of External Coatings for Northern Pipelines: Laboratory Methodologies for Evaluation and Qualification of Coatings(2004)2 cited