Integrating network and transfer metrics to optimize transfer efficiency and experiment workflows

Citations Over TimeTop 19% of 2015 papers

Abstract

The Worldwide LHC Computing Grid relies on the network as a critical part of its infrastructure and therefore needs to guarantee effective network usage and prompt detection and resolution of any network issues, including connection failures, congestion, traffic routing, etc. The WLCG Network and Transfer Metrics project aims to integrate and combine all network-related monitoring data collected by the WLCG infrastructure. This includes FTS monitoring information, monitoring data from the XRootD federation, as well as results of the perfSONAR tests. The main challenge consists of further integrating and analyzing this information in order to allow the optimizing of data transfers and workload management systems of the LHC experiments. In this contribution, we present our activity in commissioning WLCG perfSONAR network and integrating network and transfer metrics: We motivate the need for the network performance monitoring, describe the main use cases of the LHC experiments as well as status and evolution in the areas of configuration and capacity management, datastore and analytics, including integration of transfer and network metrics and operations and support.

Related Papers

• → Real-Time Network Device Monitoring System with Simple Network Management Protocol (SNMP) Model(2021)18 cited
• → Monitoring Systems and Networks(2020)3 cited
• Design and Development of Meteorological Network Management Platform(2015)
• Based on SNMP Network Traffic Monitoring System and Application(2011)
• A Review of Applications and Approaches of Network Monitoring(2019)