User-friendly parallelization of GAUDI applications with Python
Citations Over Time
Abstract
GAUDI is a software framework in C++ used to build event data processing applications using a set of standard components with well-defined interfaces. Simulation, high-level trigger, reconstruction, and analysis programs used by several experiments are developed using GAUDI. These applications can be configured and driven by simple Python scripts. Given the fact that a considerable amount of existing software has been developed using serial methodology, and has existed in some cases for many years, implementation of parallelisation techniques at the framework level may offer a way of exploiting current multi-core technologies to maximize performance and reduce latencies without re-writing thousands/millions of lines of code. In the solution we have developed, the parallelization techniques are introduced to the high level Python scripts which configure and drive the applications, such that the core C++ application code requires no modification, and that end users need make only minimal changes to their scripts. The developed solution leverages from existing generic Python modules that support parallel processing. Naturally, the parallel version of a given program should produce results consistent with its serial execution. The evaluation of several prototypes incorporating various parallelization techniques are presented and discussed.
Related Papers
- → PyMOOSE: Interoperable scripting in Python for MOOSE(2008)109 cited
- USING PYTHON AND EPPY FOR A LARGE NATIONAL SIMULATION STUDY(2016)
- → Data analysis with MATLAB® or Python(2022)4 cited
- → User-friendly parallelization of GAUDI applications with Python(2010)1 cited
- → Scripting(2011)