Generative emulation of weather forecast ensembles with diffusion models

Citations Over TimeTop 1% of 2024 papers

Abstract

Uncertainty quantification is crucial to decision-making. A prominent example is probabilistic forecasting in numerical weather prediction. The dominant approach to representing uncertainty in weather forecasting is to generate an ensemble of forecasts by running physics-based simulations under different conditions, which is a computationally costly process. We propose to amortize the computational cost by emulating these forecasts with deep generative diffusion models learned from historical data. The learned models are highly scalable with respect to high-performance computing accelerators and can sample thousands of realistic weather forecasts at low cost. When designed to emulate operational ensemble forecasts, the generated ones are similar to physics-based ensembles in statistical properties and predictive skill. When designed to correct biases present in the operational forecasting system, the generated ensembles show improved probabilistic forecast metrics. They are more reliable and forecast probabilities of extreme weather events more accurately. While we focus on weather forecasting, this methodology may enable creating large climate projection ensembles for climate risk assessment.

Related Papers

• → Improving Renewable Energy Forecasting With a Grid of Numerical Weather Predictions(2017)282 cited
• → Multi-distribution ensemble probabilistic wind power forecasting(2019)63 cited
• → A Hybrid Wind Power Forecasting Model with XGBoost, Data Preprocessing Considering Different NWPs(2021)61 cited
• → An Ensemble Forecasting Primer(1997)106 cited
• → Ultra-Short-Term Probabilistic Wind Forecasting: Can Numerical Weather Predictions Help?(2023)7 cited