Reinforcement Learning for PID Fine-Tuning in Nonlinear Temperature Control Systems
Abstract
This paper compares the traditional tuning techniques, i.e., Ziegler-Nichols and Cohen-Coon, with artificial intelligence-based techniques, i.e., Reinforcement Learning (RL) and Genetic Algorithms (GA), for tuning Proportional-Integral-Derivative (PID) controllers in nonlinear temperature control systems, which are modeled by an augmented Newton's Law of Cooling with a heat dissipation coefficient that varies with temperature. The analysis is done in a simulated setting that includes sensor noise, control delays, and different levels of nonlinearity. System performance is evaluated based on stability, response time, energy efficiency, and disturbance robustness. Results from the simulations demonstrate that the GA-based approach consistently achieves the highest accuracy and stability across all tested conditions, outperforming both classical methods and RL-based strategies, which show limitations in handling complex dynamics and noise. These findings offer practical insights for selecting effective PID tuning methods for nonlinear thermal systems.
Related Papers
- → Application of PID controller in controlling refrigerator temperature(2009)47 cited
- → Design of PID disturbance observer for temperature control on room heating system(2017)9 cited
- → Self-tuning temperature control of a polymerizing reactor(2002)7 cited
- → Application of Adaptive PID Temperature Control Algorithm under Spatial Thermal Model of ALD Reaction Chamber(2022)1 cited
- PID-Temperature-Control system of implement software based on the single-chip(2010)