Distributed Bayesian optimization of deep reinforcement learning algorithms

Citations Over TimeTop 10% of 2020 papers

Abstract

Significant strides have been made in supervised learning settings thanks to the successful application of deep learning. Now, recent work has brought the techniques of deep learning to bear on sequential decision processes in the area of deep reinforcement learning (DRL). Currently, little is known regarding hyperparameter optimization for DRL algorithms. Given that DRL algorithms are computationally intensive to train, and are known to be sample inefficient, optimizing model hyperparameters for DRL presents significant challenges to established techniques. We provide an open source, distributed Bayesian model-based optimization algorithm, HyperSpace, and show that it consistently outperforms standard hyperparameter optimization techniques across three DRL algorithms.

Related Papers

• → Initializing Bayesian Hyperparameter Optimization via Meta-Learning(2015)394 cited
• → Deep Neural Network with Hyperparameter Tuning for Detection of Heart Disease(2021)23 cited
• → Evaluation of Hyperparameter-Optimization Approaches in an Industrial Federated Learning System(2022)14 cited
• → Bayesian Hyperparameter Optimization for Ensemble Learning(2016)35 cited
• → Evaluation of Hyperparameter-Optimization Approaches in an Industrial Federated Learning System(2021)