Online distributed optimization via dual averaging
Citations Over TimeTop 10% of 2013 papers
Abstract
This paper presents a regret analysis on a distributed online optimization problem computed over a network of agents. The goal is to distributively optimize a global objective function which can be decomposed into the summation of convex cost functions associated with each agent. Since the agents face uncertainties in the environment, their cost functions change at each time step. We extend a distributed algorithm based on dual subgradient averaging to the online setting. The proposed algorithm yields an upper bound on regret as a function of the underlying network topology, specifically its connectivity. The regret of an algorithm is the difference between the cost of the sequence of decisions generated by the algorithm and the performance of the best fixed decision in hindsight. A model for distributed sensor estimation is proposed and the corresponding simulation results are presented.
Related Papers
- → Addressing Hindsight Bias in Multigoal Reinforcement Learning(2021)18 cited
- → Domain Knowledge and Hindsight Bias among Poker Players(2013)8 cited
- Motivational influences on the strength of the hindsight bias(2002)
- → Supplemental Material for Is There Hindsight Bias Without Real Hindsight? Conjectures Are Sufficient to Elicit Hindsight Bias(2018)