A Method for Speeding Up Value Iteration in Partially Observable Markov Decision Processes
arXiv (Cornell University)2013pp. 696–703
Citations Over Time
Abstract
We present a technique for speeding up the convergence of value iteration for partially observable Markov decisions processes (POMDPs). The underlying idea is similar to that behind modified policy iteration for fully observable Markov decision processes (MDPs). The technique can be easily incorporated into any existing POMDP value iteration algorithms. Experiments have been conducted on several test problems with one POMDP value iteration algorithm called incremental pruning. We find that the technique can make incremental pruning run several orders of magnitude faster.
Related Papers
- → Speeding Up the Convergence of Value Iteration in Partially Observable Markov Decision Processes(2001)125 cited
- → Incremental Pruning: A Simple, Fast, Exact Method for Partially Observable Markov Decision Processes(2013)343 cited
- → A Method for Speeding Up Value Iteration in Partially Observable Markov\n Decision Processes(2013)1 cited
- → An analysis of gradient-based policy iteration(2006)
- → A special case of partially observable Markov decision processes problem by event-based optimization(2016)