On the public citation graph

Speeding Up the Convergence of Value Iteration in Partially Observable Markov Decision Processes

0 signed · 111 inferred · view as graph

Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.

Is this your work? Sign in with ORCID and put your name on the claims that are yours.
Claim with ORCID
Reference health. See whether every reference in this work resolves to a known work and none has been retracted — and get a dated CiteStamped badge you can embed.
See reference health

What this work says

Outgoing claims: the papers this work cites, builds on, or argues with.

inferredcites →https://doi.org/10.1002/9780470316887openalex-snapshot
Markov Decision Processes
inferredcites →https://doi.org/10.1007/3-540-44533-1_53openalex-snapshot
A POMDP Approximation Algorithm That Anticipates the Need to Observe
inferredcites →https://doi.org/10.1016/0022-247x(65)90154-xopenalex-snapshot
Optimal control of Markov processes with incomplete state information
inferredcites →https://doi.org/10.1016/b978-1-55860-377-6.50052-9openalex-snapshot
Learning policies for partially observable environments: Scaling up
inferredcites →https://doi.org/10.1016/s0004-3702(98)00023-xopenalex-snapshot
Planning and acting in partially observable stochastic domains
inferredcites →https://doi.org/10.1057/jors.1995.110openalex-snapshot
Markov Decision Processes
inferredcites →https://doi.org/10.1137/0318028openalex-snapshot
Optimal Infinite-Horizon Undiscounted Control of Finite Probabilistic Systems
inferredcites →https://doi.org/10.1287/moor.12.3.441openalex-snapshot
The Complexity of Markov Decision Processes
inferredcites →https://doi.org/10.1287/opre.21.5.1071openalex-snapshot
The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
inferredcites →https://doi.org/10.1287/opre.32.5.1107openalex-snapshot
The Optimal Search for a Moving Target When the Search Path Is Constrained
inferredcites →https://doi.org/10.1287/opre.37.5.791openalex-snapshot
Solution Procedures for Partially Observed Markov Decision Processes
inferredcites →https://doi.org/10.1287/opre.39.1.162openalex-snapshot
Computationally Feasible Bounds for Partially Observed Markov Decision Processes
inferredcites →https://doi.org/10.1287/opre.41.3.583openalex-snapshot
Suboptimal Policies, with Bounds, for Parameter Adaptive Decision Processes
inferredcites →https://doi.org/10.14288/1.0098252openalex-snapshot
Algorithms for partially observable Markov decision processes
inferredcites →https://doi.org/10.1613/jair.419openalex-snapshot
A Model Approximation Scheme for Planning in Partially Observable Stochastic Domains
inferredcites →https://doi.org/10.1613/jair.678openalex-snapshot
Value-Function Approximations for Partially Observable Markov Decision Processes
inferredcites →https://doi.org/10.48550/arxiv.1301.6751openalex-snapshot
A Method for Speeding Up Value Iteration in Partially Observable Markov Decision Processes
inferredcites →https://doi.org/10.48550/arxiv.1301.7380openalex-snapshot
Solving POMDPs by Searching in Policy Space
inferredcites →https://doi.org/10.48550/arxiv.1302.1525openalex-snapshot
Incremental Pruning: A Simple, Fast, Exact Method for Partially Observable Markov Decision Processes

What points at this work

Incoming claims: where this work appears in other papers’ reference lists and arguments.

inferred← citeshttps://doi.org/10.1002/9780470400531.eorms0710openalex-snapshot
Reduction of a POMDP to an MDP
inferred← citeshttps://doi.org/10.1002/9780470400531.eorms1047openalex-snapshot
Structural Results for POMDPs
inferred← citeshttps://doi.org/10.1007/11678823_5openalex-snapshot
Implementation Techniques for Solving POMDPs in Personal Assistant Agents
inferred← citeshttps://doi.org/10.1007/11766247_33openalex-snapshot
Belief Selection in Point-Based Planning Algorithms for POMDPs
inferred← citeshttps://doi.org/10.1007/3-540-44652-4_8openalex-snapshot
Space-Progressive Value Iteration: An Anytime Algorithm for a Class of POMDPs
inferred← citeshttps://doi.org/10.1007/978-3-030-99527-0_2openalex-snapshot
Under-Approximating Expected Total Rewards in POMDPs
inferred← citeshttps://doi.org/10.1007/978-3-031-32013-2_4openalex-snapshot
Answerable and Unanswerable Questions in Decision and Risk Analysis
inferred← citeshttps://doi.org/10.1007/978-3-319-46073-4_5openalex-snapshot
A Fast Elimination Method for Pruning in POMDPs
inferred← citeshttps://doi.org/10.1007/978-3-642-02906-6_72openalex-snapshot
An Uncertainty-Based Belief Selection Method for POMDP Value Iteration
inferred← citeshttps://doi.org/10.1007/978-3-642-04020-7_30openalex-snapshot
Using Control Theory for Analysis of Reinforcement Learning and Optimal Policy Properties in Grid-World Problems
inferred← citeshttps://doi.org/10.1007/978-3-642-11688-9_8openalex-snapshot
Affective Dialogue Management Using Factored POMDPs
inferred← citeshttps://doi.org/10.1007/978-3-642-17319-6_49openalex-snapshot
Accelerating Point-Based POMDP Algorithms via Greedy Strategies
inferred← citeshttps://doi.org/10.1007/s00214-021-02726-zopenalex-snapshot
Determination of stable structure of a cluster using convolutional neural network and particle swarm optimization
inferred← citeshttps://doi.org/10.1007/s10458-012-9200-2openalex-snapshot
A survey of point-based POMDP solvers
inferred← citeshttps://doi.org/10.1007/s10472-010-9202-1openalex-snapshot
Planning in partially-observable switching-mode continuous domains
inferred← citeshttps://doi.org/10.1007/s10472-013-9361-yopenalex-snapshot
Planning for multiple measurement channels in a continuous-state POMDP
inferred← citeshttps://doi.org/10.1007/s10729-016-9354-6openalex-snapshot
Strategic level proton therapy patient admission planning: a Markov decision process modeling approach
inferred← citeshttps://doi.org/10.1007/s10732-006-4834-3openalex-snapshot
Heuristic anytime approaches to stochastic decision processes
inferred← citeshttps://doi.org/10.1007/s12205-022-2121-yopenalex-snapshot
Quantification of Value of Information associated with Optimal Observation Actions within Partially Observable Markov Decision Processes
inferred← citeshttps://doi.org/10.1016/j.artint.2007.03.004openalex-snapshot
Partially observable Markov decision processes with imprecise parameters
inferred← citeshttps://doi.org/10.1016/j.artint.2022.103838openalex-snapshot
Solving zero-sum one-sided partially observable stochastic games
inferred← citeshttps://doi.org/10.1016/j.ecolmodel.2010.12.015openalex-snapshot
Resolving structural uncertainty in natural resources management using POMDP approaches
inferred← citeshttps://doi.org/10.1016/j.neucom.2019.08.045openalex-snapshot
Robust Quadratic Programming for MDPs with uncertain observation noise
inferred← citeshttps://doi.org/10.1016/j.strusafe.2017.01.003openalex-snapshot
A randomized point-based value iteration POMDP enhanced with a counting process technique for optimal management of multi-state multi-element systems
inferred← citeshttps://doi.org/10.1016/s0004-3702(02)00376-4openalex-snapshot
Equivalence notions and model minimization in Markov decision processes
inferred← citeshttps://doi.org/10.1017/cbo9780511546877.015openalex-snapshot
Planning Under Sensing Uncertainty
inferred← citeshttps://doi.org/10.1088/1748-9326/8/2/025004openalex-snapshot
Confronting dynamics and uncertainty in optimal decision making for conservation
inferred← citeshttps://doi.org/10.1109/case56687.2023.10260500openalex-snapshot
An MDP-based Method for Dynamic Workforce Allocation in Bernoulli Serial Production Lines
inferred← citeshttps://doi.org/10.1109/ccis.2012.6664612openalex-snapshot
Goal-oriented action planning in partially observable stochastic domains
inferred← citeshttps://doi.org/10.1109/cdc.2009.5400629openalex-snapshot
A probabilistic approach for control of a stochastic system from LTL specifications
inferred← citeshttps://doi.org/10.1109/cdc.2014.7039624openalex-snapshot
A max-plus based randomized algorithm for solving a class of HJB PDEs
inferred← citeshttps://doi.org/10.1109/cdc.2015.7403399openalex-snapshot
Learning based supervisor synthesis of POMDP for PCTL specifications
inferred← citeshttps://doi.org/10.1109/cdc.2016.7798419openalex-snapshot
Automated synthesis of low-rank control systems from sc-LTL specifications using tensor-train decompositions
inferred← citeshttps://doi.org/10.1109/cdc45484.2021.9683383openalex-snapshot
On Anderson Acceleration for Partially Observable Markov Decision Processes
inferred← citeshttps://doi.org/10.1109/fskd.2017.8393054openalex-snapshot
Unconscious decision minds and divergent thinking model
inferred← citeshttps://doi.org/10.1109/icdsbs63635.2025.11032062openalex-snapshot
Optimizing Spectrum Access in Cognitive Radio Networks: A Reinforcement Learning Approach with Correlation-Aware Utility Maximization
inferred← citeshttps://doi.org/10.1109/icisce.2017.119openalex-snapshot
Point-Based Incremental Pruning for Monte-Carlo Tree Search
inferred← citeshttps://doi.org/10.1109/icra.2019.8794258openalex-snapshot
Generalized Controllers in POMDP Decision-Making
inferred← citeshttps://doi.org/10.1109/icsmc.2004.1401080openalex-snapshot
Incremental topological reinforcement learning agent in non-structured environments
inferred← citeshttps://doi.org/10.1109/ictai.2008.45openalex-snapshot
Preprocessing for Point-Based Algorithms of POMDPs
inferred← citeshttps://doi.org/10.1109/iros.2005.1545091openalex-snapshot
Robust navigation using Markov models
inferred← citeshttps://doi.org/10.1109/iros.2010.5650307openalex-snapshot
Dynamic path planning adopting human navigation strategies for a domestic mobile robot
inferred← citeshttps://doi.org/10.1109/itnec.2019.8729322openalex-snapshot
Throughput Maximization for Ambient Backscatter Communication: A Reinforcement Learning Approach
inferred← citeshttps://doi.org/10.1109/rams.2011.5754479openalex-snapshot
Optimal resurfacing decisions for road maintenance: A POMDP perspective
inferred← citeshttps://doi.org/10.1109/robot.2005.1570645openalex-snapshot
Planning with Continuous Actions in Partially Observable Environments
inferred← citeshttps://doi.org/10.1109/robot.2008.4543472openalex-snapshot
Probabilistic localization with a blind robot
inferred← citeshttps://doi.org/10.1109/robot.2010.5509686openalex-snapshot
Motion planning and control from temporal logic specifications with probabilistic satisfaction guarantees
inferred← citeshttps://doi.org/10.1109/tase.2026.3663075openalex-snapshot
Control Policy Optimization for Bernoulli Serial Production Lines With Dynamic Helper Allocation
inferred← citeshttps://doi.org/10.1109/tcomm.2023.3265091openalex-snapshot
Optimizing Age of Information in Wireless Uplink Networks With Partial Observations
inferred← citeshttps://doi.org/10.1109/tcomm.2025.3631552openalex-snapshot
An Efficient Reservation Protocol for Medium Access: When Tree Splitting Meets Reinforcement Learning
inferred← citeshttps://doi.org/10.1109/tro.2011.2172150openalex-snapshot
Temporal Logic Motion Planning and Control With Probabilistic Satisfaction Guarantees
inferred← citeshttps://doi.org/10.1109/tsmcb.2008.926610openalex-snapshot
Random Sampling of States in Dynamic Programming
inferred← citeshttps://doi.org/10.1109/tsp.2012.2237171openalex-snapshot
Online Learning Based Congestion Control for Adaptive Multimedia Transmission
inferred← citeshttps://doi.org/10.1111/risa.13553openalex-snapshot
Answerable and Unanswerable Questions in Risk Analysis with Open‐World Novelty
inferred← citeshttps://doi.org/10.1142/s0218488513500396openalex-snapshot
BOUNDED-PARAMETER PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES: FRAMEWORK AND ALGORITHM
inferred← citeshttps://doi.org/10.1145/1082473.1082621openalex-snapshot
Exploiting belief bounds
inferred← citeshttps://doi.org/10.1146/annurev-control-042920-092451openalex-snapshot
Partially Observable Markov Decision Processes and Robotics
inferred← citeshttps://doi.org/10.11606/t.18.2004.tde-21102011-081848openalex-snapshot
Agente topológico de aprendizado por reforço
inferred← citeshttps://doi.org/10.13039/501100000780openalex-snapshot
Relación entre los mecanismos de difusión atómica y las propiedades ópticas en la sinterización por Spark Plasma Sintering (SPS) de la alúmina
inferred← citeshttps://doi.org/10.1504/ijfipm.2013.057405openalex-snapshot
Modelling traditional Chinese medicine therapy planning with POMDP
inferred← citeshttps://doi.org/10.15607/rss.2019.xv.006openalex-snapshot
DESPOT-Alpha: Online POMDP Planning with Large State and Observation Spaces
inferred← citeshttps://doi.org/10.1613/jair.1134openalex-snapshot
On Polynomial Sized MDP Succinct Policies
inferred← citeshttps://doi.org/10.1613/jair.1379openalex-snapshot
Restricted Value Iteration: Theory and Algorithms
inferred← citeshttps://doi.org/10.1613/jair.1496openalex-snapshot
Finding Approximate POMDP solutions Through Belief Compression
inferred← citeshttps://doi.org/10.1613/jair.1659openalex-snapshot
Perseus: Randomized Point-based Value Iteration for POMDPs
inferred← citeshttps://doi.org/10.1613/jair.2078openalex-snapshot
Anytime Point-Based Approximations for Large POMDPs
inferred← citeshttps://doi.org/10.1613/jair.2567openalex-snapshot
Online Planning Algorithms for POMDPs
inferred← citeshttps://doi.org/10.1613/jair.2667openalex-snapshot
Policy Iteration for Decentralized Control of Markov Decision Processes
inferred← citeshttps://doi.org/10.1613/jair.5328openalex-snapshot
DESPOT: Online POMDP Planning with Regularization
inferred← citeshttps://doi.org/10.18130/v3sr5xopenalex-snapshot
Expectation-maximization for Bayes-adaptive POMDPs
inferred← citeshttps://doi.org/10.24963/ijcai.2019/329openalex-snapshot
Perception-Aware Point-Based Value Iteration for Partially Observable Markov Decision Processes
inferred← citeshttps://doi.org/10.25549/usctheses-c89-45392openalex-snapshot
Artificial Intelligence for Low-Resource Communities: Influence Maximization in an Uncertain World
inferred← citeshttps://doi.org/10.25911/5d7a2b73cbb88openalex-snapshot
Policy-Gradient Algorithms for Partially Observable Markov Decision Processes
inferred← citeshttps://doi.org/10.3182/20110828-6-it-1002.02287openalex-snapshot
LTL Control in Uncertain Environments with Probabilistic Satisfaction Guarantees*
inferred← citeshttps://doi.org/10.3233/ifs-162126openalex-snapshot
A novel factored POMDP model for affective dialogue management
inferred← citeshttps://doi.org/10.33448/rsd-v9i2.2128openalex-snapshot
Tuning heuristics and convergence analysis of reinforcement learning algorithm for online data-based optimal control design
inferred← citeshttps://doi.org/10.33915/etd.8239openalex-snapshot
Active Localization for Robotic Systems: Algorithms and Cost Metrics
inferred← citeshttps://doi.org/10.3724/sp.j.1001.2008.01309openalex-snapshot
Preprocessing for Point-Based Algorithms of POMDP
inferred← citeshttps://doi.org/10.3990/1.9789036527149openalex-snapshot
Toward affective dialogue management using partially observable Markov decision processes
inferred← citeshttps://doi.org/10.4018/979-8-3693-0876-9.ch016openalex-snapshot
Nitty-Gritty of Deep Reinforcement Learning for the Healthcare Sector
inferred← citeshttps://doi.org/10.48550/arxiv.1202.3729openalex-snapshot
Suboptimality Bounds for Stochastic Shortest Path Problems
inferred← citeshttps://doi.org/10.48550/arxiv.1207.1412openalex-snapshot
Point-Based POMDP Algorithms: Improved Analysis and Implementation
inferred← citeshttps://doi.org/10.48550/arxiv.1701.06209openalex-snapshot
Counterexample-guided Abstraction Refinement for POMDPs
inferred← citeshttps://doi.org/10.48550/arxiv.1703.08262openalex-snapshot
Supervisor Synthesis of POMDP based on Automata Learning
inferred← citeshttps://doi.org/10.48550/arxiv.1810.00204openalex-snapshot
Stochastic 2-D Motion Planning with a POMDP Framework
inferred← citeshttps://doi.org/10.48550/arxiv.2103.15275openalex-snapshot
On Anderson acceleration for partially observable Markov decision processes
inferred← citeshttps://doi.org/10.5555/1036843.1036906openalex-snapshot
Heuristic search value iteration for POMDPs
inferred← citeshttps://doi.org/10.5555/1046920.1088701openalex-snapshot
Prioritization Methods for Accelerating MDP Solvers
inferred← citeshttps://doi.org/10.5555/777092.777136openalex-snapshot
The size of MDP factored policies
inferred← citeshttps://doi.org/10.5772/10691openalex-snapshot
Robust Navigation using Markov Models
inferred← citeshttps://doi.org/10.70675/370d5308z351bz48baz8627zbce71f5b44acopenalex-snapshot
Contributions to safety assurance of autonomous trains
inferred← citeshttps://doi.org/10.70675/a867c017ze4ddz471ez9b35z7fc054891ffaopenalex-snapshot
Planification de perception et de mission en environnement incertain : Application à la détection et à la reconnaissance de cibles par un hélicoptère autonome
Editorial review for independent work. ICSAC — the Institute for Complexity Science and Advanced Computing — runs a structured editorial panel for researchers publishing outside journals, and publishes on CiteStamp rails. Submission is free and goes through ORCID: icsacinstitute.org/submit.