On the public citation graph
Policy Iteration for Decentralized Control of Markov Decision Processes
0 signed · 98 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1007/11564096_38openalex-snapshot
An Optimal Best-First Search Algorithm for Solving Infinite Horizon DEC-POMDPs
inferredcites →https://doi.org/10.1016/0022-247x(65)90154-xopenalex-snapshot
Optimal control of Markov processes with incomplete state information
inferredcites →https://doi.org/10.1016/0304-4068(74)90037-8openalex-snapshot
Subjectivity and correlation in randomized strategies
inferredcites →https://doi.org/10.1016/b978-1-55860-335-6.50042-8openalex-snapshot
Learning Without State-Estimation in Partially Observable Markovian Decision Processes
inferredcites →https://doi.org/10.1016/b978-1-55860-377-6.50052-9openalex-snapshot
Learning policies for partially observable environments: Scaling up
inferredcites →https://doi.org/10.1016/s0004-3702(98)00023-xopenalex-snapshot
Planning and acting in partially observable stochastic domains
inferredcites →https://doi.org/10.1016/s0899-8256(02)00544-4openalex-snapshot
Multi-agent influence diagrams for representing and solving games
inferredcites →https://doi.org/10.1109/aamas.2004.67openalex-snapshot
Approximate Solutions for Partially Observable Stochastic Games with Common Payoffs
inferredcites →https://doi.org/10.1109/proc.1971.8488openalex-snapshot
Separation of estimation and control for discrete time systems
inferredcites →https://doi.org/10.1142/9789811227332_0007openalex-snapshot
Subjectivity and Correlation in Randomized Strategies
inferredcites →https://doi.org/10.1287/moor.27.4.819.297openalex-snapshot
The Complexity of Decentralized Control of Markov Decision Processes
inferredcites →https://doi.org/10.1287/opre.21.5.1071openalex-snapshot
The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
inferredcites →https://doi.org/10.1287/opre.26.2.282openalex-snapshot
The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs
inferredcites →https://doi.org/10.14288/1.0098252openalex-snapshot
Algorithms for partially observable Markov decision processes
inferredcites →https://doi.org/10.1613/jair.761openalex-snapshot
Speeding Up the Convergence of Value Iteration in Partially Observable Markov Decision Processes
inferredcites →https://doi.org/10.48550/arxiv.1206.5258openalex-snapshot
Optimizing Memory-Bounded Controllers for Decentralized POMDPs
inferredcites →https://doi.org/10.48550/arxiv.1206.5295openalex-snapshot
Improved Memory-Bounded Dynamic Programming for Decentralized POMDPs
inferredcites →https://doi.org/10.48550/arxiv.1207.1359openalex-snapshot
MAA*: A Heuristic Search Algorithm for Solving Decentralized POMDPs
inferredcites →https://doi.org/10.48550/arxiv.1207.1412openalex-snapshot
Point-Based POMDP Algorithms: Improved Analysis and Implementation
inferredcites →https://doi.org/10.48550/arxiv.1207.4116openalex-snapshot
Region-Based Incremental Pruning for POMDPs
inferredcites →https://doi.org/10.48550/arxiv.1301.7380openalex-snapshot
Solving POMDPs by Searching in Policy Space
inferredcites →https://doi.org/10.48550/arxiv.1301.7417openalex-snapshot
Planning with Partially Observable Markov Decision Processes: Advances in Exact Solution Method
inferredcites →https://doi.org/10.48550/arxiv.1302.1525openalex-snapshot
Incremental Pruning: A Simple, Fast, Exact Method for Partially Observable Markov Decision Processes
inferredcites →https://doi.org/10.48550/arxiv.1408.1484openalex-snapshot
Learning to Cooperate via Policy Search
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1007/978-3-030-60990-0_12openalex-snapshot
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms
inferred← citeshttps://doi.org/10.1007/978-3-319-46675-0_21openalex-snapshot
Decentralized Stabilization for Nonlinear Systems with Unknown Mismatched Interconnections
inferred← citeshttps://doi.org/10.1007/978-3-642-05258-3_7openalex-snapshot
Cosine Policy Iteration for Solving Infinite-Horizon Markov Decision Processes
inferred← citeshttps://doi.org/10.1007/978-3-642-24016-4_9openalex-snapshot
Modeling Agents and Agent Systems
inferred← citeshttps://doi.org/10.1007/978-3-642-24647-0_2openalex-snapshot
On Support of Imperfect Bayesian Participants
inferred← citeshttps://doi.org/10.1007/978-3-642-24873-3_23openalex-snapshot
Influence Diagrams with Memory States: Representation and Algorithms
inferred← citeshttps://doi.org/10.1007/978-3-642-32723-0_24openalex-snapshot
Heuristic Planning for Decentralized MDPs with Sparse Interactions
inferred← citeshttps://doi.org/10.1007/978-3-642-40988-2_9openalex-snapshot
Expectation Maximization for Average Reward Decentralized POMDPs
inferred← citeshttps://doi.org/10.1007/978-3-662-44848-9_22openalex-snapshot
Error-Bounded Approximations for Infinite-Horizon Discounted Decentralized POMDPs
inferred← citeshttps://doi.org/10.1007/s10458-009-9103-zopenalex-snapshot
Optimizing fixed-size stochastic controllers for POMDPs and decentralized POMDPs
inferred← citeshttps://doi.org/10.1007/s10458-012-9204-yopenalex-snapshot
Solving decentralized POMDP problems using genetic algorithms
inferred← citeshttps://doi.org/10.1007/s10458-014-9261-5openalex-snapshot
Scalable solutions of interactive POMDPs using generalized and bounded policy iteration
inferred← citeshttps://doi.org/10.1016/j.artint.2010.09.008openalex-snapshot
Online planning for multi-agent systems with bounded communication
inferred← citeshttps://doi.org/10.1016/j.artint.2012.01.003openalex-snapshot
Exploiting symmetries for single- and multi-agent Partially Observable Stochastic Domains
inferred← citeshttps://doi.org/10.1016/j.artint.2022.103728openalex-snapshot
Knowledge-based strategies for multi-agent teams playing against Nature
inferred← citeshttps://doi.org/10.1016/j.ifacol.2023.10.1346openalex-snapshot
Decentralized Learning of Finite-Memory Policies in Dec-POMDPs
inferred← citeshttps://doi.org/10.1016/j.phycom.2015.08.006openalex-snapshot
A DEC-MDP model for joint uplink/downlink resource management in OFDMA-based networks
inferred← citeshttps://doi.org/10.1016/j.robot.2020.103693openalex-snapshot
LoOP: Iterative learning for optimistic planning on robots
inferred← citeshttps://doi.org/10.1080/13873954.2018.1512504openalex-snapshot
Dynamic process scheduling and resource allocation in distributed environment: an agent-based modelling and simulation
inferred← citeshttps://doi.org/10.1088/2632-2153/ae352bopenalex-snapshot
Constrained collaborative optimization of charged particle tracking with multi-agent reinforcement learning
inferred← citeshttps://doi.org/10.1109/aisp.2017.8324075openalex-snapshot
An incremental fuzzy controller for large dec-POMDPs
inferred← citeshttps://doi.org/10.1109/cdc.2013.6760239openalex-snapshot
Decentralized control of partially observable Markov decision processes
inferred← citeshttps://doi.org/10.1109/icra.2016.7487751openalex-snapshot
Graph-based Cross Entropy method for solving multi-robot decentralized POMDPs
inferred← citeshttps://doi.org/10.1109/icra.2017.7989106openalex-snapshot
Scalable accelerated decentralized multi-robot policy search in continuous observation spaces
inferred← citeshttps://doi.org/10.1109/icra.2017.7989107openalex-snapshot
Semantic-level decentralized multi-robot decision-making using probabilistic macro-observations
inferred← citeshttps://doi.org/10.1109/icra.2018.8460180openalex-snapshot
Q-CP: Learning Action Values for Cooperative Planning
inferred← citeshttps://doi.org/10.1109/ictai52525.2021.00069openalex-snapshot
Solving infinite-horizon Dec-POMDPs using Finite State Controllers within JESP
inferred← citeshttps://doi.org/10.1109/isit.2009.5205689openalex-snapshot
Delay-optimal distributed power and transmission threshold control for S-ALOHA network with FSMC fading channels
inferred← citeshttps://doi.org/10.1109/tccn.2025.3544822openalex-snapshot
Computation Offloading Optimization for UAV-Based Cloud-Edge Collaborative Task Scheduling Strategy
inferred← citeshttps://doi.org/10.1109/tcds.2018.2840971openalex-snapshot
Decision Making in Multiagent Systems: A Survey
inferred← citeshttps://doi.org/10.1109/tcomm.2009.081661openalex-snapshot
Delay-sensitive distributed power and transmission threshold control for S-ALOHA network with finite state markov fading channels
inferred← citeshttps://doi.org/10.1109/tcsii.2023.3304322openalex-snapshot
Decentralized Optimal Neurocontroller Design for Mismatched Interconnected Systems via Integral Policy Iteration
inferred← citeshttps://doi.org/10.1109/tmc.2013.39openalex-snapshot
Optimizing Spatial and Temporal Reuse in Wireless Networks by Decentralized Partially Observable Markov Decision Processes
inferred← citeshttps://doi.org/10.1109/tsg.2013.2269481openalex-snapshot
Coordinated Multi-Microgrids Optimal Control Algorithm for Smart Distribution Management System
inferred← citeshttps://doi.org/10.1109/tsg.2019.2906823openalex-snapshot
Hierarchical and Decentralized Stochastic Energy Management for Smart Distribution Systems With High BESS Penetration
inferred← citeshttps://doi.org/10.1109/tsmc.2017.2690665openalex-snapshot
Decentralized Control for Large-Scale Nonlinear Systems With Unknown Mismatched Interconnections via Policy Iteration
inferred← citeshttps://doi.org/10.1145/3303848openalex-snapshot
Cooperative Heterogeneous Multi-Robot Systems
inferred← citeshttps://doi.org/10.1177/0278364916679611openalex-snapshot
Policy search for multi-robot coordination under uncertainty
inferred← citeshttps://doi.org/10.1177/0278364917692864openalex-snapshot
Decentralized control of multi-robot partially observable Markov decision processes using belief space macro-actions
inferred← citeshttps://doi.org/10.1287/opre.2021.2253openalex-snapshot
Misinformation and Disinformation in Modern Warfare
inferred← citeshttps://doi.org/10.14569/ijacsa.2018.090822openalex-snapshot
Developing Communication Strategy for Multi-Agent Systems with Incremental Fuzzy Model
inferred← citeshttps://doi.org/10.15607/rss.2015.xi.007openalex-snapshot
Policy Search for Multi-Robot Coordination under Uncertainty
inferred← citeshttps://doi.org/10.1609/aaai.v24i1.7706openalex-snapshot
Automatic Derivation of Finite-State Machines for Behavior Control
inferred← citeshttps://doi.org/10.1609/aaai.v24i1.7748openalex-snapshot
Finite-State Controllers Based on Mealy Machines for Centralized and Decentralized POMDPs
inferred← citeshttps://doi.org/10.1609/aaai.v29i1.9773openalex-snapshot
Building Strong Semi-Autonomous Systems
inferred← citeshttps://doi.org/10.1609/aaai.v32i1.11589openalex-snapshot
Integrated Cooperation and Competition in Multi-Agent Decision-Making
inferred← citeshttps://doi.org/10.1609/icaps.v19i1.13355openalex-snapshot
Incremental Policy Generation for Finite-Horizon DEC-POMDPs
inferred← citeshttps://doi.org/10.1609/icaps.v26i1.13759openalex-snapshot
Dual Formulations for Optimizing Dec-POMDP Controllers
inferred← citeshttps://doi.org/10.1613/jair.1.11418openalex-snapshot
Modeling and Planning with Macro-Actions in Decentralized POMDPs
inferred← citeshttps://doi.org/10.1613/jair.3788openalex-snapshot
Incremental Clustering and Expansion for Faster Optimal Planning in Decentralized POMDPs
inferred← citeshttps://doi.org/10.1613/jair.3804openalex-snapshot
Incremental Clustering and Expansion for Faster Optimal Planning in Dec-POMDPs
inferred← citeshttps://doi.org/10.1613/jair.4623openalex-snapshot
Optimally Solving Dec-POMDPs as Continuous-State MDPs
inferred← citeshttps://doi.org/10.1613/jair.4649openalex-snapshot
Probabilistic Inference Techniques for Scalable Multiagent Decision Making
inferred← citeshttps://doi.org/10.23919/acc.2019.8814803openalex-snapshot
Online Planning for Decentralized Stochastic Control with Partial History Sharing
inferred← citeshttps://doi.org/10.24963/ijcai.2017/638openalex-snapshot
COG-DICE: An Algorithm for Solving Continuous-Observation Dec-POMDPs
inferred← citeshttps://doi.org/10.3390/e23050551openalex-snapshot
Forward and Backward Bellman Equations Improve the Efficiency of the EM Algorithm for DEC-POMDP
inferred← citeshttps://doi.org/10.3390/e24111599openalex-snapshot
Memory-Limited Partially Observable Stochastic Control and Its Mean-Field Control Approach
inferred← citeshttps://doi.org/10.3390/e25050791openalex-snapshot
Decentralized Stochastic Control with Finite-Dimensional Memories: A Memory Limitation Approach
inferred← citeshttps://doi.org/10.4018/978-1-60960-165-2.ch003openalex-snapshot
An Introduction to Fully and Partially Observable Markov Decision Processes
inferred← citeshttps://doi.org/10.48550/arxiv.1203.3490openalex-snapshot
Anytime Planning for Decentralized POMDPs using Expectation Maximization
inferred← citeshttps://doi.org/10.48550/arxiv.1210.4865openalex-snapshot
Scaling Up Decentralized MDPs Through Heuristic Search
inferred← citeshttps://doi.org/10.48550/arxiv.1505.00274openalex-snapshot
Stick-Breaking Policy Learning in Dec-POMDPs
inferred← citeshttps://doi.org/10.48550/arxiv.1607.03340openalex-snapshot
Real-time Rescheduling in Distributed Railway Network: An Agent-Based Approach
inferred← citeshttps://doi.org/10.48550/arxiv.2011.00583openalex-snapshot
Game-Theoretic Multiagent Reinforcement Learning
inferred← citeshttps://doi.org/10.48550/arxiv.2110.08480openalex-snapshot
Learning Cooperation and Online Planning Through Simulation and Graph Convolutional Network
inferred← citeshttps://doi.org/10.5555/1838206.1838377openalex-snapshot
Point-based policy generation for decentralized POMDPs
inferred← citeshttps://doi.org/10.5555/1838206.1838398openalex-snapshot
Quasi deterministic POMDPs and DecPOMDPs
inferred← citeshttps://doi.org/10.65109/qkae8908openalex-snapshot
Exploiting separability in multiagent planning with continuous-state MDPs
inferred← citeshttps://doi.org/10.65109/rjma3901openalex-snapshot
Producing efficient error-bounded solutions for transition independent decentralized mdps
inferred← citeshttps://doi.org/10.70675/6601c7deza7f1z464bzbd28z88b10567bd6copenalex-snapshot
Probabilistic Decision-Making Models for Multi-Agent Systems and Human-Robot Collaboration
inferred← citeshttps://doi.org/10.7275/smq4-z028openalex-snapshot
Exploiting Domain Structure in Multiagent Decision-Theoretic Planning and Reasoning
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.