On the public citation graph
Online Planning for Large Markov Decision Processes with Hierarchical Decomposition
0 signed · 80 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1007/11871842_29openalex-snapshot
Bandit Based Monte-Carlo Planning
inferredcites →https://doi.org/10.1007/3-540-44914-0_2openalex-snapshot
An Overview of MAXQ Hierarchical Reinforcement Learning
inferredcites →https://doi.org/10.1007/978-3-540-30115-8_16openalex-snapshot
Model Approximation for HEXQ Hierarchical Reinforcement Learning
inferredcites →https://doi.org/10.1007/978-3-540-74024-7_7openalex-snapshot
Half Field Offense in RoboCup Soccer: A Multiagent Reinforcement Learning Case Study
inferredcites →https://doi.org/10.1007/978-3-540-76928-6_8openalex-snapshot
Safe State Abstraction and Reusable Continuing Subtasks in Hierarchical Reinforcement Learning
inferredcites →https://doi.org/10.1007/978-3-642-20217-9_4openalex-snapshot
On Progress in RoboCup: The Simulation League Showcase
inferredcites →https://doi.org/10.1007/978-3-642-39250-4_14openalex-snapshot
Towards a Principled Solution to Simulated Robot Soccer
inferredcites →https://doi.org/10.1007/978-3-662-09438-9openalex-snapshot
Principles of Artificial Intelligence
inferredcites →https://doi.org/10.1007/s10514-009-9120-4openalex-snapshot
Reinforcement learning for robot soccer
inferredcites →https://doi.org/10.1016/0004-3702(94)00011-oopenalex-snapshot
Learning to act using real-time dynamic programming
inferredcites →https://doi.org/10.1016/j.artint.2011.03.007openalex-snapshot
Monte-Carlo tree search and rapid action value estimation in computer Go
inferredcites →https://doi.org/10.1016/s0004-3702(01)00106-0openalex-snapshot
LAO∗: A heuristic search algorithm that finds solutions with loops
inferredcites →https://doi.org/10.1016/s0004-3702(98)00023-xopenalex-snapshot
Planning and acting in partially observable stochastic domains
inferredcites →https://doi.org/10.1016/s0004-3702(99)00052-1openalex-snapshot
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
inferredcites →https://doi.org/10.1023/a:1013689704352openalex-snapshot
Finite-time Analysis of the Multiarmed Bandit Problem
inferredcites →https://doi.org/10.1023/a:1017932429737openalex-snapshot
A Sparse Sampling Algorithm for Near-Optimal Planning in Large Markov Decision Processes
inferredcites →https://doi.org/10.1023/a:1022140919877openalex-snapshot
Recent Advances in Hierarchical Reinforcement Learning
inferredcites →https://doi.org/10.1023/a:1025696116075openalex-snapshot
Recent Advances in Hierarchical Reinforcement Learning
inferredcites →https://doi.org/10.1080/00401706.1995.10484354openalex-snapshot
Markov Decision Processes: Discrete Stochastic Dynamic Programming
inferredcites →https://doi.org/10.1108/ir.1999.04926fae.001openalex-snapshot
Lecture Notes in Computer Science 1205
inferredcites →https://doi.org/10.1109/iros.2005.1545548openalex-snapshot
Hierarchical dynamic programming for robot path planning
inferredcites →https://doi.org/10.1109/proc.1981.12145openalex-snapshot
Principles of artificial intelligence
inferredcites →https://doi.org/10.1109/robot.1985openalex-snapshot
Proceedings. 1985 IEEE International Conference on Robotics and Automation
inferredcites →https://doi.org/10.1109/robot.1999.772544openalex-snapshot
Monte Carlo localization for mobile robots
inferredcites →https://doi.org/10.1109/tciaig.2012.2186810openalex-snapshot
A Survey of Monte Carlo Tree Search Methods
inferredcites →https://doi.org/10.1145/1102351.1102423openalex-snapshot
Bounded real-time dynamic programming
inferredcites →https://doi.org/10.1145/1102351.1102454openalex-snapshot
Identifying useful subgoals in reinforcement learning by local graph partitioning
inferredcites →https://doi.org/10.1145/1160633.1160686openalex-snapshot
A hierarchical approach to efficient reinforcement learning in deterministic domains
inferredcites →https://doi.org/10.1145/1390156openalex-snapshot
Proceedings of the 25th international conference on Machine learning - ICML '08
inferredcites →https://doi.org/10.1145/1390156.1390211openalex-snapshot
Hierarchical model-based reinforcement learning
inferredcites →https://doi.org/10.1145/1390156.1390238openalex-snapshot
Automatic discovery and transfer of MAXQ hierarchies
inferredcites →https://doi.org/10.1177/105971230501300301openalex-snapshot
Reinforcement Learning for RoboCup Soccer Keepaway
inferredcites →https://doi.org/10.1609/aaai.v26i1.8369openalex-snapshot
Action Selection for MDPs: Anytime AO* Versus UCT
inferredcites →https://doi.org/10.1609/aimag.v32i1.2342openalex-snapshot
Automatic Discovery and Transfer of Task Hierarchies in Reinforcement Learning
inferredcites →https://doi.org/10.1609/icaps.v23i1.13557openalex-snapshot
Trial-Based Heuristic Tree Search for Finite Horizon MDPs
inferredcites →https://doi.org/10.1613/jair.4432openalex-snapshot
Simple Regret Optimization in Online Planning for Markov Decision Processes
inferredcites →https://doi.org/10.1613/jair.639openalex-snapshot
Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
inferredcites →https://doi.org/10.2307/2291177openalex-snapshot
Markov Decision Processes: Discrete Stochastic Dynamic Programming.
inferredcites →https://doi.org/10.48550/arxiv.1301.7381openalex-snapshot
Hierarchical Solution of Markov Decision Processes using Macro-actions
inferredcites →https://doi.org/10.48550/arxiv.1302.4971openalex-snapshot
On the Complexity of Solving Markov Decision Problems
inferredcites →https://doi.org/10.5555/1248547.1248628openalex-snapshot
Causal Graph Based Decomposition of Factored MDPs
inferredcites →https://doi.org/10.5555/1577069.1755839openalex-snapshot
Transfer Learning for Reinforcement Learning Domains: A Survey
inferredcites →https://doi.org/10.5555/2343896.2343928openalex-snapshot
Online planning for large MDPs with MAXQ decomposition
inferredcites →https://doi.org/10.5555/777092.777114openalex-snapshot
State abstraction for programmable reinforcement learning agents
inferredcites →https://doi.org/10.5555/777092.777164openalex-snapshot
Symbolic heuristic search for factored Markov decision processes
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1002/9781119678816.iehc0635openalex-snapshot
Health Technology Assessment ( HTA ) Using MAFEIP (Monitoring and Assessment Framework for the European Innovation Partnership on Active and Healthy Ageing)
inferred← citeshttps://doi.org/10.1007/978-3-030-00308-1_10openalex-snapshot
Analysing Soccer Games with Clustering and Conceptors
inferred← citeshttps://doi.org/10.1007/978-3-030-00308-1_16openalex-snapshot
Concurrent Hierarchical Reinforcement Learning for RoboCup Keepaway
inferred← citeshttps://doi.org/10.1007/978-3-030-00308-1_19openalex-snapshot
A Robust Algorithm: Find an Unknown Person via Referring Grounding
inferred← citeshttps://doi.org/10.1007/978-3-030-00308-1_27openalex-snapshot
RoboCup 2D Soccer Simulation League: Evaluation Challenges
inferred← citeshttps://doi.org/10.1007/978-3-030-35699-6_50openalex-snapshot
Fractals2019: Combinatorial Optimisation with Dynamic Constraint Annealing
inferred← citeshttps://doi.org/10.1007/978-3-030-82681-9_11openalex-snapshot
Interactive Reinforcement Learning for Autonomous Behavior Design
inferred← citeshttps://doi.org/10.1007/978-3-319-65289-4_17openalex-snapshot
Toward Effective Soft Robot Control via Reinforcement Learning
inferred← citeshttps://doi.org/10.1007/978-3-319-65298-6_25openalex-snapshot
Performance Metrics for Coverage of Cleaning Robots with MoCap System
inferred← citeshttps://doi.org/10.1007/978-3-319-65298-6_26openalex-snapshot
A General Batch-Calibration Framework of Service Robots
inferred← citeshttps://doi.org/10.1007/s10015-017-0367-0openalex-snapshot
Quantifying the impact of communication on performance in multi-agent teams
inferred← citeshttps://doi.org/10.1007/s10489-018-1248-5openalex-snapshot
Posterior sampling for Monte Carlo planning under uncertainty
inferred← citeshttps://doi.org/10.1016/j.ejor.2025.08.038openalex-snapshot
A primal–dual policy iteration algorithm for constrained Markov decision processes
inferred← citeshttps://doi.org/10.1016/j.eswa.2023.120949openalex-snapshot
Solving nonstationary Markov decision processes via contextual decomposition: A military air battle management application
inferred← citeshttps://doi.org/10.1016/j.robot.2018.11.013openalex-snapshot
A context aware model for autonomous agent stochastic planning
inferred← citeshttps://doi.org/10.1080/08839514.2021.1934265openalex-snapshot
Performance Study of Minimax and Reinforcement Learning Agents Playing the Turn-based Game Iwoki
inferred← citeshttps://doi.org/10.1109/access.2019.2913235openalex-snapshot
Scalable Deep Multi-Agent Reinforcement Learning via Observation Embedding and Parameter Noise
inferred← citeshttps://doi.org/10.1109/access.2021.3094623openalex-snapshot
Contextual Bandit Learning With Reward Oracles and Sampling Guidance in Multi-Agent Environments
inferred← citeshttps://doi.org/10.1109/icces.2017.8275329openalex-snapshot
A machine learning based system for mostly automating opponent modeling in real-time strategy games
inferred← citeshttps://doi.org/10.1109/icetc66579.2025.11387503openalex-snapshot
Personalized Feedback Generation From Common Programming Approaches
inferred← citeshttps://doi.org/10.1145/3183891openalex-snapshot
Optimum Velocity Profile of Multiple Bernstein-Bézier Curves Subject to Constraints for Mobile Robots
inferred← citeshttps://doi.org/10.1145/3357236.3395525openalex-snapshot
A Survey on Interactive Reinforcement Learning
inferred← citeshttps://doi.org/10.1145/3428080openalex-snapshot
Pricing-aware Real-time Charging Scheduling and Charging Station Expansion for Large-scale Electric Buses
inferred← citeshttps://doi.org/10.1609/aaai.v31i1.10744openalex-snapshot
A Deep Hierarchical Approach to Lifelong Learning in Minecraft
inferred← citeshttps://doi.org/10.3389/fdgth.2021.662874openalex-snapshot
Cost-Effectiveness Assessment of Internet of Things in Smart Cities
inferred← citeshttps://doi.org/10.3389/frobt.2020.00123openalex-snapshot
Structure-Preserving Imitation Learning With Delayed Reward: An Evaluation Within the RoboCup Soccer 2D Simulation Environment
inferred← citeshttps://doi.org/10.3390/app8122453openalex-snapshot
HRLB⌃2: A Reinforcement Learning Based Framework for Believable Bots
inferred← citeshttps://doi.org/10.3390/sym12050719openalex-snapshot
HMCTS-OP: Hierarchical MCTS Based Online Planning in the Asymmetric Adversarial Environment
inferred← citeshttps://doi.org/10.48550/arxiv.1610.02847openalex-snapshot
Situational Awareness by Risk-Conscious Skills
inferred← citeshttps://doi.org/10.48550/arxiv.1703.04115openalex-snapshot
BetaRun Soccer Simulation League Team: Variety, Complexity, and Learning
inferred← citeshttps://doi.org/10.48550/arxiv.1706.07138openalex-snapshot
Generating Long-term Trajectories Using Deep Hierarchical Networks
inferred← citeshttps://doi.org/10.48550/arxiv.1711.07832openalex-snapshot
Situationally Aware Options
inferred← citeshttps://doi.org/10.48550/arxiv.2105.12949openalex-snapshot
A Survey on Interactive Reinforcement Learning: Design Principles and Open Challenges
inferred← citeshttps://doi.org/10.65109/tjsn8981openalex-snapshot
A Deep Policy Inference Q-Network for Multi-Agent Systems
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.