On the public citation graph
On the significance of Markov decision processes
0 signed · 50 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1007/bf00992700openalex-snapshot
Transfer of learning by composing solutions of elemental sequential tasks
inferredcites →https://doi.org/10.1016/0004-3702(94)00011-oopenalex-snapshot
Learning to act using real-time dynamic programming
inferredcites →https://doi.org/10.1016/0004-3702(94)00086-gopenalex-snapshot
Planning under time constraints in stochastic domains
inferredcites →https://doi.org/10.1016/0166-2236(95)90004-7openalex-snapshot
Models of information processing in the basal Ganglia
inferredcites →https://doi.org/10.1016/b978-1-55860-377-6.50072-4openalex-snapshot
TD Models: Modeling the World at a Mixture of Time Scales
inferredcites →https://doi.org/10.1016/s0020-7373(77)80038-2openalex-snapshot
Exploring, modelling and controlling discrete sequential environments
inferredcites →https://doi.org/10.1016/s0898-1221(97)90029-8openalex-snapshot
Advances in neural information processing systems 8: Proceedings of the 1995 conference
inferredcites →https://doi.org/10.1016/s0898-1221(98)90499-0openalex-snapshot
Advances in neural information processing systems 9: Proceedings of the 1996 conference
inferredcites →https://doi.org/10.1109/cdc.1997.652501openalex-snapshot
A neuro-dynamic programming approach to retailer inventory management
inferredcites →https://doi.org/10.1126/science.275.5306.1593openalex-snapshot
A Neural Substrate of Prediction and Reward
inferredcites →https://doi.org/10.1145/203330.203343openalex-snapshot
Temporal difference learning and TD-Gammon
inferredcites →https://doi.org/10.1177/105971239700600201openalex-snapshot
Experiments with Reinforcement Learning in Problems with Continuous State and Action Spaces
inferredcites →https://doi.org/10.1512/iumj.1957.6.56038openalex-snapshot
A Markovian Decision Process
inferredcites →https://doi.org/10.3233/icg-1995-18207openalex-snapshot
Temporal Difference Learning and TD-Gammon
inferredcites →https://doi.org/10.48550/arxiv.2501.05407openalex-snapshot
On-line Policy Improvement using Monte-Carlo Search
inferredcites →https://doi.org/10.7551/mitpress/4708.001.0001openalex-snapshot
Models of Information Processing in the Basal Ganglia
inferredcites →https://doi.org/10.7551/mitpress/4708.003.0020openalex-snapshot
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1007/978-3-642-12519-5_9openalex-snapshot
An Adaptive Sensor Mining Framework for Pervasive Computing Applications
inferred← citeshttps://doi.org/10.1007/978-3-642-39408-9_12openalex-snapshot
Optimal Inventory Management in a Fluctuating Market
inferred← citeshttps://doi.org/10.1007/bfb0020311openalex-snapshot
Spatio-temporal filter adjustment from evaluative feedback for a retina implant
inferred← citeshttps://doi.org/10.1007/s11191-009-9212-8openalex-snapshot
The Relation of Story Structure to a Model of Conceptual Change in Science Learning
inferred← citeshttps://doi.org/10.1049/iet-cdt:20070027openalex-snapshot
Hardware architecture for high-speed real-time dynamic programming applications
inferred← citeshttps://doi.org/10.1080/01621459.2026.2682540openalex-snapshot
Development of Public Health Policy by Digital Twin Microsimulation and Q-learning: A COVID-19 Booster Case Study
inferred← citeshttps://doi.org/10.1080/24725854.2020.1727069openalex-snapshot
Emergency medical service resource allocation in a mass casualty incident by integrating patient prioritization and hospital selection problems
inferred← citeshttps://doi.org/10.1109/access.2020.3038735openalex-snapshot
Reinforcement Learning Techniques for Optimal Power Control in Grid-Connected Microgrids: A Comprehensive Review
inferred← citeshttps://doi.org/10.1109/cec48606.2020.9185652openalex-snapshot
Power Flow Management in Electric Vehicles Charging Station Using Reinforcement Learning
inferred← citeshttps://doi.org/10.1109/cicn70047.2026.11594235openalex-snapshot
Adaptive Strategy Formation Under Uncertainty: A Reinforcement Learning Approach to Organizational Learning
inferred← citeshttps://doi.org/10.1109/icacci.2017.8125811openalex-snapshot
Comparison of reinforcement learning algorithms applied to the cart-pole problem
inferred← citeshttps://doi.org/10.1109/icassp.1998.675456openalex-snapshot
Spatial and temporal stability of vision chips including parasitic inductances and capacitances
inferred← citeshttps://doi.org/10.1109/icassp.1998.675481openalex-snapshot
Retina implant adjustment with reinforcement learning
inferred← citeshttps://doi.org/10.1109/ijcnn52387.2021.9533791openalex-snapshot
Online Virtual Training in Soft Actor-Critic for Autonomous Driving
inferred← citeshttps://doi.org/10.1109/la-cci.2015.7435932openalex-snapshot
Soft-UCT: An algorithm for probabilistic planning based on a generalized mean operator
inferred← citeshttps://doi.org/10.1109/pesgre58662.2023.10404541openalex-snapshot
Exploration-Exploitation Balancing in Reinforcement Learning for Microgrid Scheduling: A Systematic Approach for Fixing Cooling Schedules
inferred← citeshttps://doi.org/10.1109/psc50246.2020.9131138openalex-snapshot
Reinforcement Learning Approaches to Power Management in Grid-tied Microgrids: A Review
inferred← citeshttps://doi.org/10.1109/ssci51031.2022.10022206openalex-snapshot
Increasing attacker engagement on SSH honeypots using semantic embeddings of cyber-attack patterns and deep reinforcement learning
inferred← citeshttps://doi.org/10.1109/tii.2019.2944183openalex-snapshot
Cooperative Management for PV/ESS-Enabled Electric Vehicle Charging Stations: A Multiagent Deep Reinforcement Learning Approach
inferred← citeshttps://doi.org/10.1109/tii.2022.3143175openalex-snapshot
Cooperative Multiagent Deep Reinforcement Learning for Reliable Surveillance via Autonomous Multi-UAV Control
inferred← citeshttps://doi.org/10.1109/tro.2010.2044948openalex-snapshot
A Probabilistic Particle-Control Approximation of Chance-Constrained Stochastic Predictive Control
inferred← citeshttps://doi.org/10.1109/tvt.2021.3062418openalex-snapshot
Orchestrated Scheduling and Multi-Agent Deep Reinforcement Learning for Cloud-Assisted Multi-UAV Charging Systems
inferred← citeshttps://doi.org/10.1109/wiiat50758.2020.00088openalex-snapshot
Validation of Double Transition Model by Analyzing Reward Distributions
inferred← citeshttps://doi.org/10.1145/3484824.3484916openalex-snapshot
Keyphrase Extraction using Markov Decision Process from Social Media Data
inferred← citeshttps://doi.org/10.1146/annurev-statistics-030718-105251openalex-snapshot
Precision Medicine
inferred← citeshttps://doi.org/10.1522/030012648openalex-snapshot
modele hybride de reconnaissance de plans pour les patients Alzheimer :
inferred← citeshttps://doi.org/10.3390/machines10080609openalex-snapshot
Utilizing Human Feedback in Autonomous Driving: Discrete vs. Continuous
inferred← citeshttps://doi.org/10.6092/unibo/amsdottorato/2403openalex-snapshot
The dark side of the board: advances in chess Kriegspiel
inferred← citeshttps://doi.org/10.70675/75c572e9z9cc3z4accza6b4zc3feb98b6db8openalex-snapshot
Sequence Prediction using Recurrent Neural Networks in the Context of Time Series and Information Retrieval Search Sessions
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.