On the public citation graph
Linear reinforcement learning: Flexible reuse of computation in planning, grid fields, and cognitive control
0 signed · 87 inferred · view as graph
Inferred edges come from two machine sources: sweeps of open repository metadata (mostly SSRN and Zenodo), and a bulk OpenAlex citation snapshot. Every row below is labelled with the one it came from. Neither is a complete citation index — absence here is not evidence of absence.
Is this your work? Sign in with ORCID and put your name on the
claims that are yours.
Reference health. See whether every reference in this work resolves to a
known work and none has been retracted — and get a dated CiteStamped
badge you can embed.
What this work says
Outgoing claims: the papers this work cites, builds on, or argues with.
inferredcites →https://doi.org/10.1007/7854_2015_388openalex-snapshot
Learning and Motivational Processes Contributing to Pavlovian–Instrumental Transfer and Their Neural Bases: Dopamine and Beyond
inferredcites →https://doi.org/10.1007/bf00275687openalex-snapshot
Simplified neuron model as a principal component analyzer
inferredcites →https://doi.org/10.1016/b978-1-55860-377-6.50072-4openalex-snapshot
TD Models: Modeling the World at a Mixture of Time Scales
inferredcites →https://doi.org/10.1016/j.biopsych.2017.07.003openalex-snapshot
A Formal Valuation Framework for Emotions and Their Control
inferredcites →https://doi.org/10.1016/j.cell.2020.10.024openalex-snapshot
The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation
inferredcites →https://doi.org/10.1016/j.cognition.2008.08.011openalex-snapshot
Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective
inferredcites →https://doi.org/10.1016/j.cognition.2010.08.018openalex-snapshot
The influence of reward associations on conflict processing in the Stroop task
inferredcites →https://doi.org/10.1016/j.cub.2015.02.037openalex-snapshot
Grid Cells Form a Global Representation of Connected Environments
inferredcites →https://doi.org/10.1016/j.cub.2017.06.034openalex-snapshot
Grid Cells Encode Local Positional Information
inferredcites →https://doi.org/10.1016/j.cub.2019.06.072openalex-snapshot
Environmental Barriers Disrupt Grid-like Representations in Humans during Navigation
inferredcites →https://doi.org/10.1016/j.neunet.2006.03.002openalex-snapshot
The misbehavior of value and the discipline of the will
inferredcites →https://doi.org/10.1016/j.neuron.2011.02.027openalex-snapshot
Model-Based Influences on Humans' Choices and Striatal Prediction Errors
inferredcites →https://doi.org/10.1016/j.neuron.2013.07.007openalex-snapshot
The Expected Value of Control: An Integrative Theory of Anterior Cingulate Cortex Function
inferredcites →https://doi.org/10.1016/j.neuron.2018.10.002openalex-snapshot
What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior
inferredcites →https://doi.org/10.1017/s0140525x12003196openalex-snapshot
An opportunity cost model of subjective effort and task performance
inferredcites →https://doi.org/10.1037/0033-295x.97.3.332openalex-snapshot
On the control of automatic processes: A parallel distributed processing account of the Stroop effect.
inferredcites →https://doi.org/10.1037/0097-7403.33.1.1openalex-snapshot
Stimulus-outcome interactions during instrumental discrimination learning by rats and humans.
inferredcites →https://doi.org/10.1037/a0020198openalex-snapshot
Decision making and the avoidance of cognitive demand.
inferredcites →https://doi.org/10.1037/h0054651openalex-snapshot
Studies of interference in serial verbal reactions.
inferredcites →https://doi.org/10.1037/h0058316openalex-snapshot
Discriminative conditioning. I. A discriminative property of conditioned anticipation.
inferredcites →https://doi.org/10.1037/h0062845openalex-snapshot
Studies in learning and motivation: I. Equal reinforcements in both end-boxes, followed by shock in one end-box.
inferredcites →https://doi.org/10.1038/nature03721openalex-snapshot
Microstructure of a spatial map in the entorhinal cortex
inferredcites →https://doi.org/10.1038/nature05601openalex-snapshot
Hippocampal remapping and grid realignment in entorhinal cortex
inferredcites →https://doi.org/10.1038/nn.2396openalex-snapshot
Fragmentation of grid cell maps in a multicompartment environment
inferredcites →https://doi.org/10.1038/nn1560openalex-snapshot
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
inferredcites →https://doi.org/10.1038/nn1905openalex-snapshot
Experience-dependent rescaling of entorhinal grids
inferredcites →https://doi.org/10.1038/s41562-017-0180-8openalex-snapshot
The successor representation in human reinforcement learning
inferredcites →https://doi.org/10.1038/s41593-018-0232-zopenalex-snapshot
Prioritized memory access explains planning and hippocampal replay
inferredcites →https://doi.org/10.1073/pnas.0710743106openalex-snapshot
Efficient computation of optimal actions
inferredcites →https://doi.org/10.1073/pnas.1414219112openalex-snapshot
Interplay of approximate planning strategies
inferredcites →https://doi.org/10.1073/pnas.1506367112openalex-snapshot
Habitual control of goal selection in humans
inferredcites →https://doi.org/10.1073/pnas.1609094113openalex-snapshot
Adaptive integration of habits into depth-limited planning defines a habitual-goal–directed spectrum
inferredcites →https://doi.org/10.1098/rstb.2013.0478openalex-snapshot
The algorithmic anatomy of model-based evaluation
inferredcites →https://doi.org/10.1101/421461openalex-snapshot
Intuitive planning: global navigation through cognitive maps based on grid-like codes
inferredcites →https://doi.org/10.1103/physrevlett.95.200201openalex-snapshot
Linear Theory for Control of Nonlinear Stochastic Systems
inferredcites →https://doi.org/10.1109/cdc.2008.4739438openalex-snapshot
General duality between optimal control and estimation
inferredcites →https://doi.org/10.1111/cogs.12126openalex-snapshot
The Computational and Neural Basis of Cognitive Control: Charted Territory and New Frontiers
inferredcites →https://doi.org/10.1111/ejn.13851openalex-snapshot
Behavioural signatures of backward planning in animals
inferredcites →https://doi.org/10.1111/j.1460-9568.2007.05934.xopenalex-snapshot
General and outcome‐specific forms of Pavlovian‐instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area
inferredcites →https://doi.org/10.1111/j.1460-9568.2012.08050.xopenalex-snapshot
Habits, action sequences and reinforcement learning
inferredcites →https://doi.org/10.1126/science.1166466openalex-snapshot
Representation of Geometric Borders in the Entorhinal Cortex
inferredcites →https://doi.org/10.1126/science.1169694openalex-snapshot
The Computation of Social Behavior
inferredcites →https://doi.org/10.1126/science.1223252openalex-snapshot
Preference by Association: How Memory Mechanisms in the Hippocampus Bias Decisions
inferredcites →https://doi.org/10.1126/science.aaf0941openalex-snapshot
Organizing conceptual knowledge in humans with a gridlike code
inferredcites →https://doi.org/10.1126/science.aav4837openalex-snapshot
The entorhinal cognitive map is attracted to goals
inferredcites →https://doi.org/10.1126/science.aav5297openalex-snapshot
Remembered reward locations restructure entorhinal spatial maps
inferredcites →https://doi.org/10.1146/annurev-neuro-072116-031526openalex-snapshot
Toward a Rational and Mechanistic Account of Mental Effort
inferredcites →https://doi.org/10.1146/annurev-psych-010814-015044openalex-snapshot
Motivation and Cognitive Control: From Behavior to Neural Mechanism
inferredcites →https://doi.org/10.1146/annurev-psych-122414-033457openalex-snapshot
Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On
inferredcites →https://doi.org/10.1152/jn.00518.2019openalex-snapshot
Home, head direction stability, and grid cell distortion
inferredcites →https://doi.org/10.1162/cpsy_a_00026openalex-snapshot
Anxiety, Avoidance, and Sequential Evaluation
inferredcites →https://doi.org/10.1162/neco.1993.5.4.613openalex-snapshot
Improving Generalization for Temporal Difference Learning: The Successor Representation
inferredcites →https://doi.org/10.1257/aer.102.3.41openalex-snapshot
Prospect Theory as Efficient Perceptual Distortion
inferredcites →https://doi.org/10.1371/journal.pcbi.1002055openalex-snapshot
Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes
inferredcites →https://doi.org/10.1371/journal.pcbi.1002235openalex-snapshot
Grid Cells, Place Cells, and Geodesic Generalization for Spatial Reinforcement Learning
inferredcites →https://doi.org/10.1371/journal.pcbi.1005768openalex-snapshot
Predictive representations can link model-based reinforcement learning to model-free mechanisms
inferredcites →https://doi.org/10.1371/journal.pone.0068210openalex-snapshot
What Is the Subjective Cost of Cognitive Effort? Load, Trait, and Aging Effects Revealed by Economic Preference
inferredcites →https://doi.org/10.1523/jneurosci.0151-18.2018openalex-snapshot
The Successor Representation: Its Computational Logic and Neural Substrates
inferredcites →https://doi.org/10.1523/jneurosci.1237-11.2011openalex-snapshot
Reward Value-Based Gain Control: Divisive Normalization in Parietal Cortex
inferredcites →https://doi.org/10.1523/jneurosci.2033-15.2016openalex-snapshot
Human Choice Strategy Varies with Anatomical Projections from Ventromedial Prefrontal Cortex to Medial Striatum
inferredcites →https://doi.org/10.3758/bf03199951openalex-snapshot
Motivational control of goal-directed action
inferredcites →https://doi.org/10.7551/mitpress/4708.003.0018openalex-snapshot
Adaptive Critics and the Basal Ganglia
inferredcites →https://doi.org/10.7551/mitpress/7503.003.0176openalex-snapshot
Linearly-solvable Markov decision problems
inferredcites →https://doi.org/10.7554/elife.10094openalex-snapshot
Extracting grid cell characteristics from place cell inputs using non-negative principal component analysis
inferredcites →https://doi.org/10.7554/elife.11305openalex-snapshot
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control
inferredcites →https://doi.org/10.7554/elife.16937openalex-snapshot
Visual landmarks sharpen grid cell metric and confer context specificity to neurons of the medial entorhinal cortex
What points at this work
Incoming claims: where this work appears in other papers’ reference lists and arguments.
inferred← citeshttps://doi.org/10.1007/s42113-020-00095-7openalex-snapshot
Computational Neural Mechanisms of Goal-Directed Planning and Problem Solving
inferred← citeshttps://doi.org/10.1016/j.cobeha.2021.02.017openalex-snapshot
Cognitive maps and novel inferences: a flexibility hierarchy
inferred← citeshttps://doi.org/10.1016/j.isci.2025.113441openalex-snapshot
Separable cognitive and motor decline tracked across adult life-span for goal-directed navigation
inferred← citeshttps://doi.org/10.1038/s41467-021-22559-5openalex-snapshot
Clone-structured graph representations enable flexible learning and vicarious evaluation of cognitive maps
inferred← citeshttps://doi.org/10.1038/s41593-021-00866-wopenalex-snapshot
Formalizing planning and information search in naturalistic decision-making
inferred← citeshttps://doi.org/10.1038/s44271-024-00169-3openalex-snapshot
Humans rationally balance detailed and temporally abstract world models
inferred← citeshttps://doi.org/10.1101/2020.09.15.297655openalex-snapshot
Reduced Successor Representation Potentially Interferes with Cessation of Habitual Reward-Seeking
inferred← citeshttps://doi.org/10.1101/2021.08.29.458114openalex-snapshot
Neural evidence for the successor representation in choice evaluation
inferred← citeshttps://doi.org/10.1101/2022.06.24.497481openalex-snapshot
Control Limited Perceptual Decision Making
inferred← citeshttps://doi.org/10.1111/ejn.15227openalex-snapshot
Rigid reduced successor representation as a potential mechanism for addiction
inferred← citeshttps://doi.org/10.1371/journal.pcbi.1007720openalex-snapshot
Generalizing to generalize: Humans flexibly switch between compositional and conjunctive structures during reinforcement learning
inferred← citeshttps://doi.org/10.1371/journal.pcbi.1008497openalex-snapshot
Value-complexity tradeoff explains mouse navigational learning
inferred← citeshttps://doi.org/10.1371/journal.pcbi.1010829openalex-snapshot
Humans account for cognitive costs when finding shortcuts: An information-theoretic analysis of navigation
inferred← citeshttps://doi.org/10.31234/osf.io/kv86mopenalex-snapshot
Multi-Step Planning in the Brain
inferred← citeshttps://doi.org/10.31234/osf.io/ptz2ropenalex-snapshot
Inferring Actions, Intentions, and Causal Relations in a Neural Network
inferred← citeshttps://doi.org/10.3389/fpsyg.2020.01193openalex-snapshot
Is Language Production Planning Emergent From Action Planning? A Preliminary Investigation
Editorial review for independent work. ICSAC — the Institute for Complexity
Science and Advanced Computing — runs a structured editorial panel for researchers
publishing outside journals, and publishes on CiteStamp rails. Submission is free
and goes through ORCID: icsacinstitute.org/submit.