List of publications by theme.

Structure Learning

Credit assignment in hierarchical option transfer [PDF]
Li, Xia, Dong, and Collins (2022)
Proceedings of Cog Sci 2022

How the Mind Creates Structure: Hierarchical Learning of Action Sequences [PDF]
Eckstein and Collins (2021)
Cog Sci 2021 Proceedings

Context is key for learning motor skills [PDF]
Collins and McDougle (2021)
Nature

Temporal and state abstractions for efficient learning, transfer and composition in humans [PDF] [SI] [Data]
Xia and Collins (2021)
Psychological Review

Computational Evidence for Hierarchically-Structured Reinforcement Learning in Humans [PDF] [Data]
Eckstein and Collins (2020)
PNAS

Sequential control underlies robust ramping dynamics in the rostrolateral prefrontal cortex [PDF]
Desrochers, Collins, and Badre (2018)
Journal of Neuroscience

Prefrontal Cortex in Control: Broadening the Scope to Identify Mechanisms [PDF]
Alexander, WH, Brown, JW, Collins, AGE, Hayden, BY, and Vassena, E (2017)
Journal of Cognitive Neuroscience

The cost of structure learning [PDF]
Collins, AGE (2017)
Journal of Cognitive Neuroscience

Stimulus discriminability may bias value-based probabilistic learning [PDF]
Schutte, I, Slagter, HA, Collins, AGE, Frank, MJ, and Kenemans, JL (2017)
PLoS One

Role of Prefrontal Cortex in Learning and Generalizing Hierarchical Rules in 8-Month-Old Infants [PDF]
Werchan, DM, Collins, AGE, Frank, MJ, and Amso, D (2016)
The Journal of Neuroscience

Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning [PDF]
Collins, AGE, Frank, MJ (2016)
Cognition

Motor demands constrain cognitive rule structures [PDF]
Collins, AGE, and Frank, MJ (2016)
Plos Computational Biology

8-Month-Old infants spontaneously learn and generalize hierarchical rules [PDF]
Werchan, DM, Collins, AGE, Frank, MJ, and Amso, D (2015)
Psychological Science

Foundations of human reasoning in the prefrontal cortex [PDF]
Donoso, M, Collins, AGE, Koechlin, E. (2014)
Science

Human EEG uncovers latent generalizable rule structure during learning [PDF]
Collins, AGE, Cavanagh, JF, and Frank, MJ (2014)
Journal of Neuroscience

Cognitive control over learning: creating, clustering and generalizing task-set structure [PDF]
Collins, AGE and Frank, MJ. (2013)
Psychological Review

Reasoning, learning, and creativity: frontal lobe function and human decision-making [PDF]
Collins A, Koechlin E (2012)
PLoS Biology

A computational theory of prefrontal executive control
Collins, A. and Koechlin, E. (2009)
Frontiers in Systems Neuroscience

Working Memory and Learning

Age-related differences in prefrontal glutamate are associated with increased working memory decay that gives the appearance of learning deficits [PDF]
Rmus, He, Baribault, Walsh, Festa, Collins & Nassar (2023)
eLife

Neural index of reinforcement learning predicts improved stimulus-response retention under high working memory load [PDF]
Rac-Lubashevsky, Cremer, Collins, Frank, and Schwabe (2023)
Journal of Neuroscience

Three systems interact in one-shot reinforcement learning [PDF]
Zou and Collins (2022)
Proceedings of Cog Sci 2022

Modeling the influence of working memory, reinforcement, and action uncertainty on reaction time and choice during instrumental learning [PDF]
McDougle and Collins (2020)
Psychonomic Bulletin & Review

Event segmentation reveals working memory forgetting rate [PDF] [RLWM Data]
Jafarpour, Buffalo, Knight, and Collins (2022)
iScience

Within and across-trial dynamics of human EEG reveal cooperative interplay between reinforcement learning and working memory [PDF] [Data]
Collins, AGE and Frank, MJ (2018)
PNAS

Working memory load strengthens reward prediction errors [PDF] [SI] [Data]
Collins, AGE, Ciullo, B, Frank, MJ, and Badre, D. (2017)
Journal of Neuroscience

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational and neurogenetic analysis [PDF] [Data]
Collins, AGE and Frank, MJ. (2012)
European Journal of Neuroscience

Reinforcement learning

Lowered inter-stimulus discriminability hurts incremental contributions to learning [Cognitive, Affective, & Behavioral Neuroscience] [Data]
Yoo, Keglovits, and Collins (2023)
Cognitive, Affective, & Behavioral Neuroscience

Intrinsic rewards explain context-sensitive valuation in reinforcement learning [PLOS][Data]
Molinaro and Collins (2023)
PLOS Biology

Choice Type Impacts Human Reinforcement Learning [PDF] [Data]
Rmus, Zou, Collins (2023)
Journal of Cognitive Neuroscience

The interpretation of computational model parameters depends on the context [PDF] [Data]
Eckstein, Master, Xia, Dahl, Wilbrecht, and Collins (2022)
eLife

Reinforcement Learning and Bayesian Inference Provide Complementary Models for the Unique Advantage of Adolescents in Stochastic Reversal [PDF] [Data]
Eckstein, Master, Dahl, Wilbrecht, and Collins (2022)
Developmental Cognitive Neuroscience

Activation, but not inhibition, of the indirect pathway disrupts choice rejection in a freely moving, multiple-choice foraging task [PDF]
Delevich, Hoshal, Zhou, Zhang, Vedula, Lin, Chase, Collins, Wilbrecht (2022)
Cell Reports

Modeling Changes in Probabilistic Reinforcement Learning during Adolescence [PDF] [Data]
Xia, Master, Eckstein, Baribault, Dahl, Wilbrecht, Collins (2021)
PLoS Computational Biology

Executive Function Assigns Value to Novel Goal-Congruent Outcomes [PDF]
McDougle, Ballard, Baribault, Bishop, and Collins (2021)
Cerebral Cortex

What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience [PDF]
Eckstein, Wilbrecht, and Collins (2021)
Current Opinion in Behavioral Sciences

Learning under uncertainty changes during adolescence [PDF]
Xia, Master, Eckstein, Wilbrecht, and Collins (2020)
CogSci 2020 Submission

What is a Choice in Reinforcement Learning? [PDF]
Rmus and Collins (2020)
CogSci 2020 Submission

Disentangling the systems contributing to changes in learning during adolescence [PDF]
Master, Eckstein, Gotlieb, Dahl, Wilbrecht, and Collins (2019)
Developmental Cognitive Neuroscience

Cross-Task Contributions of Frontobasal Ganglia Circuitry in Response Inhibition and Conflict-Induced Slowing [PDF]
Jahfari, Ridderinkhof, Collins, Knapen, Waldorp, Frank (2019)
Cerebral Cortex

A reinforcement learning mechanism responsible for the valuation of free choice [PDF]
Cockburn, J, Collins, AGE, and Frank, MJ (2014)
Neuron

Opponent Actor Learning (OpAL): modeling interactive effect of striatal dopamine on reinforcement learning and choice incentive [PDF]
Collins, AGE and Frank, MJ. (2014)
Psychological Review

Computational Psychiatry

Impulsivity relates to multi-trial choice strategy in probabilistic reversal learning [PDF] [Data]
Zou, Muñoz Lopez, Johnson, Collins (2022)
Frontiers in Psychiatry

Proof-of-Mechanism Study of the PDE10 Inhibitor RG7203 in Patients with Schizophrenia and Negative Symptoms [PDF]
Umbricht D., Abt M., Tamburri P., Chatham C., Holiga Š., Frank M.J., Collins A.G.E., Walling D.P., Mofsen R., Gruener D., Gertsik L., Sevigny J., Keswani S. & Dukart J. (2021)
Biological Psychiatry Global Open Science

Dopaminergic activity and exercise behavior in anorexia nervosa [PDF]
Gorrell, Collins, Le Grange, Yang (2020)
OBM Neurobiol

Computational Mechanisms of Effort and Reward Decisions in Patients With Depression and Their Association With Relapse After Antidepressant Discontinuation [PDF]
Berwian, Wenzel, Collins, Seifritz, Stephan, Walter, Huys (2020)
JAMA Psychiatry

Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia [PDF]
Collins, AGE, Albrecht, MA, Waltz, JA, Gold, JM and Frank, MJ (2017)
Biological Psychiatry

Probabilistic Reinforcement Learning in Patients with Schizophrenia: Relationships to Anhedonia and Avolition [PDF]
Dowd, EC, Frank, MJ, Collins, AGE, Gold, JM, and Barch, DM (2016)
Biological Psychiatry

Working memory contributions to reinforcement learning impairments in schizophrenia [PDF] [Data]
Collins, AGE, Brown, J, Gold, J, Waltz, J, and Frank, MJ (2014)
Journal of Neuroscience

Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence [PDF] [Data]
Gold, JM; Waltz, JA; Matveeva, TM; Kasanova, Z; Strauss, G; Herbener, E; Collins, AGE; Frank, MJ (2012)
Arch Gen Psychiatry

Reviews/Tutorials

Troubleshooting Bayesian cognitive models [PDF]
Baribault and Collins (2023)
Psychological Methods

How working memory and reinforcement learning are intertwined: a cognitive, neural, and computational perspective [PDF]
Yoo and Collins (2022)
Journal of Cognitive Neuroscience

Advances in modeling learning and decision-making in neuroscience [PDF]
Collins and Shenhav (2021)
Neuropsychopharmacology

The Role of Executive Function in Shaping Reinforcement Learning [PDF]
Rmus, McDougle, and Collins (2020)
Current Opinion in Behavioral Sciences

Beyond simple dichotomies in reinforcement learning. [PDF]
Collins and Cockburn (2020)
Nature Reviews Neuroscience

Ten simple rules for the computational modeling of behavioral data [PDF] [example code]
Wilson and Collins (2019)
eLIFE

Reinforcement learning: bringing together computation and cognition [PDF]
Collins (2019)
Current Opinion in Behavioral Sciences

Chapter 5: Learning Structures Through Reinforcement [PDF]
Collins, AGE (2018)
Goal-Directed Decision Making

The tortoise and the hare: interactions between reinforcement learning and working memory [PDF] [summary]
Collins, AGE (2018)
Journal of Cognitive Neuroscience

Surprise! dopamine signals mix action, value and error [PDF]
Collins, AGE, and Frank, MJ (2015)
Nature Neuroscience