Hippocampal pattern separation supports reinforcement learning

Ian C. Ballard, Anthony D. Wagner, Samuel McClure

Research output: Contribution to journalArticlepeer-review

32 Scopus citations

Abstract

Animals rely on learned associations to make decisions. Associations can be based on relationships between object features (e.g., the three leaflets of poison ivy leaves) and outcomes (e.g., rash). More often, outcomes are linked to multidimensional states (e.g., poison ivy is green in summer but red in spring). Feature-based reinforcement learning fails when the values of individual features depend on the other features present. One solution is to assign value to multi-featural conjunctive representations. Here, we test if the hippocampus forms separable conjunctive representations that enables the learning of response contingencies for stimuli of the form: AB+, B−, AC−, C+. Pattern analyses on functional MRI data show the hippocampus forms conjunctive representations that are dissociable from feature components and that these representations, along with those of cortex, influence striatal prediction errors. Our results establish a novel role for hippocampal pattern separation and conjunctive representation in reinforcement learning.

Original languageEnglish (US)
Article number1073
JournalNature communications
Volume10
Issue number1
DOIs
StatePublished - Dec 1 2019

ASJC Scopus subject areas

  • General Chemistry
  • General Biochemistry, Genetics and Molecular Biology
  • General Physics and Astronomy

Fingerprint

Dive into the research topics of 'Hippocampal pattern separation supports reinforcement learning'. Together they form a unique fingerprint.

Cite this