Learning to represent reward structure: a key to adapting to complex environments (Q36442584)

14 August 2017

Learning to represent reward structure: a key to adapting to complex environments (English)

1 reference

14 August 2017

2

Okihide Hikosaka

1 reference

14 August 2017

Hiroyuki Nakahara

1

1 reference

14 August 2017

13 October 2012

1 reference

14 August 2017

Neuroscience Research

1 reference

14 August 2017

74

1 reference

14 August 2017

3-4

1 reference

14 August 2017

177-183

1 reference

Valuation and decision-making in frontal cortex: one or many serial or parallel systems?

14 August 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Neural mechanisms of foraging

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Model-based learning and the contribution of the orbitofrontal cortex to the model-free world

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Mapping value based planning and extensively trained choice in the human brain

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Neuron-type-specific signals for reward and punishment in the ventral tegmental area

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Dopamine neurons learn to encode the long-term value of multiple future rewards.

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

A neural signature of hierarchical reinforcement learning

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Prediction error associated with the perceptual segmentation of naturalistic events

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Neuronal basis of sequential foraging decisions in a patchy environment.

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

A selectionist account of de novo action learning

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Model-based influences on humans' choices and striatal prediction errors

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis.

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Decision making under uncertainty: a neural model based on partially observable markov decision processes

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Structure learning in human sequential decision-making

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Alterations in choice behavior by manipulations of world model

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Multiple timescales of memory in lateral habenula and dopamine neurons

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Distinct tonic and phasic anticipatory activity in lateral habenula and dopamine neurons

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Learning latent structure: carving nature at its joints

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Neurons in anterior cingulate cortex multiplex information about reward and action

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Neural correlates of variations in event processing during learning in basolateral amygdala

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Human reinforcement learning subdivides structured action spaces by learning effector-specific values

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Midbrain dopamine neurons signal preference for advance information about upcoming rewards

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Two types of dopamine neuron distinctly convey positive and negative motivational signals

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Reinforcement learning: Computational theory and biological mechanisms

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Reinforcement learning: the good, the bad and the ugly

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

A framework for studying the neurobiology of value-based decision making

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards.

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

A common framework for perceptual learning

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

The short-latency dopamine signal: a role in discovering novel actions?

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Midbrain dopamine neurons encode decisions for future action

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Imaging valuation models in human choice

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Representation and timing in theories of the dopamine system

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Basal ganglia orient eyes to reward

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Midbrain dopamine neurons encode a quantitative reward prediction error signal

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Computational roles for dopamine in behavioural control

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Discrete coding of reward probability and uncertainty by dopamine neurons.

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Dopamine: generalization and bonuses

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Dopamine-dependent plasticity of corticostriatal synapses

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach.

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Parallel neural networks for learning sequential procedures.

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Predictive reward signal of dopamine neurons

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

A neural substrate of prediction and reward

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

A framework for mesencephalic dopamine systems based on predictive Hebbian learning

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats

30 September 2017

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Encoding of probabilistic rewarding and aversive events by pallidal and nigral neurons

28 June 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Dopamine modulation in the basal ganglia locks the gate to working memory

28 June 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Learning to simulate others' decisions

28 June 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

The successor representation and temporal context

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Cortical map plasticity improves learning but is not necessary for improved performance.

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

The neural basis of intuitive best next-move generation in board game experts

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Internal-Time Temporal Difference Model for Neural Value-Based Decision Making

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Brain hemispheres selectively track the expected value of contralateral options.

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Do substantia nigra dopaminergic neurons differentiate between reward and punishment?

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Stimulus representation and the timing of reward-prediction errors in models of the dopamine system

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

fMRI investigation of cortical and subcortical networks in the learning of abstract and effector-specific representations of motor sequences.

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Bayesian theories of conditioning in a changing world

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Dopamine neurons can represent context-dependent prediction error.

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

Cortical remodelling induced by activity of ventral tegmental dopamine neurons

21 September 2018

1 reference

https://eutils.ncbi.nlm.nih.gov/entrez/eutils/elink.fcgi?dbfrom=pmc&linkname=pmc_refs_pubmed&retmode=json&id=3513573

10.1016/J.NEURES.2012.09.007

21 September 2018

Identifiers

DOI

1 reference

14 August 2017

1 reference

PMC publication ID

3513573

14 August 2017

PubMed publication ID

23069349

1 reference

PMC publication ID

3513573