Abstract
Understanding how organisms deal with probabilistic stimulus-reward associations has been advanced by a convergence between reinforcement learning models and primate physiology, which demonstrated that the brain encodes a reward prediction error signal. However, organisms must also predict the level of risk associated with reward forecasts, monitor the errors in those risk predictions, and update these in light of new information. Risk prediction serves a dual purpose: (1) to guide choice in risk-sensitive organisms and (2) to modulate learning of uncertain rewards. To date, it is not known whether or how the brain accomplishes risk prediction. Using functional imaging during a simple gambling task in which we constantly changed risk, we show that an early-onset activation in the human insula correlates significantly with risk prediction error and that its time course is consistent with a role in rapid updating. Additionally, we show that activation previously associated with general uncertainty emerges with a delay consistent with a role in risk prediction. The activations correlating with risk prediction and risk prediction errors are the analogy for risk of activations correlating with reward prediction and reward prediction errors for reward expectation. As such, our findings indicate that our understanding of the neural basis of reward anticipation under uncertainty needs to be expanded to include risk prediction.
Keywords
Affiliated Institutions
Related Publications
Investigating emotion with music: An fMRI study
Abstract The present study used pleasant and unpleasant music to evoke emotion and functional magnetic resonance imaging (fMRI) to determine neural correlates of emotion process...
Performance of a Randomization Test for Single-Subject <sup>15</sup>O-Water PET Activation Studies
We adapted and implemented a permutation test ( Holmes 1994 ) to single-subject positron emission tomography (PET) activation studies with multiple replications of conditions. T...
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
We develop a theoretical framework that shows how mesencephalic dopamine systems could distribute to their targets a signal that represents information about future expectations...
Reinforcement Learning or Active Inference?
This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive...
Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies
Abstract Positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have been extensively used to explore the functional neuroanatomy of cognitive funct...
Publication Info
- Year
- 2008
- Type
- article
- Volume
- 28
- Issue
- 11
- Pages
- 2745-2752
- Citations
- 781
- Access
- Closed
External Links
Social Impact
Social media, news, blog, policy document mentions
Citation Metrics
Cite This
Identifiers
- DOI
- 10.1523/jneurosci.4286-07.2008