Abstract

Understanding how organisms deal with probabilistic stimulus-reward associations has been advanced by a convergence between reinforcement learning models and primate physiology, which demonstrated that the brain encodes a reward prediction error signal. However, organisms must also predict the level of risk associated with reward forecasts, monitor the errors in those risk predictions, and update these in light of new information. Risk prediction serves a dual purpose: (1) to guide choice in risk-sensitive organisms and (2) to modulate learning of uncertain rewards. To date, it is not known whether or how the brain accomplishes risk prediction. Using functional imaging during a simple gambling task in which we constantly changed risk, we show that an early-onset activation in the human insula correlates significantly with risk prediction error and that its time course is consistent with a role in rapid updating. Additionally, we show that activation previously associated with general uncertainty emerges with a delay consistent with a role in risk prediction. The activations correlating with risk prediction and risk prediction errors are the analogy for risk of activations correlating with reward prediction and reward prediction errors for reward expectation. As such, our findings indicate that our understanding of the neural basis of reward anticipation under uncertainty needs to be expanded to include risk prediction.

Keywords

Anticipation (artificial intelligence)InsulaMean squared prediction errorProbabilistic logicComputer sciencePsychologyCognitive psychologyReinforcement learningMachine learningNeuroimagingArtificial intelligenceNeuroscience

Affiliated Institutions

Related Publications

Publication Info

Year
2008
Type
article
Volume
28
Issue
11
Pages
2745-2752
Citations
781
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

781
OpenAlex

Cite This

Kerstin Preuschoff, Steven R. Quartz, Peter Bossaerts (2008). Human Insula Activation Reflects Risk Prediction Errors As Well As Risk. Journal of Neuroscience , 28 (11) , 2745-2752. https://doi.org/10.1523/jneurosci.4286-07.2008

Identifiers

DOI
10.1523/jneurosci.4286-07.2008