Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces

Signe Bray; John O'Doherty

doi:10.1152/jn.01211.2006

journal article Apr 01, 2007

Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces

Signe Bray John O'Doherty

Journal of Neurophysiology Vol. 97 No. 4 pp. 3036-3045 · American Physiological Society

View at Publisher Save 10.1152/jn.01211.2006

Abstract

Attractive faces can be considered to be a form of visual reward. Previous imaging studies have reported activity in reward structures including orbitofrontal cortex and nucleus accumbens during presentation of attractive faces. Given that these stimuli appear to act as rewards, we set out to explore whether it was possible to establish conditioning in human subjects by pairing presentation of arbitrary affectively neutral stimuli with subsequent presentation of attractive and unattractive faces. Furthermore, we scanned human subjects with functional magnetic resonance imaging (fMRI) while they underwent this conditioning procedure to determine whether a reward-prediction error signal is engaged during learning with attractive faces as is known to be the case for learning with other types of reward such as juice and money. Subjects showed changes in behavioral ratings to the conditioned stimuli (CS) when comparing post- to preconditioning evaluations, notably for those CSs paired with attractive female faces. We used a simple Rescorla-Wagner learning model to generate a reward-prediction error signal and entered this into a regression analysis with the fMRI data. We found significant prediction error-related activity in the ventral striatum during conditioning with attractive compared with unattractive faces. These findings suggest that an arbitrary stimulus can acquire conditioned value by being paired with pleasant visual stimuli just as with other types of reward such as money or juice. This learning process elicits a reward-prediction error signal in a main target structure of dopamine neurons: the ventral striatum. The findings we describe here may provide insights into the neural mechanisms tapped into by advertisers seeking to influence behavioral preferences by repeatedly exposing consumers to simple associations between products and rewarding visual stimuli such as pretty faces.

Topics

No keywords indexed for this article. Browse by subject →

References

55

[1]

10.1016/s0959-4388(00)00202-6

[2]

10.1016/s0896-6273(01)00491-3

[3]

10.1006/nimg.2001.0746

[4]

10.1016/0005-7967(93)90003-d

[5]

Baker MJ, Churchill GAJ.The impact of physically attractive models on advertising evaluations.J Market ResXIV: 538–555, 1977. 10.1177/002224377701400411

[6]

10.2307/1418359

[7]

10.1098/rstb.2002.1220

[8]

10.1016/s0896-6273(00)80476-6

[9]

10.1523/jneurosci.3360-04.2005

[10]

10.1016/s0896-6273(02)00588-3

[11]

10.1037/0022-3514.68.2.261

[12]

10.1016/s1053-8119(03)00073-9

[13]

10.1152/jn.2000.84.6.3072

[14]

10.1037/h0033731

[15]

Dipboye RL, Arvey RD, Terpstra DE.Sex and physical attractiveness of raters and applicants as determinants of resume evaluations.J Appl Psychol4: 288–294, 1977. 10.1037//0021-9010.62.3.288

[16]

Dynamics of a stressful encounter: Cognitive appraisal, coping, and encounter outcomes.

Susan Folkman, Richard S. Lazarus, Christine Dunkel-Schetter et al.

Journal of Personality and Social Psychology 10.1037/0022-3514.50.5.992

[17]

Spatial registration and normalization of images

Karl. J. Friston, J. Ashburner, J.‐B. Poline et al.

Human Brain Mapping 10.1002/hbm.460030303

[18]

10.1097/00001756-200108280-00036

[19]

10.1016/s1057-7408(08)80016-2

[20]

10.1523/jneurosci.22-24-10829.2002

[21]

10.1126/science.1087919

[22]

10.1038/6404

[23]

Hamermesh DS, Biddle JE.Beauty and the labor market.Am Econom Rev84: 1174–1194, 1994. 10.3386/w4518

[24]

The distributed human neural system for face perception

James V. Haxby, Elizabeth A. Hoffman, M.Ida Gobbini

Trends in Cognitive Sciences 10.1016/s1364-6613(00)01482-0

[25]

10.1038/1124

[26]

10.1016/j.brainresbull.2005.05.027

[27]

10.1523/jneurosci.20-07-02649.2000

[28]

The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception

Nancy Kanwisher, Josh McDermott, Marvin M. Chun

The Journal of Neuroscience 10.1523/jneurosci.17-11-04302.1997

[29]

10.1006/lmot.1996.0006

[30]

Kim H, Shimojo S, O'Doherty JP.Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain.PLoS Biol4: 1453–1461, 2006. 10.1371/journal.pbio.0040233

[31]

10.1523/jneurosci.0642-05.2005

[32]

10.1016/j.cub.2005.10.070

[33]

10.1016/s0896-6273(00)80475-4

[34]

10.1016/s0896-6273(03)00154-5

[35]

10.1016/j.neuron.2005.11.014

[36]

Temporal Difference Models and Reward-Related Learning in the Human Brain

John P. O'Doherty, Peter Dayan, Karl Friston et al.

Neuron 10.1016/s0896-6273(03)00169-7

[37]

Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning

John O'Doherty, Peter Dayan, Johannes Schultz et al.

Science 10.1126/science.1094285

[38]

10.1016/s0028-3932(02)00145-8

[39]

Olson IR, Marshuetz C.Facial attractiveness is appraised at a glance.Emotion5: 186–201, 2005. 10.1037/1528-3542.5.4.498

[40]

The primate amygdala represents the positive and negative value of visual stimuli during learning

Joseph J. Paton, Marina A. Belova, Sara E. Morrison et al.

Nature 10.1038/nature04490

[41]

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans

Mathias Pessiglione, Ben Seymour, Guillaume Flandin et al.

Nature 10.1038/nature05051

[42]

Rescorla RA, Wagner AR.A theory of Pavlovian conditioning: Variations in effectiveness of reinforcement and nonreinforcement. In:Classical Conditioning II: Current Research and Theory, edited by Black AH, Prokasy WF. New York: Appleton Century-Crofts, 1972.

[43]

10.1146/annurev.psych.57.102904.190208

[44]

Attractiveness and sexual behavior: Does attractiveness enhance mating success?

Gillian Rhodes, Leigh W. Simmons, Marianne Peters

Evolution and Human Behavior 10.1016/j.evolhumbehav.2004.08.014

[45]

The Orbitofrontal Cortex and Reward

E. T. Rolls

Cerebral Cortex 10.1093/cercor/10.3.284

[46]

A Neural Substrate of Prediction and Reward

Wolfram Schultz, Peter Dayan, P. Read Montague

Science 10.1126/science.275.5306.1593

[47]

10.1038/nature02581

[48]

Smith GH, Engel R.Influence of a female model on perceived characteristics of an automobile.76th Annual Convention American Psychological Association, San Francisco, CA, 1968. 10.1037/e473742008-342

[49]

Learning to predict by the methods of temporal differences

Richard S. Sutton

Machine Learning 10.1007/bf00115009

[50]

Sutton RS, Barto AG.Time derivative models of Pavlovian reinforcement. In:Learning and Computational Neuroscience: Foundations of adaptive networks, edited by Gabriel M, Moore J. Cambridge, MA: MIT Press, 1990, p. 497–537.

Showing 50 of 55 references

Metrics

137

Citations

55

References

Details

Published: Apr 01, 2007
Vol/Issue: 97(4)
Pages: 3036-3045

Authors

Wellcome Department of Imaging Neuroscience, Institute of Neurology, University College of London, 12 Queen Square, WC1N 3AR London, UK.; Headache Group, Institute of Neurology, University College of London, Queen Square, WC1N 3BG London, UK.

Cite This Article

Signe Bray, John O'Doherty (2007). Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces. Journal of Neurophysiology, 97(4), 3036-3045. https://doi.org/10.1152/jn.01211.2006

Neural Coding of Reward-Prediction Error Signals During Classical Conditioning With Attractive Faces

You May Also Like