The role of the basal ganglia in habit formation

Henry H. Yin; Barbara J. Knowlton

doi:10.1038/nrn1919

journal article Jun 01, 2006

The role of the basal ganglia in habit formation

Henry H. Yin Barbara J. Knowlton

Nature Reviews Neuroscience Vol. 7 No. 6 pp. 464-476 · Springer Science and Business Media LLC

View at Publisher Save 10.1038/nrn1919

Topics

No keywords indexed for this article. Browse by subject →

References

114

[1]

Swanson, L. W. Cerebral hemisphere regulation of motivated behavior. Brain Res. 886, 113–164 (2000). A learned and provocative review of cerebral anatomy focusing on basal ganglia organization. 10.1016/s0006-8993(00)02905-x

[2]

Wilson, C. J. in The Synaptic Organization of the Brain (ed. Shepherd, G. M.) 329–375 (Oxford Univ. Press, New York, 2004).

[3]

Deniau, J. M. & Chevalier, G. Disinhibition as a basic process in the expression of striatal functions. II. The striato-nigral influence on thalamocortical cells of the ventromedial thalamic nucleus. Brain Res. 334, 227–233 (1985). 10.1016/0006-8993(85)90214-8

[4]

The functional anatomy of basal ganglia disorders

Roger L. Albin, Anne B. Young, John B. Penney

Trends in Neurosciences 1989 10.1016/0166-2236(89)90074-x

[5]

Canales, J. J. Stimulant-induced adaptations in neostriatal matrix and striosome systems: transiting from instrumental responding to habitual behavior in drug addiction. Neurobiol. Learn. Mem. 83, 93–103 (2005). 10.1016/j.nlm.2004.10.006

[6]

Wickens, J. R. & Koetter, R. in Models of Information Processing in the Basal Ganglia (eds Houk, J. C., Davis, J. L. & Beiser, D. G.) 187–214 (MIT Press, Cambridge, Massachusetts, 1995).

[7]

Behavioral effects of selective ablation of the caudate nucleus.

Ivan Divac, H. Enger Rosvold, Maria K. Szwarcbart

Journal of Comparative and Physiological Psycholog... 1967 10.1037/h0024348

[8]

Konorski, J. Integrative Activity of the Brain (University of Chicago Press, Chicago, 1967).

[9]

Skinner, B. The Behavior of Organisms (Appleton-Century-Crofts, New York, 1938).

[10]

Tolman, E. C. Purposive Behavior in Animals and Man (Macmillan, New York, 1932).

[11]

Thorndike, E. L. Animal Intelligence: Experimental Studies (Macmillan, New York, 1911). 10.5962/bhl.title.55072

[12]

Hull, C. Principles of Behavior (Appleton-Century-Crofts, New York, 1943).

[13]

Dickinson, A. in Animal Learning and Cognition (ed. Mackintosh, N. J.) 45–79 (Academic, Orlando, 1994). 10.1016/b978-0-08-057169-0.50009-7

[14]

Colwill, R. M. & Rescorla, R. A. in The Psychology of Learning and Motivation (ed. Bower, G.) 55–104 (Academic, New York, 1986). References 13 and 14 are excellent introductions to the modern study of instrumental learning.

[15]

Hammond, L. J. The effect of contingency upon the appetitive conditioning of free-operant behavior. J. Exp. Anal. Behav. 34, 297–304 (1980). 10.1901/jeab.1980.34-297

[16]

Dickinson, A. & Balleine, B. in Spatial Representation: Problems in Philosophy and Psychology (eds Eilan, N. et al.) 277–293 (Blackwell, Malden, Massachusetts, 1993).

[17]

Yin, H. H., Knowlton, B. J. & Balleine, B. W. Inactivation of dorsolateral striatum enhances sensitivity to changes in the action–outcome contingency in instrumental conditioning. Behav. Brain Res. 166, 189–196 (2006). 10.1016/j.bbr.2005.07.012

[18]

Davis, J. & Bitterman, M. E. Differential reinforcement of other behavior (DRO): a yoked-control comparison. J. Exp. Anal. Behav. 15, 237–241 (1971). 10.1901/jeab.1971.15-237

[19]

Holman, E. W. Some conditions for the dissociation of consummatory and instrumental behavior in rats. Learn. Motiv. 6, 358–366 (1975). 10.1016/0023-9690(75)90015-6

[20]

Adams, C. D. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q. J. Exp. Psychol. 33B, 109–122 (1982).

[21]

Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning

Henry H. Yin, Barbara J. Knowlton, Bernard W. Balleine

European Journal of Neuroscience 2004 10.1111/j.1460-9568.2004.03095.x

[22]

Colwill, R., Rescorla, R. A. The role of response–reinforcer associations increases throughout extended instrumental training. Anim. Learn. Behav. 16, 105–111 (1988). 10.3758/bf03209051

[23]

Dickinson, A. in Learning, Motivation, and Cognition (eds Bouton, M. E. & Fanselow, M. S.) 345–367 (American Psychological Association, Washington DC, 1997).

[24]

Dickinson, A. in Contemporary Learning Theories (eds Klein, S. B. & Mowrer, R. R.) 279–308 (Lawrence Erlbaum Associates, Hillsdale, New Jersey, 1989).

[25]

Dickinson, A., Nicholas, D. J. & Adams, C. D. The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Q. J. Exp. Psychol. B 35, 35–51 (1983). 10.1080/14640748308400912

[26]

Miller, R. Meaning and Purpose in the Intact Brain (Oxford Univ. Press, New York, 1981).

[27]

Mishkin, M., Malamut, B. & Bachevalier, J. in Neurobiology of Learning and Memory (eds Lynch, G. et al.) 65–77 (Guilford, New York, 1984).

[28]

Robbins, T. W., Giardini, V., Jones, G. H., Reading, P. & Sahakian, B. J. Effects of dopamine depletion from the caudate-putamen and nucleus accumbens septi on the acquisition and performance of a conditional discrimination task. Behav. Brain Res. 38, 243–261 (1990). 10.1016/0166-4328(90)90179-i

[29]

Packard, M. G. & Knowlton, B. J. Learning and memory functions of the basal ganglia. Annu. Rev. Neurosci. 25, 563–593 (2002). 10.1146/annurev.neuro.25.112701.142937

[30]

White, N. M. A functional hypothesis concerning the striatal matrix and patches: mediation of S–R memory and reward. Life Sci. 45, 1943–1957 (1989). 10.1016/0024-3205(89)90569-9

[31]

Packard, M. G. Glutamate infused posttraining into the hippocampus or caudate-putamen differentially strengthens place and response learning. Proc. Natl Acad. Sci. USA 96, 12881–12886 (1999). 10.1073/pnas.96.22.12881

[32]

Packard, M. G. & McGaugh, J. L. Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning. Neurobiol. Learn. Mem. 65, 65–72 (1996). 10.1006/nlme.1996.0007

[33]

Poldrack, R. A. & Packard, M. G. Competition among multiple memory systems: converging evidence from animal and human brain studies. Neuropsychologia 41, 245–251 (2003). 10.1016/s0028-3932(02)00157-4

[34]

Bayley, P. J., Frascino, J. C. & Squire, L. R. Robust habit learning in the absence of awareness and independent of the medial temporal lobe. Nature 436, 550–553 (2005). 10.1038/nature03857

[35]

Knowlton, B. J., Mangels, J. A. & Squire, L. R. A neostriatal habit learning system in humans. Science 273, 1399–1402 (1996). 10.1126/science.273.5280.1399

[36]

Moody, T. D., Bookheimer, S. Y., Vanek, Z. & Knowlton, B. J. An implicit learning task activates medial temporal lobe in patients with Parkinson's disease. Behav. Neurosci. 118, 438–442 (2004). 10.1037/0735-7044.118.2.438

[37]

Kawagoe, R., Takikawa, Y. & Hikosaka, O. Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neurosci. 1, 411–416 (1998). 10.1038/1625

[38]

Lauwereyns, J. et al. Feature-based anticipation of cues that predict reward in monkey caudate nucleus. Neuron 33, 463–473 (2002). 10.1016/s0896-6273(02)00571-8

[39]

Lauwereyns, J., Watanabe, K., Coe, B. & Hikosaka, O. A neural correlate of response bias in monkey caudate nucleus. Nature 418, 413–417 (2002). 10.1038/nature00892

[40]

Different time courses of learning-related activity in the prefrontal cortex and striatum

Anitha Pasupathy, Earl K. Miller

Nature 2005 10.1038/nature03287

[41]

Joel, D. & Weiner, I. The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96, 451–474 (2000). 10.1016/s0306-4522(99)00575-8

[42]

West, M. O. et al. A region in the dorsolateral striatum of the rat exhibiting single-unit correlations with specific locomotor limb movements. J. Neurophysiol. 64, 1233–1246 (1990). 10.1152/jn.1990.64.4.1233

[43]

Partridge, J. G., Tang, K. C. & Lovinger, D. M. Regional and postnatal heterogeneity of activity-dependent long-term changes in synaptic efficacy in the dorsal striatum. J. Neurophysiol. 84, 1422–1429 (2000). The first study to demonstrate regional variations in the types and mechanisms of striatal synaptic plasticity. 10.1152/jn.2000.84.3.1422

[44]

Whishaw, I. Q., Mittleman, G., Bunch, S. T. & Dunnett, S. B. Impairments in the acquisition, retention and selection of spatial navigation strategies after medial caudate-putamen lesions in rats. Behav. Brain Res. 24, 125–138 (1987). 10.1016/0166-4328(87)90250-6

[45]

Effects of medial and lateral caudate-putamen lesions on place- and cue-guided behaviors in the water maze: relation to thigmotaxis

B.D. Devan, R.J. McDonald, N.M. White

Behavioural Brain Research 1999 10.1016/s0166-4328(98)00107-7

[46]

Devan, B. D. & White, N. M. Parallel information processing in the dorsal striatum: relation to hippocampal function. J. Neurosci. 19, 2789–2798 (1999). 10.1523/jneurosci.19-07-02789.1999

[47]

Yin, H. H., Knowlton, B. J. & Balleine, B. W. Blockade of NMDA receptors in the dorsomedial striatum prevents action–outcome learning in instrumental conditioning. Eur. J. Neurosci. 22, 505–512 (2005). 10.1111/j.1460-9568.2005.04219.x

[48]

Yin, H. H., Ostlund, S. B., Knowlton, B. J. & Balleine, B. W. The role of the dorsomedial striatum in instrumental conditioning. Eur. J. Neurosci. 22, 513–523 (2005). 10.1111/j.1460-9568.2005.04218.x

[49]

Yin, H. H. & Knowlton, B. J. Contributions of striatal subregions to place and response learning. Learn. Mem. 11, 459–463 (2004). References 47–49 present a series of studies that established for the first time a dissociation between S–R learning in the DLS and A–O learning in the pDMS. 10.1101/lm.81004

[50]

Ragozzino, M. E. Acetylcholine actions in the dorsomedial striatum support the flexible shifting of response patterns. Neurobiol. Learn. Mem. 80, 257–267 (2003). 10.1016/s1074-7427(03)00077-7

Showing 50 of 114 references

Cited By

1,890

Imbalance between the caudate and putamen connectivity in obsessive–compulsive disorder

Ziwen Peng, Tingxin He · 2022

NeuroImage: Clinical

Coordinated and Compartmentalized Neuromodulation Shapes Sensory Processing in Drosophila

Raphael Cohn, Ianessa Morantte · 2015

Cell

Metrics

1,890

Citations

114

References

Details

Published: Jun 01, 2006
Vol/Issue: 7(6)
Pages: 464-476
License: View

Authors

H

Henry H. Yin

Department of Psychology and Neuroscience, Duke University, Durham, NC 3; Duke Institute for Brain Sciences, Durham, NC 7; Department of Neurobiology, Duke University Medical Center, Durham, NC 8

B

Barbara J. Knowlton

Cite This Article

Henry H. Yin, Barbara J. Knowlton (2006). The role of the basal ganglia in habit formation. Nature Reviews Neuroscience, 7(6), 464-476. https://doi.org/10.1038/nrn1919

The role of the basal ganglia in habit formation

You May Also Like