Izifundo ezikhokelwa ngumvuzo ngaphandle kwe-dopamine kwi-nucleus accumbens: imisebenzi yokudibanisa ye-cortico-basal ganglia network (2008)

Eur J Neurosci. 2008 Oct;28(8):1437-48. doi: 10.1111/j.1460-9568.2008.06422.x.

Yin HH1, I-Ostlund SB, Balleine BW.

Abstract

Apha sicela umngeni kumbono wokuba ukufunda okukhokelwa ngumvuzo kulawulwa kuphela yindlela ye-mesoaccumbens evela kwi-dopaminergic neurons kwindawo ye-ventral tegmental kunye neprojekthi kwi-nucleus accumbens. Le mbono yamkelwe ngokubanzi ithatha ukuba umvuzo ngumbono we-monolithic, kodwa umsebenzi wamva nje ucebise ngenye indlela. Ngoku kubonakala ngathi, ekufundeni okukhokelwa ngumvuzo, imisebenzi ye-ventral kunye ne-dorsal striata, kunye ne-cortico-basal ganglia circry ehambelana nazo, inokwahlulwa. Nangona i-nucleus accumbens iyimfuneko ekufumaneni kunye nokubonakaliswa kweempendulo ezithile zePavlovian ezinomdla kunye negalelo kulawulo olukhuthazayo lokusebenza kwezixhobo, i-dorsal striatum iyimfuneko ekufumaneni nasekuboniseni izenzo zezixhobo. Ezo ziphumo zibonisa ubukho beenkqubo ezininzi ezizimeleyo kodwa ezisebenzisanayo ezisebenzayo eziphunyezwa ngokuphindaphinda kunye nolungelelwaniso olucwangcisiweyo lwe-cortico-basal ganglia networks ezibandakanyeka kukuziphatha okukhangayo ukusuka kwiimpendulo ze-Pavlovian ukuya kwiinjongo-ezijoliswe kwizenzo zesixhobo ezilawulwa yi-action-outcomencies.

Internet: i-striatum, i-dopamine, i-basal ganglia, ukufunda, i-nucleus accumbens, umvuzo

Sekuyinto eqhelekileyo kuncwadi lwamva nje ukufumana ingqikelelo ye-monolithic 'yomvuzo' esetyenziswa ngokufanayo ekuziphatheni okunqwenelayo, nokuba ichaza nantoni na elungileyo kumzimba (idla ngokusuka kumbono womvavanyi), okanye isetyenziswe ngokutshintshanayo namagama amadala afana nala. 'ukuqinisa' okanye 'inkuthazo.' Le meko yemicimbi iyakhuthazwa, ukuba ayisiyiyo ngokwayo isiphumo, kugxilwe kwi-neural substrate enye 'yomvuzo' obandakanya ukukhutshwa kwe-dopamine (DA) kwi-nucleus accumbens.I-Berke kunye neHyman, 2000; UGrace et al., 2007).

Ikhonkco phakathi kwendlela ye-mesoaccumbens kunye nomvuzo, evunyiweyo kumashumi eminyaka eyadlulayo, iye yavuselelwa bubungqina bamva nje bokuba isiginali ye-phasic ye-DA ifaka impazamo yokuxela kwangaphambili umvuzo, ekusenokwenzeka ukuba isebenza njengophawu lokufundisa kwi-associative learnin.g (Schultz et al., 1997). Ngokweyona ngcaciso idumileyo, kanye njengokuba kukho umqondiso omnye womvuzo, ngoko kukho umqondiso omnye wokufunda okukhokelwa ngumvuzo, oku kuthetha unxulumano phakathi kovuselelo kunye nomvuzo (UMontague et al., 2004). Umbuzo wokuba olu hlobo lokufunda luyilawula njani indlela yokuziphatha eguquguqukayo, nakuba kunjalo, uye watyeshelwa; kucingelwa nje ukuba isiginali ye-dopamine yanele kokubini ukufunda kwangaphambili, kunye neempendulo ezinemiqathango eziveliswa ngoko, kunye nezenzo ezijolise kwiinjongo ezikhokelwa lumanyano lwabo nomvuzo. Ngenxa yoko, ugqaliselo lolona phando luninzi kwicandelo lomvuzo kunye nokulutha kukubonakaliswa kwe-DA kunye neplastiki ehambelanayo kwindlela ye-mesoaccumbens (EBerridge noRobinson, i-1998; Hyman et al., 2006; UGrace et al., 2007).

Lo mbono wenkqubo yomvuzo, njengoko uqondwa ngakumbi (IKhadidi kunye no-., 2002; I-Balleine, 2005; Everitt kunye noRobbins, i-2005; Hyman et al., 2006), akonelanga kwaye uyalahlekisa. Ayonelanga kuba akukho kuzuza okanye ukusebenza kwezenzo ezijoliswe kwiinjongo ezinokuchazwa ngokweenkqubo zonxulumano ezilamla ukufunda okuvuzwayo.. Kuyalahlekisa, ngaphezu koko, ngenxa yokuba ugxininiso olulodwa kumsebenzi wendlela ye-mesoaccumbens, engeyomfuneko okanye eyaneleyo kwizenzo ezijoliswe kwiinjongo, iphambukile ingqalelo kumbuzo obaluleke kakhulu wokuba zeziphi izenzo ezijoliswe kwiinjongo kunye nendlela eziphunyezwa ngayo. ngengqondo. Ewe, ngokobungqina obuguqukayo obuvela kwiindlela ezahlukeneyo zovavanyo, into ebikhe yabonakala ngathi yindlela enye yomvuzo inokubandakanya iinkqubo ezininzi ezineziphumo ezahlukeneyo zokuziphatha kunye ne-neural substrates.Corbit et al., 2001; ODoherty et al., 2004; Yin et al., 2004; Delgado et al., 2005; Yin et al., 2005b; IHaruno kunye neKawato, ngo-2006a; UTobler et al., 2006; Jedynak et al., 2007; URobinson et al., 2007; UTobler et al., 2007).

Apha sizama ukuveza ezinye zeengxaki ezinxulumene nemodeli yangoku ye-mesoaccumbens kunye nokuphakamisa, endaweni yayo, imodeli eyahlukileyo yokufunda okukhokelwa ngumvuzo. Siyakuxoxa ukuba i-striatum sisakhiwo esine-heterogeneous ephezulu enokuthi yahlulwe ibe yimimandla emine esebenzayo, nganye kuzo isebenza njenge-hub kuthungelwano olusebenzayo oluhlukileyo kunye nezinye izinto ze-cortical, thalamic, pallidal, kunye ne-midbrain.. Imisebenzi edibeneyo yolu thungelwano, ukusuka kwimveliso yeempendulo ezingenamiqathango ezifunwa ngumvuzo wokulawula izenzo ezijoliswe kwiinjongo, zinokwahlulwa kwaye zifundwe kusetyenziswa iimvavanyo zokuziphatha zangoku.

Uqikelelo kunye nolawulo

Indlela ye-mesoaccumbens ihlala icingelwa ukuba iyimfuneko ukuze kufunyanwe umanyano phakathi komvuzo kunye novuselelo lwendalo oluqikelela loo mvuzo. Ngokomzekelo, kwezinye iimvavanyo ezivavanya umsebenzi we-phasic weeseli ze-DA ezifunyanwe ngumvuzo, iinkawu zaqeqeshelwa ukudibanisa i-stimulus kunye nokuhanjiswa kwejusi (I-Waelti et al., 2001) kwaye emva koko uphendule kwi-stimulus ngempendulo enemiqathango (CR) -i-licking elindelekileyo. Ukukhothwa kwenkawu kunokujoliswa kumgomo, kuba ikholelwa ukuba kuyimfuneko ukufumana ijusi. Ngenye indlela, ukukhothwa kunokuphakanyiswa yi-antecedent stimulus apho ijusi idibene nayo. Yeyiphi kwezi zigqibo zokukhothwa kweenkawu ezilawula ukuziphatha kuyo nayiphi na imeko ayaziwa kuqala, kwaye ayinakuqinisekiswa ngokuqwalasela okungaphezulu; inokumiselwa kuphela ngokusebenzisa iimvavanyo ezenzelwe ngokukodwa le njongo. Ezi mvavanyo, ezithathe amashumi eminyaka ukuba ziphuhle, zenza undoqo wenkqubela phambili enkulu yanamhlanje kufundo lokufunda nokuziphatha (1 Table). Ukususela ekusetyenzisweni kwezi mvavanyo, eziza kuxutyushwa ngezantsi, ngoku siyazi ukuba impendulo efanayo yokuziphatha - nokuba yindlela ye-ambulatory, i-orienting, okanye icinezela i-lever-inokuthi ivele kwiimpembelelo ezininzi ezingenakulinganiswa.

1 Table  

Ukufunda okukhokelwa ngumvuzo

Ukungabi naluvelwano kumbindi ophakathi kwezona zigqibo zokuziphatha yeyona ngxaki iphambili kuhlalutyo lwangoku lwe-neuroscientific yokufunda okukhokelwa ngumvuzo. To ukuqonda ukubaluleka kwale ngxaki, kuyimfuneko ukuqonda umahluko phakathi kwendlela yokufunda kwangaphambili (okanye i-Pavlovian) kunye nenjongo-ezijoliswe (okanye izixhobo) zokulawula ukuziphatha okunomdla. Ewe, ngokujonga ukuba ezi nkqubo zimbini ziye zadityaniswa kangaphi kuncwadi ngomvuzo, uphononongo olufutshane lwalo mahluko lubonakala luyisiqalo esiluncedo kwingxoxo yethu.

Kwimeko ye-Pavlovian ekhangayo, umvuzo (okt i-stimulus engenamiqathango okanye i-US) idityaniswe ne-stimulus (isivuseleli esinemiqathango okanye i-CS), kungakhathaliseki ukuba isilwanyana siziphatha njani, ngelixa ukufunda ngezixhobo, umvuzo uxhomekeke kwizenzo zezilwanyana. Umbuzo obalulekileyo kuzo zombini iimeko, nangona kunjalo, ingaba umbutho wokuvuselela-umvuzo okanye umbutho wokuvuza isenzo ukulawula ukuziphatha.

Njengoko kubonakala kulula, lo mbuzo awuzange uphumelele kubaphandi kumashumi eminyaka amaninzi ngenxa yokuba iimpendulo zokuziphatha kwezi meko zinokubonakala zifana.

Ke, iimpendulo ezinemiqathango (CRs) ezilawulwa yi-Pavlovian stimulus-reward association zihlala zine-veneer yenjongo-directional malunga nazo. Nokuba i-salivation, i-CR ye-Pavlov yasekuqaleni, yayinokuthi iveliswe yizinja zakhe njengenzame ngamabomu ukuququzelela ukungenisa. Kungenxa yoko le nto ingcaciso ecacileyo-ekuthi kwi-Pavlovian conditioning i-stimulus-outcome association ifundwe, ngelixa i-instrumental conditioning i-action-outcome association ifundwe-yehlulekile ukufumana inkxaso eninzi kwiminyaka emininzi (Isikhumba, i-1938; UAshby, ngo-1960; IiBolles, i-1972; IMackintosh, 1974). Nangona kunjalo, nangona ii-CRs ezininzi zePavlovian zizimele okanye zigqibezela, ezinye ii-CRs, ezinje ngokuziphatha okusingise emvuzweni, azibonakali kakuhle (Rescorla kunye noSolomon, ngo-1967); eneneni, ngokulula banokubhidaniswa nezenzo zesixhobo (UBrown noJenkins, ngo-1968; UWilliams noWilliams, ngo-1969; Schwartz noGamzu, ngo-1977). Ngoku siyazi ukuba, nangona ukufana okungaphezulu, i-Pavlovian CRs kunye neenjongo ezijoliswe kwiinjongo zezixhobo ziyahluka kwisakhiwo esimelayo esilawula ukusebenza kwempendulo (Schwartz noGamzu, ngo-1977).

Eyona ndlela ichanekileyo yokumisela ukuba ngaba ukusebenza kwempendulo kulamlwa ngumvuzo we-stimulus-award okanye i-action-reward association kukuhlola ukusebenza kokulawula okungalindelekanga. Umzekelo wokugalela amathe uyafundisa apha. Sheffield (1965) ivavanyiwe ukuba ingaba i-salivation kwi-Pavlovian conditioning yayilawulwa bubudlelwane bayo nomvuzo okanye ngombutho wokuvuselela umvuzo. Kuvavanyo lwakhe, izinja zafumana izibini phakathi kwethoni kunye nomvuzo wokutya (Sheffield, ngo-1965). Nangona kunjalo, ukuba izinja zahlutha ngexesha lethoni, ukutya akuzange kuhanjiswe kweso lingo. Eli lungiselelo lagcina ubudlelwane be-Pavlovian phakathi kwethoni kunye nokutya, kodwa laphelisa naluphi na unxulumano oluthe ngqo phakathi kwe-salivation kunye nokuhanjiswa kokutya. Ukuba isaliti yayisisenzo esilawulwa lubudlelwane bayo nokutya, ngoko ke izinja kufuneka ziyeke ukugalela amathe-eneneni akufuneki zithole isalivation kwithowuni kwaphela. USheffield wafumanisa ukuba ngokucacileyo yayiyi-Pavlovian ithoni-ubudlelwane bokutya obulawula i-salivation CR. Ebudeni bokutya okungaphezulu kwama-800, izinja ziye zafumana zaza zagcina izinkcwe kwithowuni nangona oku kubangele ukuba ziphulukane nokutya ebezinokukufumana ngokungatyi izinkcwe. Isigqibo esifanayo safikelelwa ngabanye kwizifundo nabantu (Pithers, 1985) kunye nezinye izilwanyana (UBrown noJenkins, ngo-1968; Williams & Williams, ngo-1969; eHolland, ngo-1979); kuzo zonke iimeko, kubonakala ukuba, nangona kukho ukuhlukahluka okukhulu, iimpendulo zePavlovian azilawulwa ngobudlelwane babo nomvuzo-okt yi-action-outcomency contingency.

Igama elithi imeko enokwenzeka libhekisa kubudlelwane obunemiqathango phakathi kwesiganeko 'A' kunye nesinye, 'B', kangangokuba ukwenzeka kuka-B kuxhomekeke ku-A. Ubudlelwane obulolu hlobo bunokuthotywa ngokulula ngokuthi kuboniswe u-B engekho u-A. Ukusetyenziswa kolingelo, okubhekiselwa kuko ukuthotywa okunokwenzeka, kuqhele ukwenziwa ngokunikezela ngomvuzo ngokuzimeleyo nokuba sisivuseleli esixelwe kwangaphambili okanye isenzo. Nangona le ndlela yaphuhliswa ekuqaleni ukufunda imeko yePavlovian (Rescorla, ngo-1968), ukuthotywa kwezixhobo ezinokwenzeka kuye kwaba sisixhobo esiqhelekileyo (Hammond, ngo-1980). Xa ezi ziganeko ezingalindelekanga ziphathwa ngokuthe ngqo, umxholo wokufunda utyhilwa: umz. kwi-autoshaping, i-Pavlovian CR 'efihliweyo' njengesenzo sesixhobo iphazamiseka ngokusetyenziswa kwePavlovian kunokuba i-instrumental contingency (Schwartz noGamzu, ngo-1977).

Izenzo zesixhobo ezijoliswe kwiinjongo zibonakaliswe ngeendlela ezimbini: 1) uvakalelo kwiinguqu kwixabiso lesiphumo, kunye ne-2) uvakalelo lokutshintsha kwimeko enokwenzeka phakathi kwesenzo kunye nesiphumo. (I-Dickinson, i-1985; UDickinson kunye neBalleine, i-1993). Uvakalelo lokuthotywa kwesiphumo sodwa, kufuneka kugxininiswe, akwanelanga ekuboniseni impendulo njengenjongo ejoliswe kuyo kuba ezinye iimpendulo zePavlovian nazo zinokuba novelwano kolu qheliso (IHolland kunye neRescorla, ngo-1975). Nangona kunjalo, ukusebenza kweenjongo ezijoliswe kwiinjongo zezixhobo zikwanovakalelo ekusetyenzisweni kwesiphumo sesiphumo esilindelekileyo, ngelixa iimpendulo zePavlovian zinovakalelo malunga nokunyanzeliswa kwesiphumo sokuvuselela (Rescorla, ngo-1968; UDavis noBitterman, ngo-1971; UDickinson noCharnock, ngo-1985). Imeko ebalulekileyo, nangona kunjalo, inokufumaneka kwimeko yemikhwa (jonga apha ngezantsi), efana kakhulu neempendulo zePavlovian ekungakhathaliyo kwazo kwiinguqu kwi-instrument contingency, kodwa nazo zingenakuthintelwa ukuthotywa kwesiphumo ngenxa yokuba isiphumo asiyonxalenye. yesakhiwo esimelayo esilawula ukusebenza (cf. I-Dickinson, i-1985 kwaye ngezantsi kwingxoxo eqhubekayo).

Ukushwankathela, ngoko ke, kubaluleke kakhulu ukuba impendulo ethile ichazwe ngokucacileyo kwixesha lexesha elingalindelekanga elilawulayo kunokuba mhlawumbi ifom yempendulo okanye umsebenzi wokuziphatha osetyenzisiweyo ukuseka. Ngaphandle kokuphonononga ulawulo olunokwenzeka kwimeko enikiweyo, zombini indlela yokuziphatha kunye neenkqubo ze-neural ezifunyenwe ukulamla indlela yokuziphatha kusenokwenzeka ukuba zingabhalwa ngendlela engeyiyo. Ekugqibeleni, njengoko siza kuxoxa, lolona lawulo lungalindelekanga, olufunyenwe ngokufunda nokuphunyezwa ziinkqubo zemithambo-luvo ezahlukileyo, ezilawula ukuziphatha, nangona zinokwabelana 'ngendlela yokugqibela eqhelekileyo'. Ke ngoko owona mceli mngeni uphambili kukuhamba ngaphaya kwembonakalo ukuze utyhile indlela yokuziphatha esisiseko yokulawula imeko (ukufumana isishwankathelo bona 1 Table). Ukuze wenze ibango lokuba izakheko ezithile ze-neural zilamla amandla athile engqondo, umz. ulwalathiso-njongo, ubume bokuziphatha kufuneka buvavanywe ngovavanyo lokuziphatha olufanelekileyo. Ukwenza ngenye indlela kukumema ukubhideka njengoko amaqela exoxa malunga nezikhombisi ezifanelekileyo ze-neural ngelixa esilela ukuqaphela ukuba imisebenzi yabo yokuziphatha inokuba kukulinganisa iziganeko ezahlukeneyo. Eyona nto ibalulekileyo, ekugqibeleni, yinto esiyifundayo sisilwanyana, hayi into ekholelwa ukuba isilwanyana siyayifunda, kwaye into efundwa sisilwanyana sinokutyhilwa kuphela ziimvavanyo eziphonononga ngokuthe ngqo umxholo wokufunda.

Ukwahlula kwe-Pavlovian-instrumental bekuya kuba yinto encinci, ukuba isilwanyana siyakwazi ukufunda into efanayo (thetha umbutho phakathi kwe-stimulus kunye nomvuzo) kungakhathaliseki ukuba yintoni na amalungiselelo okulinga. Ukusebenzisa awona manyathelo aqhelekileyo okufunda akhoyo kwi-neuroscience namhlanje, akukho ndlela yokuxela. Ngaloo ndlela abaphandi bahlala bebanga ukuba bafunda ukuziphatha okujoliswe kuko ngaphandle kokuvavanya ukuba ukuziphatha okubhekiselwe ngokwenene kujoliswe ekujoliswe kuyo. Nangona iindidi ezahlukeneyo zokufunda zikholisa ukucingelwa ukuba zibangelwa kukusetyenziswa 'kwemisebenzi' okanye 'ii-paradigms' ezahlukeneyo, amaxesha amaninzi abaphandi bayasilela ukubonelela ngengqiqo eyaneleyo yeengqikelelo zabo.

Umzekelo obalaseleyo walo mba kukusetyenziswa kweemaze ukufunda ukufunda. Enye ingxaki ngovavanyo lwe-maze kunye novavanyo oluhambelanayo, njengokukhethwa kwendawo emiselweyo, ubunzima bokuvavanya ukuhlukanisa impembelelo ye-Pavlovian (i-stimulus-reward) kunye nesixhobo (isenzo somvuzo) kwiimeko zokuziphatha (I-Dickinson, i-1994; I-Yin kunye ne-Knowlton, i-2002). Ke, ukuhamba nge-T-maze ukufumana ukutya kunokubonisa isicwangciso sokuphendula (jikela ngasekhohlo) okanye indlela nje ebekwe kwimeko ethile ukuya kwindawo ethile eyongezelelekileyo elawulwa lumanyano lokutya (cue-food association)Ukuphumla, ngo-1957). Enye indlela yokuvavanya ukuba ingaba le yokugqibela idlala indima na ekusebenzeni kukuguqula imaze; ngoku impendulo abafundi kufuneka baqhubeke nokujika bajike ngasekhohlo ngelixa abo basebenzisa imiqondiso engaphezulu yemaze kufuneka bajike ekunene. Kodwa ngaba abo baqhubeka bejikela ngasekhohlo ngenene besebenzisa isicwangciso sokuphendula okanye basondela nje kwezinye intra-maze cue ehambelana nokutya? Ayingomba ulula ukufumana, kuba ulawulo oluqhelekileyo lolawulo lwePavlovian lokuziphatha alunakusetyenziswa ngokulula kwizifundo zemaze. Enye yezi, ulawulo lwe-bidirectional, imisela ukuba izilwanyana zikwazi ukulawula impendulo ethile ngokufuna ukuguqulwa kolwalathiso lwaloo mpendulo ukuze ufumane umvuzo (Hershberger, ngo-1986; Heyes kunye noDawson, ngo-1990). Ngelishwa, kwi-maze, ukuguqulwa kwempendulo kusenokungonelanga ukuseka isenzo njengenjongo ejoliswe kuyo, kuba ukuguqulwa kunokufezekiswa ngokucima ubudlelwane obukhoyo kunye nokubuyisela omnye endaweni. Umzekelo, impuku esondela kwindawo ethile ye-intra-maze cue inokufunda, ngexesha lokubuyela umva, ukuba ayisadityaniswa nomvuzo, kodwa enye into evuselelayo, ekhokelela ekufumaneni indlela ye-CR ebhekiselele kwisivuseleli esitsha. Ke ngoko, banokuthi bayibuyisele umva impendulo yabo ngaphandle kokuba bafake ikhowudi yokufumana umvuzo wokuphendula. Ngenxa yokuba oku kunokwenzeka kungenakuvavanywa ngokusebenza, ukusetyenziswa kweemazes, iinkqubo zokukhethwa kwendawo, okanye imisebenzi elula ye-locomotor ukufunda iinkqubo zokufunda ezijoliswe kwiinjongo ziyingozi kakhulu kwaye zingabangela ukungahambi kakuhle kweenkqubo zokulawula ukuziphatha kunye nendima ethile yayo nayiphi na i-neural. iinkqubo ezifunyenwe zibandakanyeka (USmith-Roe noKelley, i-2000; Hernandez et al., 2002; Atallah et al., 2007).

I-Nucleus accumbens ayiyimfuneko ekufundeni izixhobo

Ukungaphumeleli kokuhlalutya kokuziphatha kwangoku kuyacaca ngokukodwa kwisifundo se-nucleus accumbens. Izifundo ezininzi zicebise ukuba esi sakhiwo sibaluleke kakhulu ekufumaneni izenzo ezijoliswe kwiinjongo (Hernandez et al., 2002; Goto noGrace, 2005; Hernandez et al., 2005; Pothuizen et al., 2005; I-Taha kunye neMimandla, i-2006; Atallah et al., 2007; I-Cheer et al., 2007; Lerchner et al., 2007). Kodwa esi sigqibo kuye kwafikelelwa kuso ngokusekwe ubukhulu becala kwimilinganiselo yotshintsho kwindlela yokusebenza yodwa, kusetyenziswa imisebenzi apho ukuziphatha kokulawula okunokwenzeka kungacacanga. Nangona uqwalaselo lokuba ukukhohlisa kuphazamisa ukufunyanwa kwempendulo ethile yokuziphatha kungabonisa ukusilela ekufundeni, banokubonisa impembelelo ekuqalisweni kwempendulo okanye inkuthazo. Ngokomzekelo, ukuphazamiseka ekufumaneni i-lever pressing kuhlala kubonisa umphumo ekusebenzeni kunokuba kufundwe (USmith-Roe noKelley, i-2000). Iijiko zokufumana izinto zodwa, njengenkcazelo engaphelelanga yayo nayiphi na inkqubo yokufunda, mazitolikwe ngononophelo (Gallistel et al., 2004). Ngelishwa, umahluko phakathi kokufunda nokusebenza, mhlawumbi esona sifundo sidala kwisifundo sokufunda, usoloko ungahoywa namhlanje.

Uhlalutyo oluneenkcukacha ngakumbi lubonisa ukuba i-accumbens ayiyomfuneko kwaye ayikwanelanga ekufundeni izixhobo. Izilonda zeqokobhe le-accumbens aziluguquli ubuntununtunu bokwenziwa komsebenzi ukuthotywa kweziphumo (de Borchgrave et al, 2002; UCorbit et al, ngo-2001) okanye ukuthotywa kwesixhobo esingalindelekanga (UCorbit et al, ngo-2001), ngelixa izilonda ze-accumbens core zifunyenwe ukunciphisa ubuntununtunu ekuhlahleni ngaphandle kokuphazamisa uvakalelo lweempuku ekuthotyweni okukhethiweyo kwimeko yesixhobo (Corbit et al., 2001). Olunye uphononongo oluvavanya isiphumo se-accumbens manipulations ekufumaneni impendulo entsha kwizifundo zokomelezwa kwemeko ziye zafumana isiphumo ekusebenzeni okunxulumene nomvuzo, ngakumbi ukongezwa kokusebenza kwe-amphetamine, kodwa hayi ekufumaneni impendulo nganye (iParkinson). kunye nabanye, ngo-1999). Ngokunjalo, uphononongo olucwangcisiweyo lukaKhadinali kunye noCheung alufumananga siphumo sezilonda eziphambili ze-accumbens ekufumaneni impendulo ye-lever press phantsi kweshedyuli eqhubekayo yokomeleza; ukufunyanwa okungalunganga kwajongwa kuphela ngokulibaziseka kokuqinisa (UKhadinali kunye neCheung, ngo-2005).

Nangona i-accumbens ingafaki i-instrumental contingency (i-Balleine & Killcross, i-1994; Corbit, Muir & Balleine, 2001), ubungqina obuninzi bubonisa ukuba inendima ebalulekileyo kwisixhobo ukwenza, indima esinokuyichaza ngcono ngoku xa sijonga umsebenzi wakutshanje. Njengoko kuqukunjelwe zizifundo ezininzi, i-accumbens ibalulekile kwiintlobo ezithile zemeko ye-Pavlovian enomdla, kwaye ilamla zombini iziphumo ezingachanekanga ezinokuthi zifumane umvuzo ekusebenzeni kwesixhobo, kunye nesiphumo esikhethekileyo ekukhetheni impendulo eveliswayo. ngeempawu ezinjalo. Izilonda ze-core, okanye i-cingulate yangaphambili, umthombo omkhulu we-cortical input kwi-core, okanye uqhawulo phakathi kwezi zakhiwo zimbini, ukuphazamisa ukufunyanwa kwendlela yokuziphatha kwePavlovian (Parkinson et al., 2000). Ukufakwa kwendawo ye-D1-efana ne-dopamine receptor antagonist okanye i-NMDA glutamate receptor antagonist ngokukhawuleza emva koqeqesho nayo iyonakalisa le ndlela yokufunda ngaphandle kokuchaphazela ukusebenza (Dalley et al., 2005). Ezi datha ziyavumelana nemilinganiselo ye kwi vivo umsebenzi we-neural. Ngokomzekelo, uCarelli kunye noogxa bafumanisa ukuba i-neurons kwi-accumbens core inokutshintsha umsebenzi wabo ngokucwangcisiweyo ngexesha lokufunda umsebenzi we-autoshaping wePavlovian (Imini et al., 2006; Usuku kunye neCarelli, 2007).

IiNeurons ezikummandla weqokobhe zibonakala zilungelelaniswe nemivuzo kunye nezivuseleli eziphikisayo, nangaphambi kwawo nawaphi na amava okufunda; bayakwazi nokuphuhlisa iimpendulo kwii-CS eziqikelela ezi ziphumo (Roitman et al., 2005). Sebenza nguBerridge kunye nabalingane, ngaphezu koko, iye yaphakamisa amathuba okuba imimandla ethile kwi-nucleus accumbens iqokobhe kunye ne-downstream ventral pallidum inokuphawulwa njenge-'hedonic hotspots.' Ezi ndawo zimodareyitha ngokuthe ngqo iimpendulo ze-hedonic ezivuzwayo, ezifana nokuphinda kusebenze. Umzekelo, ii-agonists ze-opioid receptors kule mimandla zinokukhulisa kakhulu incasa yokungena kwi-sucrose. Imimandla ehlala kwindawo ephezulu, nangona kunjalo, ifakwe kuthungelwano olubanzi olungadlali nxaxheba ekuziphatheni okunqwenelayo.I-Taha kunye neMimandla, i-2005; UPecina et al., 2006; I-Taha kunye neMimandla, i-2006).

Umahluko kwiindima ezihambelanayo zondoqo kunye neqokobhe ubonakala ungomnye phakathi kokulungiselela kunye nokuziphatha okunqwenelayo, ngokulandelelana, okunokuguqulwa ngokulula ngamava ngeentlobo ezahlukeneyo zemeko yePavlovian. Iimpendulo zolungiselelo ezifana nendlela zinxulunyaniswa neempawu zovakalelo ngokubanzi zesiphumo, kanti iindlela zokuziphatha ezigqibeleleyo zinxulunyaniswa neempawu zovakalelo ezithe ngqo; zikwachaphazeleka ngokwahlukileyo kwiintlobo ezahlukeneyo ze-CS, umz. iimpendulo ezilungiselelweyo zilungiswa ngokulula kunye nesivuseleli esinexesha elide (Konorski, ngo-1967; UDickinson kunye noDearing, ngo-1979; I-Balleine, 2001; UDickinson kunye neBalleine, i-2002).

Ngayiphi na indlela, ubungqina obubandakanya i-accumbens kwezinye iinkalo ze-Pavlovian conditioning buninzi. Nangona kunjalo, ayisiyiyo kuphela isakhiwo esibandakanyekayo, kunye nezinye iinethiwekhi, ezifana nezo zibandakanya i-nuclei ye-amygdaloid eyahlukeneyo, nazo zibonakala zidlala indima ephambili kwizinto zombini zokulungiselela kunye ne-consummatory ye-Pavlovian conditoning. (IBalleine kunye neKillcross, 2006).

Omnye umsebenzi onokuthi uchazwe ngokucacileyo kwi-accumbens ukuhlanganiswa kweempembelelo zePavlovian ekuziphatheni kwezixhobo. I-Pavlovian CRs, kubandakanywa nezo zibonakalisa ukusebenza kweendawo ezikhuthazayo eziphambili, ezifana nokukhanga kunye nokuvuswa, kunokusebenzisa impembelelo enamandla ekusebenzeni kwezixhobo zokusebenza (UTrapold noOvermier, ngowe-1972; Lovibond, ngo-1983; eHolland, ngo-2004). Ngokomzekelo, i-CS eqikelela ngokuzimeleyo ukuhanjiswa kokutya inokunyusa ukuphendula kwesixhobo sokutya okufanayo. Esi siphumo sifundwa ngokuqhelekileyo kusetyenziswa i-Pavlovian-instrumental transfer paradigm (PIT). Kwi-PIT, izilwanyana zifumana izigaba ezihlukeneyo zePavlovian kunye nezixhobo zoqeqesho, apho zifunda, ngokuzimeleyo, ukudibanisa i-cue kunye nokutya, kunye nokucinezela i-lever yokutya okufanayo. Emva koko kwiimvavanyo zeprobe, i-cue inikezelwa nge-lever ekhoyo, kwaye ukuphakama kwamazinga okuphendula phambi kwe-CS kulinganiswa. Iindlela ezimbini zePIT zichongiwe; enye inxulumene nefuthe elivuselelayo ngokubanzi lemikhombandlela enxulumene nomvuzo kunye neyesibini isiphumo esikhethiweyo ngakumbi kwintsebenzo ekhethiweyo eveliswe yimeko eqikelelweyo ye-cue ngentlonipho yomvuzo othile ngokuchasene neminye. Iqokobhe le-accumbens liyimfuneko kolu hlobo lokugqibela lukhethekileyo lwe-PIT, kodwa aluyomfuneko kuhlobo lwangaphambili, oluqhelekileyo okanye kubuntununtunu ekuthotyweni kwesiphumo; ngokuchaseneyo, izilonda ze-accumbens core zinciphisa ubuntununtunu kuzo zombini ukuhla kwesiphumo kunye nohlobo oluqhelekileyo lwe-PIT kodwa zishiya i-PIT echanekileyo kwisiphumo esithile (Corbit et al., 2001; (IBalleine kunye neCorbit, ngo-2005).

Uphononongo lwakutsha nje lunikeze ingcaciso eyongezelelekileyo kwindima yeqokobhe le-accumbens kwi-PIT ethe ngqo kwisiphumo (Wiltgen et al., 2007). Ukubonakaliswa okulawulwayo kwe-calcium esebenzayo / i-calmodulin-exhomekeke kwiprotheni kinase II (CaMKII) kwi-striatum ayizange ichaphazele i-instrumental okanye i-Pavlovian yokufunda, kodwa yacima i-PIT ethile. Le ntsilelo kwi-PIT yayingenasigxina kwaye inokuguqulwa ngokucima intetho ye-transgene kunye ne-doxycycline, ebonisa ukuba intsilelo yayinxulumene nokusebenza kuphela. Ukuphucula ngokufanelekileyo inqanaba le-CaMKII kwi-striatum ke ngoko kuthintela ugqithiselo oluchanekileyo lwesiphumo senkuthazo ukusuka kwi-Pavlovian ukuya kwinkqubo yesixhobo. Okubangela umdla kukuba, ukuguqula iCaMKII transgene kwafunyaniswa ukunciphisa ubumnandi bee-neurons kwiqokobhe le-accumbens, ngaphandle kokuchaphazela ukuhanjiswa kwe-basal okanye amandla e-synaptic.

I-dorsal striatum

I-dorsal striatum, ekwabizwa ngokuba yi-neostriatum okanye i-caudate-putamen, ifumana uqikelelo olukhulu oluvela kwinto ebizwa ngokuba yi-neocortex. Inokwahlulwa kwakhona ibe ngummandla odibeneyo, ophakathi kweempuku kunye nokuqhubekayo kunye ne-ventral striatum, kunye nommandla we-sensorimotor osecaleni. (IGroenewegen et al., 1990; UJoel noWeiner, ngo-1994). Iyonke, i-dorsal striatum ivalwa ziiseli ze-DA ezivela kwi-substantia nigra pars compacta (SNc), kwaye ifumana kuphela uqikelelo oluncinci kwi-VTA DA neurons. (UJoel noWeiner, ngo-2000). Umsebenzi wangaphambili kwi-dorsal striatum ugxile kakhulu kwindima yayo kwi-stimulus-response (SR) yokufunda umkhwa (Miller, 1981; Mhlophe, 1989). Lo mbono usekelwe kumthetho wesiphumo, ngokwendlela umvuzo owenza ngayo ukuqinisa, okanye ukuqinisa, umbutho we-SR phakathi kwe-stimuli yendalo kunye nempendulo eyenziwa ngenxa yokuba ukuthambekela ukwenza loo mpendulo kwanda phambi kwabo. ukuvuselela (I-Thorndike, 1911; Hull, ngo-1943; Miller, 1981). Ke ngoko indlela ye-corticostriatal icingelwa ukuba ilamle ukufunda kwe-SR kunye ne-DA esebenza njengophawu lokuqinisa (Miller, 1981; UReynolds kunye neWickens, 2002).

Imifuziselo ye-SR inenzuzo yokuqulatha umgaqo ophantsi wokuguqulela ukufunda kwintsebenzo. Imodeli esekelwe kwizinto ezilindelekileyo ezinxulumene nezenzo, ngokuchaseneyo, intsonkothe ​​ngakumbi kuba inkolelo ethi "Inyathelo A likhokelela kwiSiphumo O" akunyanzelekanga ukuba liguqulelwe kwisenzo (Guthrie, ngo-1935; IMackintosh, 1974); ulwazi olulolu hlobo lunokusetyenziswa kokubini ukwenza u-'A' kunye nokuphepha ukwenza u-'A'. Ngesi sizathu, iithiyori zemveli zayigatya eyona ngcaciso icacileyo-eyile yokuba izilwanyana zinokufumana isiphumo esinesiphumo esikhokelela ekuziphatheni okukhethileyo. Kumashumi ambalwa eminyaka edlulileyo, nangona kunjalo, ubone uhlaziyo olukhulu lomthetho wesiphumo (I-Adams, 1982; Colwill kunye neRescorla, ngo-1986; I-Dickinson, i-1994; UDickinson et al., 1996). TIziphumo zophononongo oluninzi zibonise ukuba izenzo zesixhobo zinokujoliswa ngokwenyani, oko kukuthi, uvakalelo kutshintsho lwexabiso lomvuzo kunye nokusebenza kakuhle kwesizathu. (jonga uDickinson & Balleine, 1994; 2002; I-Balleine, 2001 uphononongo). Nangona kunjalo, ngexesha loqeqesho olubanzi phantsi kweemeko eziqhubekayo, kwanezenzo ezisandul 'ukufunyanwa zinokuthi zizenzekele kwaye ziqhutywe-inkqubo eyaziwa ngokuba yinkqubo yesiqhelo (UAdams noDickinson, ngo-1981; I-Adams, 1982; Yin et al., 2004). Imikhwa echazwe ngolu hlobo, ikhutshwe ngokuzenzekelayo yi-stimuli yangaphambili, ayilawulwa ngokulindelekileyo okanye ukubonakaliswa kwesiphumo; ngenxa yoko abanakho ukutshintsha kwixabiso lesiphumo. Ngokwale mbono, umthetho wesiphumo ngoko ke yimeko ekhethekileyo esebenza kuphela ekuziphatheni okuqhelekileyo.

Ukuhlelwa kwangoku kwendlela yokuziphatha kwezixhobo kuyahlula ibe ziindidi ezimbini. Tiklasi yokuqala iquka izenzo ezijoliswe kwiinjongo ezilawulwa yimeko enokwenzeka; okwesibini, indlela yokuziphatha engenakukwazi ukutshintsha kwixabiso lesiphumo (1 Table). Ukusebenzisa iimvavanyo zokuziphatha ezifana nokuthotywa kwesiphumo kunye nokuthotywa kwesixhobo esinokwenzeka, u-Yin et al waseka ukwahlukana okusebenzayo phakathi kwe-sensormotor (dorsolateral striatum, DLS) kunye nemimandla yokudibanisa (i-dorsomedial striatum, i-DMS) ye-dorsal striatum.I-Yin kunye ne-Knowlton, i-2004; Yin et al., 2004, 2005a; Yin et al., 2005b; Yin et al., 2006a). Izilonda ze-DLS zonakalise ukuphuhliswa kwemikhwa, okukhokelela kwindlela yokulawula ukuziphatha okujoliswe ngakumbi. Izilonda ze-DMS zinempembelelo echaseneyo kwaye zikhokelela ekutshintsheni kwinjongo-ejoliswe kulawulo oluqhelekileyo. U-Yin et al waphetha, ngoko ke, ukuba i-DLS kunye ne-DMS inokudityaniswa ngokusebenzayo ngokubhekiselele kuhlobo lwezakhiwo ezihlangeneyo ezixhasayo: i-DLS ibaluleke kakhulu ekwenzeni umkhwa, kanti i-DMS ibaluleke kakhulu ekufumaneni nasekuboniseni izenzo ezijoliswe kwiinjongo. Olu hlalutyo luqikelela ukuba, phantsi kweemeko ezithile (umz. uqeqesho olwandisiweyo) ulawulo lwezenzo lunokutshintsha ukusuka kwinkqubo exhomekeke kwi-DMS ukuya kwinkqubo exhomekeke kwi-DLS, isiphelo esivumelana ngokubanzi kunye noncwadi olubanzi kwiiprimates, kubandakanywa ne-neuroimaging yabantu.Hikosaka et al., 1989; Jueptner et al., 1997a; UMiyachi et al., ngo-1997; UMiyachi et al., ngo-2002; Delgado et al., 2004; UHaruno et al., 2004; Tricomi et al., 2004; Delgado et al., 2005; Samejima et al., 2005; IHaruno kunye neKawato, ngo-2006a, b; Lohrenz et al., 2007; UTobler et al., 2007). Kufuneka kukhunjulwe, kunjalo, tindawo ekhoyo yomnqwazi (umz. idorsal okanye i-ventral) iyodwa ayinakuba sisikhokelo esithembekileyo ekuthelekiseni i-rodent striatum kunye neprimate striatum; uthelekiso olunjalo kufuneka lwenziwe ngononophelo, emva kokuqwalaselwa ngokucophelela koqhagamshelwano lwe-anatomical.

Iziphumo zezilonda ze-dorsal striatal zinokuthelekiswa nezo zezilonda ze-accumbens (USmith-Roe noKelley, i-2000; Atallah et al., 2007). Njengoko sele kukhankanyiwe, iimvavanyo ezisemgangathweni zokuseka indlela yokuziphatha 'njengejolise kwinjongo' kukuthotywa kweziphumo kunye nokuthotywa kwemeko elindelekileyo yesiphumo (action-outcome contingency).UDickinson kunye neBalleine, i-1993). Izilonda ze-DMS zenza ukuba ukuziphatha kungabi naluvelwano kuzo zombini ezi nguqulelo (Yin et al., 2005b), ngelixa izilonda ze-accumbens core okanye iqokobhe azenzi (Corbit et al., 2001). Ngaphaya koko, iimvavanyo zeprobe zolu vavanyo lokuziphatha luqhutywa ngokuphela, ngaphandle kokunikezelwa kwawo nawuphi na umvuzo, ukuze kuvavanywe ukuba isilwanyana sifunde ntoni ngaphandle kokungcoliswa kukufunda okutsha. Baphonononga ngokuthe ngqo ubume bomelo obulawula ukuziphatha. Njengolawulo olongezelelekileyo lovavanyo, kudla ngokuba luncedo ukwenza uvavanyo olwahlukileyo lokuthotywa ixabiso apho imbuyekezo inikezelwa ngokwenene-into ebizwa ngokuba 'luvavanyo oluvuzayo.' Izilonda ze-DMS azizange ziphelise ubuntununtunu kwisiphumo sokuthotywa kwexabiso kuvavanyo oluvuzwayo, njengoko kufanele kulindelwe ukususela ekubeni ukunikezelwa kwesiphumo esincitshisiweyo esixhomekeke kwisenzo sinokucinezela isenzo ngokuzimeleyo kwi-encoding ye-action-outcomed. I-Accumbens izilonda zegobolondo, kwelinye icala, ayizange iphazamise ubuntununtunu ekuhlalutyweni kwesiphumo nokuba kuvavanyo lokutshabalala okanye uvavanyo oluvuzayo, ngelixa i-accumbens izilonda ezingundoqo ziphelise ubuntununtunu bokunciphisa ixabiso kuzo zombini iimvavanyo (Corbit et al., 2001). Uvakalelo lokuthotywa okunokwenzeka, nangona kunjalo, akuzange kuchaphazeleke nokuba sesiphi isilonda, nto leyo ebonisa ukuba, emva kwezilonda eziqokeleleneyo, iimpuku zikwazile ukubethelela kunye nokubuyisela imiboniso yeziphumo zentshukumo.

Indima ye-dopamine: i-Mesolimbic vs. nigrostriatal

Ukusukela oko kusenziwa izifundo zobuvulindlela kumsebenzi we-phasic we-DA neurons kwiinkawu, ukucinga okuqhelekileyo kwintsimi kukuba zonke iiseli ze-DA ziziphatha ngendlela efanayo.Schultz, 1998a; UMontague et al., 2004). Nangona kunjalo, idatha ekhoyo, kunye noqhagamshelwano lwe-anatomical, lucebisa ngenye indlela. Ngapha koko, uhlalutyo olungentla lwe-heterogeneity esebenzayo kwi-striatum inokwandiswa kwiiseli ze-DA kwi-midbrain ngokunjalo.

Iiseli ze-DA zinokwahlulwa zibe ngamaqela amabini amakhulu: i-VTA kunye ne-substantia nigra pars compacta (SNc). Nangona ingqikelelo evela kwi I-VTA to accumbens ibe liziko lengqwalasela kwinkalo yokufunda enxulumene nomvuzo, eyona ndlela inkulu ye-nigrostriatal ayihoywanga., ingqalelo ejoliswe ngokuyintloko kwindima yayo kwisifo sikaParkinson. Ukucinga kwangoku ngendima ye I-DA ekufundeni iye yaphenjelelwa kakhulu sisindululo sokuba umsebenzi we-phasic weeseli ze-DA ubonisa i-erro yokubikezela umvuzo.r (I-Ljungberg et al., 1992; Schultz, 1998b). Mnan owona msebenzi uqhelekileyo we-Pavlovian conditioning osetyenziswa nguSchultz kunye noogxa, ezi neurons zivutha umlilo ekuphenduleni umvuzo (US) kodwa, ngokufunda, umsebenzi okhutshwe e-US utshintshelwe kwi-CS. Xa i-US ishiywe emva kokufunda, iiseli ze-DA zibonisa ukudakumba okufutshane kumsebenzi ngexesha elilindelekileyo lokunikezelwa kwayo (I-Waelti et al., 2001; UFiorillo et al., 2003; UTobler et al., 2003). Ezo datha zenza isiseko seemodeli ezahlukeneyo zokubala (Schultz et al., 1997; Schultz, 1998b; Brown kunye al., 1999; UMontague et al., 2004).

Ukunikezelwa kwamanqanaba amaninzi olawulo kwiindlela zokwenziwa kunye nokukhululwa, i-spiking ye-DA neurons ayinakulinganiswa nokukhululwa kwe-DA, nangona umntu unokulindela ukuba le milinganiselo mibini idityaniswe kakhulu. Ewe, njengoko kubonisiwe kuphononongo lwakutsha nje olwenziwa nguCarelli kunye noogxa basebenzisa i-voltammetry ekhawulezayo yokuskena, Ukukhutshwa okwenyani kwe-DA kumbindi we-accumbens kubonakala kunxibelelene nempazamo yokuxela kwangaphambili kwimeko yePavlovian enomdla. (Imini et al., 2007). Bafumene umqondiso we-phasic we-DA kumbindi we-accumbens kwangoko emva kokufumana umvuzo we-sucrose kwi-autoshaping yasePavlovian. Emva kwemeko eyandisiweyo yePavlovian, nangona kunjalo, lo mqondiso awuzange ufunyanwe emva komvuzo ngokwawo, kodwa watshintshela kwi-CS endaweni yoko.. Oku kufunyanisiweyo kuxhasa uqikelelo 'lweprediction error' yokuqala. Kwakhona kuhambelana nomsebenzi wangaphambili obonisa ukusebenza kakubi kwePavlovian CR emva kokuba i-DA receptor antagonism okanye i-DA iyancipha kwi-accumbens core (Di Ciano et al., 2001; Parkinson et al., 2002). Nangona kunjalo, uqwalaselo olunye oluvela kwisifundo lutsha kwaye lunomdla omkhulu: emva kokumiswa kwemeko eyandisiweyo kunye ne-CS + eqikelela umvuzo kunye ne-CS- engenakuqikelela umvuzo, okufanayo, nangona kuncinci, umqondiso we-DA wabonwa emva kwe-CS-, nangona kunjalo. iphinde yabonisa ukuntywila okuncinci kwangoko (500 ~ 800 millisecond emva kokuqala kwecue) emva kwencopho yokuqala (Usuku et al, 2007, Umfanekiso 4). Ngeli nqanaba lokufunda, izilwanyana phantse azisondeli kwi-CS−, kodwa zihlala zisondela kwi-CS+. Ngaloo ndlela umqondiso we-DA we-phasic ngokukhawuleza emva kokuba i-predictor ayinakudlala indima ye-causal ekuveliseni impendulo yendlela, kuba ikhona nangona ukungabikho kwempendulo. Ukuba olo phawu lusafuneka na ukuze kufundwe imeko ye-stimulus-woward contingency kuhlala kungacaci, kodwa impendulo ye-phasic eqatshelweyo kwi-CS- ngokuqinisekileyo ayiqikelelwanga yiyo nayiphi na imodeli yangoku.

Okubangel 'umdla kukuba, ukucutheka kwe-DA yendawo kuyonakalisa ukusebenza kwalo msebenzi (Parkinson et al., 2002). Ngelixa umqondiso we-phasic weDA ubonwa emva kwe-CS-, engavelisi ii-CRs kwaphela, ukuphelisa zombini i-phasic kunye ne-tonic DA ngokuncipha kwendawo kuyonakalisa ukusebenza kwee-CRs. Umzekelo onjalo ubonisa ukuba i-phasic DA isignali kwi-accumbens ayidingeki ekusebenzeni kwe-Pavlovian CR, kodwa inokudlala indima ekufundeni, ngelixa i-sounder ecothayo, i-tonic ye-DA yesiginali (ekusenokwenzeka ukuba yapheliswa kwizifundo zokunciphisa) ibaluleke kakhulu ekusebenzeni. yempendulo yendlela (Cagniard et al., 2006; Yin et al., 2006b; I-Niv et al., 2007). Oku kunokwenzeka kusaza kuvavanywa.

Nangona kungekho bungqina buthe ngqo bendima eyi-causal ye-phasic signal ye-DA ekufundeni, ingqikelelo ethi 'prediction error' nangona kunjalo itsalele ingqalelo enkulu, kuba kanye kanye luhlobo lwemiqondiso yokufundisa esetyenziswa kwiimodeli eziphambili zokufunda, njengemodeli yeRescorla-Wagner kunye nolwandiso lwexesha lokwenyani umahluko wexeshana wokomeleza ialgorithm yokufunda (Schultz, 1998b). Ngokwale toliko, ukufunda ngokungxama kumiselwa ngumahluko phakathi komvuzo ofunyenweyo nolindelweyo (okanye phakathi koqikelelo lwemivuzo emibini elandelelanayo okwethutyana). Umqondiso onjalo wokufundisa ulawulwa yingxelo engalunganga evela kubo bonke abaqikeleli bomvuzo (Schultz, 1998b). Ukuba akukho mvuzo ulandela i-predictor, emva koko indlela yempendulo engalunganga iyatyhilwa njengediphu kumsebenzi we-DA neurons. Ke ngoko, ukufunda kubandakanya ukucutha okuqhubekayo kwempazamo yokuqikelela.

Ubuhle bomqondiso wokufundisa kule mifuziselo mhlawumbi bubaphazamisile abanye kwinyani ye-anatomical. Kuphononongo ngo Usuku et al (2007), isibonakaliso se-DA kwi-accumbens sivela kakhulu kwiiseli ze-VTA, kodwa kubonakala kungenakwenzeka ukuba ezinye iiseli ze-DA, ezinoqhagamshelwano oluhluke ngokupheleleyo lwe-anatomical, zingabonisa iprofayili yokuphendula efanayo kwaye zinike uphawu olufanayo. I-gradient kwinto enokwenzeka kwiiseli ze-DA, kuba iiseli ze-DA ziprojekthi kwiindawo ezahlukeneyo zokuzala ezinemisebenzi eyahluke ngokupheleleyo, kwaye zifumana, ngokulandelelana, izibonakaliso zempendulo ezingalunganga ezivela kwimimandla eyahlukeneyo yokubetha.UJoel noWeiner, ngo-2000; Wickens et al., 2007). Iindlela zokuthatha kunye nokuthotywa, kunye ne-presynaptic receptors ezilawula ukukhutshwa kwe-dopamine, zikwabonisa umahluko omkhulu kwi-striatum (UCragg et al., ngo-2002; Irayisi kunye neCragg, ngo-2004; Wickens et al., 2007; Irayisi kunye neCragg, ngo-2008).

Siphakamisa, ke ngoko, ukuba indlela ye-mesoaccumbens idlala indima ethintelweyo ngakumbi ekufundeni kwePavlovian, ekufumaneni ixabiso lamazwe kunye ne-stimuli, ngelixa indlela ye-nigrostriatal ibaluleke kakhulu ekufundeni kwezixhobo, ekufumaneni ixabiso lezenzo. TUmnqwazi kukuba, umqondiso we-phasic weDA unokufakela iimpazamo ezahlukeneyo zokuxela kwangaphambili, kunempazamo enye yoqikelelo, njengoko kucingelwa ngoku. Iindlela ezintathu zobungqina ezixhasa le ngxoxo. Okokuqala, ukuchithwa kofuzo lwe-DA kwindlela ye-nigrostriatal yonakalisa ukufunyanwa kunye nokusebenza kwezenzo zezixhobo, ngelixa ukuchithwa kwe-DA kwindlela ye-mesolimbic (I-Sotak et al., 2005; URobinson et al., 2007). Okwesibini, iiseli ze-DA kwi-SNc zinokufaka ikhowudi yexabiso lezenzo, ezifana neeseli ezikummandla wazo wokubethelela (UMorris et al., 2006). Okwesithathu, isilonda esikhethiweyo se-nigrostriatal projection ukuya kwi-DLS yonakalisa ukwakheka komkhwa (Faure et al., 2005).

Umsebenzi wakutsha nje kaPalmiter kunye noogxa babonise ukuba iimpuku ezinqongopheleyo ze-DA ezenziwe ngofuzo ziphazamiseke kakhulu ekufundeni kwezixhobo kunye nokusebenza, kodwa ukusebenza kwazo kunokubuyiselwa ngenaliti ye-L-DOPA okanye ngokugqithiselwa kofuzo lwentsholongwane kwindlela ye-nigrostriatal.I-Sotak et al., 2005; URobinson et al., 2007). Ngokwahlukileyo, ukubuyiselwa kwe-DA kwi-ventral striatum bekungeyomfuneko ukubuyisela isimilo sezixhobo. Nangona indlela imiqondiso ye-DA ikwenza ngayo ukufunda ngezixhobo ihleli ingumbuzo ovulelekileyo, enye into enokwenzeka ecacileyo kukuba inokubethelela ixabiso lezenzo zokuzenzela, okt ungakanani umvuzo oqikelelweyo xa kunikwa ikhondo elithile lesenzo.

I-dorsal striatum, iyonke, iqulethe ukubonakaliswa okuphezulu kwe-DA receptors kwingqondo, kwaye ifumana eyona projekthi inkulu ye-dopaminergic.. Uqikelelo lwe-DA kwi-DMS lunokudlala indima eyahlukileyo ekufundeni kunoqikelelo lwe-DLS, njengoko le mimandla mibini ihluke kakhulu kwiprofayili yexeshana yokukhululwa kwe-DA, ukuthathwa, kunye nokuthotywa.Wickens et al., 2007). Siqikelela ukuba uqikelelo lweDA oluya kwi-DMS olusuka kwi-medial SNc lubaluleke kakhulu kwisiphumo sokufunda, kanti uqikelelo lwe-DA oluya kwi-DLS olusuka kwi-lateral SNc lubalulekile ekwenzeni umkhwa. Ukuba oku kuyinyani, umntu kufuneka alindele iiseli ze-DA kwi-SNc ukuba zifake impazamo kwingqikelelo yomvuzo esekwe kwizenzo ezenziweyo-impazamo yesixhobo sokuxela kwangaphambili-kunokuba isekwe kwi-CS. Ubungqina bokuqala bokuxhasa eli bango buvela kuphononongo olutshanje lukaMorris et al, orekhode kwi-SNc neurons ngexesha lomsebenzi wokufunda wezixhobo (UMorris et al., 2006). Iinkawu zaqeqeshelwa ukuhambisa iingalo zazo ngokusabela kwimpembelelo yocalucalulo (SD) ebonisa intshukumo efanelekileyo kunye nokuba nokwenzeka komvuzo. I-SD Ukwenziwa komsebenzi we-phasic kwi-DA neurons ehambelana nexabiso lesenzo ngokusekelwe kumvuzo olindelekileyo wesenzo esithile. Eyona nto inika umdla, nangona impendulo yeDA kwi-SD inyuswe ngexabiso lesenzo, i-inverse yayiyinyani yempendulo ye-DA kumvuzo ngokwawo, ngokuhambelana nombono wokuba ezi neurons zifakela impazamo yokuxela kwangaphambili ehambelana nelo xabiso. Akumangalisi ukuba, eyona nto iphambili ekujoliswe kuyo kwezi seli, i-caudate nucleus, yaziwa ngokuba inee-neuron ezifaka amaxabiso esenzo.Samejima et al., 2005). Kufuneka kuqatshelwe, nangona kunjalo, ukuba olu phononongo aluzange lusebenzise imisebenzi yokuziphatha evavanya ngokungathandabuzekiyo ixabiso lezenzo. Uqikelelo olucacileyo lwemodeli yethu kukuba umsebenzi we-phasic we-DA uya kukhapha ukwenziwa kwezenzo, nokuba kungabikho i-S ecacileyo.D. Umzekelo, siqikelela ukudubula kwe-nigral DA neurons ngexesha lokuzenzela umvuzo.

Ngokombono wethu, ngelixa i-mesoaccumbens i-signal ye-DA ibonisa ixabiso le-CS, isibonakaliso se-nigrostriatal, mhlawumbi ukusuka kwezo neurons ezijoliswe kwi-DMS, zibonisa ixabiso lesenzo ngokwalo, okanye nayiphi na i-SD eliqikelela eli xabiso. Ngaphezu koko, zombini izixhobo kunye nokufunda kwePavlovian kubonakala kubandakanya uhlobo oluthile lwengxelo engalunganga yokulawula umqondiso wokufundisa osebenzayo. Ngapha koko, uqikelelo oluthe ngqo ukusuka kwi-striatum ukuya kwi-Midbrain DA neurons (Umzobo 2) kudala kucetywayo njengokuphunyezwa kwe-neural yolu hlobo lwengxelo engalunganga (IHouk et al., 1995), kunye namandla kunye nendalo yegalelo le-inhibitory inokwahluka kakhulu ukusuka kummandla ukuya kummandla.

Umzobo 2  

Uthungelwano lwe-cortico-basal ganglia

Impazamo yokuqikelela, ngokweemodeli zangoku, luphawu lokufundisa olumisela ukuba kungakanani na okwenzekayo ekufundeni. Okoko kusekho, ukufunda kuyaqhubeka. Nangona kunjalo ngokucacileyo eli bango libonakala, impazamo yokuxela kwangaphambili ngexabiso lesenzo, nangona i-syntactically ifana nempazamo ye-Pavlovian yokubikezela, ineempawu ezizodwa ezingakhange zihlolwe ngokubanzi. Kwiimodeli zemveli ezifana nemodeli ye-Rescorla-Wagner, ejongene ngokukodwa ne-Pavlovian conditioning (nangona inempumelelo encinci), into ephambili yimpendulo engalunganga elawula impazamo yokuxela kwangaphambili. Esi siphumo simele uqikelelo olufunyenweyo, ngakumbi ngakumbi isixa yazo zonke iziqikelelo zangoku, njengoko zibanjiwe yi-compound stimuli eqhelekileyo esetyenziswa ekuthinteleni imifuniselo (Rescorla, ngo-1988). Sesi sishwankathelo soqikelelo olukhoyo lokuseka igama leempazamo zehlabathi elilelona litsha liphambili kolu didi lwemodeli. Kwizinto ezenziwayo, nangona kunjalo, amagama eempazamo zomntu ngamnye abonakala enokwenzeka ngakumbi, kuba kunzima ukubona ukuba ingxelo engalunganga ingabonisa njani ixabiso lezenzo ezininzi ngaxeshanye xa inyathelo elinye kuphela elinokwenziwa ngexesha. Kakade ke, zininzi izisombululo ezinokubakho. Umzekelo, unikwe ilizwe elithile (eliphunyezwe ngovavanyo nguSD), iikhosi ezinokwenzeka zezenzo zinokubonakaliswa ngaxeshanye njengoqikelelo olufunyenweyo. Kodwa ubunzima obuphambili ngeempazamo zokuxela kwangaphambili kunento yokwenza nobume besenzo ngokwaso. Ukubikezelwa kwePavlovian ngokuzenzekelayo kulandela ukunikezelwa kwe-stimulus, ezimeleyo kwi-organism. Impazamo yoqikelelo lwesixhobo kufuneka ijongane nesiqalelo solawulo, kuba uqikelelo ngokwalo luxhomekeke kwintshukumo, kwaye isenzo esicingisisiweyo sikhutshwa ngokuzenzekela ngokusekwe ekusukeleni kwezilwanyana iziphumo zokwenza endaweni yokuba kuthiwe thaca sisivuseleli sangaphambili. Ekugqibeleni, ngokuchanekileyo kukungahoywa ngokubanzi kwemvelo ezenzekelayo yezenzo ezijoliswe kwiinjongo, kwi-neuroscience kunye ne-psychology, eye yaphazamisa ukuhlukana phakathi kwePavlovian kunye neenkqubo zokufunda izixhobo, kunye nohlobo lweempazamo zokubikezela ezibandakanyekayo. Kuhlala kusekwa, ke ngoko, ukuba luhlobo luni lwesignali yengxelo engalunganga, ukuba ikhona, elawula ukufunyanwa kwamaxabiso entshukumo (I-Dayan kunye neBalleine, 2002).

Okokugqibela, umsebenzi wamva nje ubandakanye uqikelelo lwe-nigrostriatal ukusuka kwi-SNc esecaleni ukuya kwi-DLS ngokukodwa kulwakhiwo lwesiqhelo. UFaure et al ukhethe ngokukhetha iiseli ze-DA ezibonisa i-DLS usebenzisa i-6-OHDA, kwaye wafumanisa ukuba oku kukhohlisa kunempembelelo encinci kwisantya sokucinezela i-lever, nangona kuphazamisa ukwakheka komkhwa, njengoko kulinganiswe kusetyenziswa ukuthotywa kwesiphumo.Faure et al., 2005). Okokuthi, izilwanyana ezinobungozi ziphendule ngendlela ejoliswe kuyo, nangona, kwiqela lolawulo, uqeqesho lwavelisa ukuziphatha okungaqhelekanga okungenakuvakalelwa kwisiphumo sokunciphisa ixabiso. Ukuncipha kwe-DA yendawo, ke, kuyafana nezilonda ze-excitotoxic ze-DLS, ekubeni zombini ubuqhetseba bubuyisela umva ukubunjwa komkhwa kwaye sithanda ukufunyanwa kwezenzo ezijolise ngqo (Yin et al., 2004). Umqondiso we-phasic we-DA obaluleke kakhulu ekubunjweni komkhwa sele uchazwe kakuhle ngumqondiso wokuqiniswa okusebenzayo kwi-algorithms yokufunda yokuqinisa yangoku yesikhashana ephefumlelwe ngumsebenzi kaHull kunye neSpence (Hull, ngo-1943; Isikhala, 1947, 1960; I-Sutton kunye neBarto, i-1998).

Cortico-basal ganglia networks

Ukuza kuthi ga ngoku sixoxe nge-heterogeneity esebenzayo ngaphakathi kwe-striatum, kodwa kuya kuba kulahlekisa ukucebisa ukuba nayiphi na indawo yokulala inokuthi, iguqulele isiphumo esilindelekileyo kwintsebenzo yesenzo ngokwayo. Endaweni yoko i-cerebral hemispheres iququzelelwe njengeeyunithi eziphindaphindayo ezisebenzayo ezibandakanya i-cortico-basal ganglia networks (Swanson, 2000; I-Zahm, 2005). Ti-striatum, isisikhululo sokungena kuyo yonke i-basal ganglia, isebenza njengendawo ekhethekileyo kwi-cortico-basal ganglia network motif, ekwaziyo ukudibanisa i-cortical, ithalamic, kunye ne-midbrain inputs.. Njengoko kuchaziwe ngasentla, nangona sisakhiwo esiqhubekayo, imimandla eyahlukeneyo yokubetha ibonakala ithatha inxaxheba kuthungelwano olusebenzayo olucacileyo, umzekelo, i-accumbens isebenza njenge-hub kwinethiwekhi ye-limbic kunye ne-DLS kwinethiwekhi ye-sensorimotor. Ngenxa yepropathi ephinde yangena yothungelwano olulolu hlobo, nangona kunjalo, akukho nxalenye yolu lwakhiwo inyuka okanye isezantsi kuyo nayiphi na ingqiqo epheleleyo; umz. inkqubo yethalamocortical zombini ingumthombo wegalelo elikhulu kwi-striatum kunye nokujoliswe kuko kuzo zombini iindlela ze-striato-pallidal kunye ne-striato-nigral.

Nangona i-parallel reentrant basal ganglia loops kudala iqatshelwa (UAlexander et al., 1986), sigxininisa iindima ezisebenzayo ezicacileyo zezi zijikelezo ngokusekelwe kwizakhiwo zokumela ezichazwe ngokusebenzayo kunye nokusebenzisana phakathi kweesekethe ekuveliseni ukuziphatha okudibeneyo. Ngesi siseko, ubuncinci ubunenethiwekhi obunjalo bunokuqondwa: uthungelwano lwe-limbic olubandakanya igobolondo kunye nengundoqo ye-accumbens ngokulandelanayo, inethiwekhi yokudibanisa ebandakanya i-associative striatum (DMS), kunye nenethiwekhi ye-sensorimotor ebandakanya i-sensorimotor striatum (DLS). Imisebenzi yabo isusela kulawulo lwe-Pavlovian URs kunye neeCRs ukuya kwizenzo zezixhobo (Umzobo 1).

Umzobo 1  

Imimandla esebenzayo ye-striatum. Umzekeliso we-striatum ovela kwicandelo le-coronal ebonisa isiqingatha sobuchopho (Paxinos kunye noFranklin, ngo-2003). Qaphela ukuba le mimandla emine esebenzayo i-anatomically eqhubekayo, kwaye ihambelana ngokumalunga nantoni ...

Njengoko sele kukhankanyiwe, i-ventral striatum ibandakanya ubukhulu becala i-nucleus accumbens, enokwahlulwa ngakumbi kwiqokobhe kunye nombindi, nganye ithatha inxaxheba kuthungelwano olusebenzayo oluhlukileyo. Uqikelelo lwe-cortical (glutamatergic) kwiqokobhe luvela kwi-infralimbic, embindini kunye ne-lateral orbital cortices, ngelixa uqikelelo oluya kumbindi luvela kwimimandla engaphezulu ye-dorsal midline ye-prefrontal cortex njenge-ventral kunye ne-dorsal prelimbic kunye ne-cingulate cortices yangaphambili (IGroenewegen et al., 1990; I-Zahm, 2000, 2005). Ngaphakathi kwale misebenzi yothungelwano ubungqina obuhlaziyiweyo ngasentla bucebisa ukuba iqokobhe libandakanyeka kwii-URs ukuvuza kunye nokufumana ii-CRs ezipheleleyo; undoqo kwindlela yokuziphatha yokuhlola, ngakumbi ukufunyanwa kunye nokubonakaliswa kweempendulo zendlela yePavlovian. Ubuncinci ezimbini iinethiwekhi ezinkulu, ke, zinokuqondwa ngaphakathi kwenethiwekhi enkulu ye-ventral okanye i-limbic cortico-basal ganglia, enye yeyokuqukumbela kwaye enye kukuziphatha okuzilungiselelayo kunye nokuguqulwa kwabo yiPavlovian conditioning.Umzobo 1).

I-dorsal striatum ngokunjalo inokwahlulwa ibe yimimandla emibini engundoqo, i-associative kunye ne-sensorimotor, enothungelwano olusebenzayo olwahlukileyo olunxulunyaniswa nenye. I-Associative striatum (i-caudate kunye neenxalenye ze-anterior putamen kwi-primates) iqulethe i-neurons evuthayo ngokulindela imbuyekezo exhomekeke ekuphenduleni kunye nokutshintsha ukudubula kwabo ngokobukhulu bomvuzo olindelekileyo (Hikosaka et al., 1989; Hollerman et al., 1998; Kawagoe et al., 1998). Kwinethiwekhi yokudibanisa, i-cortices ye-prefrontal kunye ne-parietal association kunye nokujoliswe kuyo kwi-DMS ibandakanyeka kwimemori yesikhashana, zombini ezilindelekileyo, ngendlela yeziphumo ezilindelekileyo, kunye ne-retrospective, njengerekhodi yeekopi zamva nje (Konorski, ngo-1967). Inqanaba le-sensorimotor, ngakolunye uhlangothi, liquka i-cortices ye-sensorimotor kunye neethagethi zabo kwi-basal ganglia. Iziphumo zale sekethi zijoliswe kwii-motor cortices kunye ne-brain stem motor networks. Umsebenzi we-Neural kwi-sensorimotor striatum ayisoloko imodareyithwa ngumvuzo olindelekileyo, ibonisa umsebenzi onxulumene nentshukumo kune-neurons kwi-associative striatum.Kanazawa et al., 1993; Kimura et al., 1993; Costa et al., 2004). Ekugqibeleni, ukongeza kwi-medial-lateral gradient, kukho i-heterogeneity ebalulekileyo esebenzayo ecaleni kwe-anterior-posterior axis ye-dorsal striatum, nangona kungekho datha yaneleyo ekhoyo ngoku ukuvumela naluphi na ulwahlulo olucacileyo (Yin et al., 2005b).

Izifundo ukuza kuthi ga ngoku zijolise kuphela kumalungu e-cortical kunye ne-striatal ezi nethiwekhi. Ngokubanzi, izilonda zommandla we-cortical zineziphumo ezifanayo njengezilonda ekujoliswe kuzo ngokubetha (I-Balleine kunye ne-Dickinson, i-1998; I-Corbit kunye neBalleine, 2003; Yin et al., 2005b). Kodwa amanye amacandelo kuthungelwano anokugcina imisebenzi efanayo. Ngokomzekelo, izilonda ze-nucleus ephakathi ye-thalamus, icandelo le-intanethi ye-associative, zifunyenwe ukuphelisa uvakalelo lokuthotyelwa kwesiphumo kunye nokuthotywa kwemeko yengozi ngendlela efanayo kunye nezilonda kwi-DMS kunye ne-prelimbic cortex.Corbit et al., 2003). Ngaloo ndlela nangona imodeli yethu ngokubanzi iqikelela ukusilela kokuziphatha okufanayo emva komonakalo kwicandelo ngalinye lenethiwekhi, iphinda iphakamise, nakwesiphi na isakhiwo esinikwe njenge-pallidum okanye i-thalamus, imimandla emininzi esebenzayo.

Intsebenziswano phakathi kothungelwano

Ngaphantsi kweemeko ezininzi, ukufunda kwePavlovian kunye nezixhobo kubonakala kwenzeka ngokufanayo. I-Phenomena efana ne-PIT, nangona kunjalo, ibonisa ukuba ezi nkqubo zahlukileyo zinokusebenzisana kangakanani. Emva kokuchaza iinkqubo zokusebenza ezizimeleyo, inyathelo elilandelayo kukuqonda ukuba ezi nkqubo zilungelelaniswe njani ukuvelisa indlela yokuziphatha. Esinye isiphakamiso esinomtsalane, ngokuhambelana nomsebenzi wamva nje we-anatomical, kukuba uthungelwano oluchazwe ngasentla lucwangciswe ngokoluhlu, ngalinye lisebenza njenge-labile, umlamli osebenzayo kuluhlu lwemigangatho, evumela ulwazi ukuba lusasazeke ukusuka kwelinye inqanaba ukuya kwelinye. Ngokukodwa, unxibelelwano olusandul 'ukufunyanwa phakathi kwe-striatum kunye ne-midbrain lucebisa umbutho we-anatomical onokuthi uphumeze intsebenziswano phakathi kwenethiwekhi.Umzobo 2). Njengoko kuphawulwe nguHaber kunye noogxa bakhe, i-neuron ebulalayo ithumela uqikelelo oluthe ngqo lwe-inhibitory kwi-DA neurons apho bafumana khona uqikelelo lwe-DA, kunye neprojekthi kwii-neuron ze-DA ezithi zona ziqhubele phambili kwindawo eyahlukileyo.Haber et al., 2000). Olu qikelelo luvumela ukusasazwa kwangaphambili kolwazi kwicala elinye kuphela, ukusuka kuthungelwano lwe-limbic ukuya kuthungelwano oludibeneyo kunye ne-sensorimotor. Ngokomzekelo, uqikelelo lwePavlovian (ixabiso elifunyenweyo le-CS) linokunciphisa umqondiso wokufundisa osebenzayo kwinqanaba le-limbic, ngelixa ngokuhambelanayo kunokwenzeka ukuba umqondiso we-DA kwinqanaba elilandelayo. Ukucinywa komqondiso wokufundisa osebenzayo ngokuqhelekileyo kuphunyezwa ngumqondiso wengxelo engeyiyo kusetyenziswa uqikelelo oluthintelayo, umzekelo, ukusuka kwi-GABAergic medium spiny projection neurons ukusuka kwi-striatum ukuya kwi-DA neurons. Okwangoku, njengoko kucetyisiwe ngumbutho we-anatomical (Haber et al., 2000; Haber, 2003), ukubakho komqondiso we-DA kuthungelwano lwe-cortico-basal ganglia engummelwane (inqanaba elilandelayo kuluhlu lwemigangatho) lunokuphunyezwa ngoqikelelo lwe-disinhibitory (okt i-GABAergic striatal projection neurons ukuya kwi-nigral GABAergic interneurons kwi-DA neurons). Ngaloo ndlela, ixabiso elifundiweyo lenethiwekhi ye-limbic inokudluliselwa kwinethiwekhi ye-associative, evumela ukulungelelaniswa kokuziphatha ukuba kuhlanjululwe kwaye kwandiswe ngokuphindaphindiweyo (UAshby, ngo-1960). Lo mzekelo uqikelela, ke ngoko, ukubandakanyeka okuqhubelekayo kweenethiwekhi ezahlukeneyo ze-neural ngexesha lamanqanaba ahlukeneyo okufunda, ingcebiso exhaswa ziidatha ezahlukeneyo (Jueptner et al., 1997b; UMiyachi et al., ngo-1997; UMiyachi et al., ngo-2002; Yin, 2004; Everitt kunye noRobbins, i-2005; I-Yin kunye ne-Knowlton, i-2005; Belin kunye ne-everitt, i-2008).

I-Phenomena efuna ukusebenzisana kweenkqubo ezisebenzayo ezicacileyo, ezifana ne-PIT, zibonelela ngendawo yokuvavanya echumileyo kwiimodeli zolu hlobo. Ngokwenene, imodeli yoluhlu lwemigangatho ihambelana neziphumo zovavanyo zakutsha nje kwi-PIT. Ngokwemodeli, ukusebenzisana kwe-Pavlovian-isixhobo kulamlwa lunxibelelwano olubuyiselanayo phakathi kwe-striatum kunye ne-DA neurons. I-DA ibonakala ibaluleke kakhulu ekutshintsheni ngokubanzi, okupheliswa ngabachasi be-DA kunye nokungasebenzi kwendawo ye-VTA (UDickinson et al., 2000; Murschall kunye noHauber, ngo-2006); ngelixa ukufakwa kwendawo ye-amphetamine, enokuthi inyuse amanqanaba e-DA, kwi-accumbens inokuphucula kakhulu (Wyvell noBerridge, i2000). Kwelinye icala, indima ye-ventral striatal dopamine kudluliselo oluthile ayicacanga kangako. Obunye ubungqina bubonisa ukuba inokugcinwa emva kokungasebenzi kwe-VTA (Corbit et al., 2007) kodwa, njengoko ICorbit kunye neJanak (2007) kuxelwe mva nje, utshintshiselwano oluthile luphelisiwe ngokungasebenzi kwe-DLS, ecebisa ukuba lo mba wolawulo lovuselelo kukhetho lwesenzo unokubandakanya uqikelelo lwe-nigrostriatal (Corbit kunye noJanak, ngo-2007). Ukuvumelana nembono yoluhlu lwemigangatho, ICorbit kunye neJanak (2007) Kwakhona kwafumanisa ukuba, ngelixa ukungasebenzi kwe-DLS kuphelise isiphumo esikhethiweyo sokuvusa i-palovian cues (kakhulu njengoko kuye kwabonwa emva kokulimala kweqokobhe le-accumbens UCorbit et al, ngo-2001), ukungasebenzi kwe-DMS kupheliswe kuphela isiphumo-ukukhethwa kokudluliselwa ngelixa kubonakala kugcinwe umphumo oqhelekileyo wokuxhamla kwezi mpawu, umkhwa obuye wabonwa emva kwezilonda ze-thalamus ephakathi, eyinxalenye ye-associative cortico-basal ganglia network (I-Ostlund kunye neBalleine, 2008). Ngokusekelwe kwezi ziphumo zokuqala, i-DMS ibonakala idibanisa kuphela ukudluliselwa okuthe ngqo, ngelixa i-DLS ingaba yimfuneko kuzo zombini iziphumo ezicacileyo kunye neziqhelekileyo zokuzonwabisa zePavlovian kwizenzo zezixhobo.

Okubangela umdla kukuba, iiprojekthi ze-limbic striatum ngokubanzi kwiiseli ze-DA eziphuhlisa i-dorsal striatum (Nauta et al., 1978; Nauta, ngo-1989); Uqikelelo lwe-dopaminergic kwi-striatum kunye noqikelelo lokuzala olubuyela kwi-midbrain luyi-asymmetrical kakhulu (Haber, 2003). I-limbic striatum ifumana igalelo elilinganiselweyo kwi-DA neurons ukanti ithumela imveliso ebanzi kwiseti enkulu ye-DA neurons, kwaye okwahlukileyo kuyinyani kwi-sensorimotor striatum. Ngaloo ndlela uthungelwano lwe-limbic lukwimeko efanelekileyo yokulawula i-associative kunye ne-sensorimotor networks. Apha i-neuroanatomy iyavumelana nedatha yokuziphatha ukuba ukuququzelelwa kwePavlovian yokuziphatha kwezixhobo kunamandla kakhulu kunomva; ngokwenene, ubungqina obuninzi bubonisa ukuba izenzo zezixhobo zivame ukuthintela, kunokuba zivuyise, i-Pavlovian CRs-ukufumanisa okusalindele inkcazo ye-neurobiological (UEllison noKonorski, ngo-1964; Williams, ngo-1965).

izigqibo

Imodeli ye-hierarchical exutyushwa apha, kufuneka iqatshelwe, yahluke kakhulu kwabanye abaxhomekeke ngokukodwa kwi-cortex kunye noqhagamshelwano olude phakathi kweendawo ze-cortical (I-Fuster, 1995). Ibandakanya amacandelo awaziwayo kunye nokudibanisa kwengqondo, kunokuba ijonge njenge-potpourri yeemodyuli ze-cortical, ngendlela ethile engachazwanga, izalisekisa uluhlu olubanzi lwemisebenzi yokuqonda. Ikwanqanda ukucinga, okuzuzwe njengelifa ukusuka kwi-19th i-neurology yenkulungwane, ukuba i-cerebral cortex ngokubanzi, kunye ne-prefrontal cortex ngokukodwa, ngandlela-thile yenza iyunithi ye-homuncular 'ephezulu' elawula yonke ingqondo. (UMiller noCohen, ngo-2001).

Ngaphaya koko, uqikelelo oluninzi oluthe ngqo lunokufunyanwa kwimodeli yangoku: (i) Kufuneka kubekho iimpazamo zokuqikelela okwahlukileyo kwizenzo eziveliswe ngokwazo kunye neemeko/izivuseleli ezineepropati ezibonisa ii-neural substrates zazo ezahlukeneyo kunye neendima ezisebenzayo. (ii) Amacandelo e-pallidal kunye ne-thalamic ye-discrete cortico-basal ganglia network nayo ilindeleke ukuba ibe yimfuneko kuhlobo lolawulo lokuziphatha oluqikelelwayo kuthungelwano ngalunye, kungekhona nje i-cortical kunye ne-striatal components. (iii) Kufuneka kubekho uthatho-nxaxheba oluqhubela phambili lothungelwano lwemithambo-luvo olwahlukeneyo ngamaxesha ahlukeneyo okufunda. (iv) Umsebenzi we-Accumbens unokulawula ngokuthe ngqo i-neurons ye-DA kwaye, emva koko, umsebenzi we-dorsal striatal. Ngokusekelwe kwingxelo ka eHolland (2004) icebisa ukuba i-PIT yonyuka ngoqeqesho lwezixhobo, olu lawulo 'lwe-limbic' lwe-associative kunye nothungelwano lwe-sensorimotor kulindeleke ukuba lomelele ngoqeqesho olwandisiweyo.

Ngaphandle kwedatha eneenkcukacha, kuse early kakhulu ukunika ingxelo esesikweni yemodeli yehierarchical. Nangona kunjalo, le ngxoxo ingentla kufuneka icacise ukuba iinguqulelo zangoku ze-mesoaccumbens umvuzo we-hypothesis ziphumle kwiingcamango eziyingxaki malunga nobume benkqubo yomvuzo kunye nokusetyenziswa kwemilinganiselo yokuziphatha engafanelekanga. Imithetho-siseko emanyanisayo, esoloko iyinjongo yeshishini lezenzululwazi, inokusekwa kuphela kubunyani bedatha yovavanyo, nangona oku kungalawuleki. Ngenxa yokuba umsebenzi wengqondo, ekugqibeleni, isizukulwana kunye nokulawulwa kokuziphatha, uhlalutyo olucacileyo lokuziphatha luya kuba sisitshixo sokuqonda iinkqubo ze-neural, njengoko inkcazo ecacileyo yokugonywa okungaphakathi kunye nokufunyenweyo kuvumela ukucaciswa kwe-immune system. Nangona kubonakala ngathi yinyani, ayinakugxininiswa kakhulu into yokuba sinokuziqonda iindlela zobuchopho ukusa kwinqanaba lokuba imisebenzi yazo ichazwe kwaye ilinganiswe ngokuchanekileyo. Xa uphononongo lomsebenzi we-neural lusekwe kubuchule bengqondo obusekiweyo, umzekelo ukumelwa kwesiphumo sentshukumo kunye nesiphumo sovuselelo, umbutho owaziwayo we-anatomical kunye neendlela ze-physiological zibonwa ngokukhanya okutsha, okukhokelela ekuqulunqweni kwezinto ezintsha. Uqikelelo kunye noyilo lwemifuniselo emitsha. Njengenyathelo lokuqala kweli cala, sinethemba lokuba inkqubo-sikhokelo exoxwa apha iya kusebenza njengesiqalo esiluncedo kuphando lwexesha elizayo.

Imibulelo

Sithanda ukubulela uDavid Lovinger ngeengcebiso eziluncedo. I-HHY yaxhaswa yiCandelo le-Intramural Clinical kunye noPhando oluSiseko lwe-NIH, i-NIAAA. I-SBO ixhaswa yi-NIH isibonelelo i-MH 17140 kunye ne-BWB ngezibonelelo ze-NIH i-MH 56446 kunye ne-HD 59257.

Ucaphulo

  1. Adams CD. Ukwahluka kobuntununtunu bokuphendula kwesixhobo ukuqinisa ukuhla. Ijenali yekota yesayikholoji yovavanyo. 1982;33b:109–122.
  2. I-Adams CD, i-Dickinson A. I-Instrumental iphendula emva kokunciphisa ixabiso. Ijenali yekota yePsychology yoMfuniselo. 1981;33:109–122.
  3. Alexander GE, DeLong MR, Strick PL. Umbutho ohambelanayo weesekethe ezahlulwe ngokusebenzayo ezidibanisa i-basal ganglia kunye ne-cortex. U-Annu uMfundisi Neurosci. 1986;9:357–381. [PubMed]
  4. U-Ashby WR. Uyilo lweNgqondo. Uhlelo lwesibini. Chapman & Hall; 1960.
  5. Atallah HE, Lopez-Paniagua D, Rudy JW, O'Reilly RC. Ukwahlula i-neural substrates yokufunda izakhono kunye nokusebenza kwi-ventral kunye ne-dorsal striatum. Nat Neurosci. 2007;10:126–131. [PubMed]
  6. Balleine BW. Iinkqubo zenkuthazo kwi-instrumental conditioning. Ku: Mowrer RR, Klein SB, abahleli. Incwadana yeethiyori zokufunda zangoku. Mahwah, NJ, US: Lawrence Erlbaum Associates, Inc., Abapapashi; 2001. iphepha 307-366.
  7. Balleine BW. Iziseko ze-Neural zokufuna ukutya: ukuchaphazela, ukuvusa kunye nomvuzo kwiisekethe ze-corticostriatolimbic. I-Physiol Behav. 2005;86:717–730. [PubMed]
  8. I-Balleine BW, Dickinson A. Intshukumo ejolise ngqo kwinjongo: imeko engxamisekileyo kunye nenkuthazo yokufunda kunye neecortical sub subates zabo. I-Neuropharmacology. I-1998; 37: 407-419. [PubMed]
  9. Balleine BW, Corbit LH. Izilonda ze-accumbens core kunye negobolondo zivelisa iziphumo ezidibeneyo kwiifom eziqhelekileyo kunye neziphumo ezichanekileyo ze-Palovian-instrumental transfer; INtlanganiso yoNyaka yoMbutho weNeuroscience; 2005.
  10. I-Balleine BW, i-Killcross S. I-Parallel incentive processing: imbono edibeneyo yomsebenzi we-amygdala. Iimpawu zeNeurosci. 2006;29:272–279. [PubMed]
  11. Belin D, uEveritt BJ. Imikhwa yokufuna iCocaine ixhomekeke kuQhagamshelwano oluXhomekeke kwi-Dopamine eDityaniswe neVentral kunye neDorsal Striatum. Neuron. 2008;57:432–441. [PubMed]
  12. I-Berke JD, iHyman SE. Iziyobisi, dopamine, kunye neendlela zememori zeemolekyuli. Neuron. I-2000; 25: 515-532. [PubMed]
  13. IBerridge KC, Robinson TE. Yintoni indima yedopamine emvuzweni: ifuthe le-hedon, ukufunda ngomvuzo, okanye ukukhuthala? I-Brain Res Brain Res Rev 1998; 28: 309-369. [PubMed]
  14. Bolles R. Ukuqiniswa, ixesha elilindelekileyo, kunye nokufunda. Uphononongo lwezeNgqondo. 1972;79:394–409.
  15. UBrown J, uBullock D, uGrossberg S. Indlela i-basal ganglia esebenzisa ngayo iindlela zokufunda ezikhuthazayo kunye nezithintelo ukukhetha ukuphendula kwiimpawu ezivuzayo ezingalindelekanga. J Neurosci. 1999;19:10502–10511. [PubMed]
  16. UBrown PL, uJenkins HM. Ukubumba iqhosha lehobe ngokuzenzekelayo. Ijenali yovavanyo loVavanyo lokuziphatha. 1968;11:1–8. [Inkcazelo yamahhala ye-PMC] [PubMed]
  17. UCagniard B, uBeeler JA, uBritt JP, uMcGehee DS, uMarinelli M, uZhuang X. I-Dopamine ilinganisa ukusebenza ngokungabikho kokufunda okutsha. Neuron. 2006;51:541–547. [PubMed]
  18. UKhadinali RN, Cheung TH. I-Nucleus iqokelela izilonda ezingundoqo zibambezela ukufunda kwezixhobo kunye nokusebenza ngokulibaziseka ukomeleza kwimpuku. BMC Neurosci. 2005;6:9. [Inkcazelo yamahhala ye-PMC] [PubMed]
  19. Cardinal RN, Parkinson JA, Hall J, Everitt BJ. Uvakalelo kunye nenkuthazo: indima ye-amygdala, i-ventral striatum, kunye ne-prefrontal cortex. I-Neurosci Biobehav Rev. 2002; 26: 321-352. [PubMed]
  20. I-Cheer JF, i-Aragona BJ, i-Heien ML, i-Seipel AT, i-Carelli RM, i-Wightman RM. Ukukhutshwa kophuculo lwedipamine edibeneyo kunye ne-neural umsebenzi wokuqhuba ojolise kwinjongo. Neuron. I-2007; 54: 237-244. [PubMed]
  21. Colwill RM, Rescorla RA. Izakhiwo zonxulumano ekufundeni ngezixhobo. Ku: Bower G, umhleli. Ipsychology yokufunda kunye nenkuthazo. ENew York: Ushicilelo lwezeMfundo; 1986. iphepha 55-104.
  22. Corbit LH, Balleine BW. Indima ye-prelimbic cortex kwi-instrumental conditioning. Behav Brain Res. 2003;146:145–157. [PubMed]
  23. Corbit LH, Janak PH. Ukungasebenzi kwe-lateral kodwa ingeyiyo i-medial dorsal striatum kuphelisa impembelelo ye-excitatory ye-Pavlovian stimuli ekuphenduleni kwezixhobo. J Neurosci. 2007;27:13977–13981. [PubMed]
  24. Corbit LH, Muir JL, Balleine BW. Indima ye-nucleus accumbens kwi-instrumental conditioning: Ubungqina bokuhlukana okusebenzayo phakathi kwe-accumbens core kunye negobolondo. Ijenali yeNeuroscience. 2001;21:3251–3260. [PubMed]
  25. Corbit LH, Muir JL, Balleine BW. Izilonda zethalamus ephakathi kunye ne-anterior thalamic nuclei zivelisa iziphumo ezidityanisiweyo kwi-instrumental conditioning kwiigundane. I-Eur J Neurosci. 2003;18:1286–1294. [PubMed]
  26. Corbit LH, Janak PH, Balleine BW. Iifom eziqhelekileyo kunye neziphumo ezichanekileyo ze-Pavlovian-instrumental transfer: impembelelo yokutshintsha kwimeko ekhuthazayo kunye nokungasebenzi kwendawo ye-ventral tegmental. I-Eur J Neurosci. 2007;26:3141–3149. [PubMed]
  27. Costa RM, Cohen D, Nicolelis MA. Ukwahluka kweplastiki ye-corticostriatal ngexesha lokufunda ngokukhawuleza kunye nokucotha kwesakhono semoto kwiimpuku. Curr Biol. 2004;14:1124–1134. [PubMed]
  28. Cragg SJ, Hille CJ, Greenfield SA. Imimandla esebenzayo kwi-dorsal striatum ye-primate engeyoyamntu ichazwa kukuziphatha okuguquguqukayo kwe-dopamine. J Neurosci. 2002;22:5705–5712. [PubMed]
  29. Dalley JW, Laane K, Theobald DE, Armstrong HC, Corlett PR, Chudasama Y, Robbins TW. Ukuguqulwa kwexesha elilinganiselweyo lememori yePavlovian enomdla yi-D1 kunye ne-NMDA receptors kwi-nucleus accumbens. I-Proc Natl Acad Sci US A. 2005; 102: 6189-6194. [Inkcazelo yamahhala ye-PMC] [PubMed]
  30. UDavis J, uBitterman ME. Ukuqiniswa okungafaniyo kokunye ukuziphatha (i-DRO): Uthelekiso lokulawula idyokhwe. Ijenali yovavanyo loVavanyo lokuziphatha. 1971;15:237–241. [Inkcazelo yamahhala ye-PMC] [PubMed]
  31. Usuku JJ, Carelli RM. I-nucleus accumbens kunye nokufunda ngomvuzo wasePavlovian. Neuroscientist. I-2007; 13: 148-159. [Inkcazelo yamahhala ye-PMC] [PubMed]
  32. Usuku lwe-JJ, i-Wheeler RA, i-Roitman MF, i-Carelli RM. I-Nucleus accumbens neurons encode Pavlovian indlela yokuziphatha: ubungqina obuvela kwi-autoshaping paradigm. I-Eur J Neurosci. 2006;23:1341–1351. [PubMed]
  33. Usuku JJ, Roitman MF, Wightman RM, Carelli RM. Isifundo sokudibanisa sidibanisa ukutshintsha kwamandla kwi-dopamine signaling kwi-nucleus accumbens. Nat Neurosci. I-2007; 10: 1020-1028. [PubMed]
  34. Dayan P, Balleine BW. Umvuzo, inkuthazo, kunye nokomeleza ukufunda. Neuron. 2002;36:285–298. [PubMed]
  35. Delgado MR, Stenger VA, Fiez JA. Iimpendulo ezixhomekeke kwi-Motivation nucleus ye-caudate yomntu. Cereb Cortex. 2004;14:1022–1030. [PubMed]
  36. Delgado MR, Miller MM, Inati S, Phelps EA. Isifundo se-fMRI sokufunda okunokwenzeka okunxulumene nomvuzo. I-Neuroimage. 2005;24:862–873. [PubMed]
  37. UDi Ciano P, Cardinal RN, Cowell RA, SJ omncinci, everitt BJ. Ukubandakanyeka okungafaniyo kwe-NMDA, i-AMPA / kainate, kunye ne-dopamine receptors kwi-nusus boks ingqokelela ekufumaneni nasekusebenzeni kwendlela yokuziphatha ye-pavlovia. J Neurosci. I-2001; 21: 9471-9477. [PubMed]
  38. Dickinson A. Izenzo kunye nemikhwa: ukuphuhliswa kokuzimela ngokuziphatha. IiNtengiselwano zefilosofi yeRoyal Society. 1985; B308:67–78.
  39. Dickinson A. Instrumental Conditioning. Ku: Mackintosh NJ, umhleli. Ukufunda ngezilwanyana kunye noKuqonda. I-Orlando: Yezemfundo; 1994. iphepha 45–79.
  40. Dickinson A, othandekayo MF. Ukusebenzisana okunomdla kunye neenkqubo zokuthintela. Ku: Dickinson A, Boakes RA, abahleli. Indlela yokufunda kunye nenkuthazo. Hillsadale, NJ: Lawrence Erlbaum Associates; 1979.
  41. UDickinson A, uCharnock DJ. Iziphumo ezinokwenzeka ngokuqiniswa kwezixhobo ezigciniweyo. Ijenali yekota yePsychology yoMfuniselo. Ukuthelekisa kunye nePsychology yePhysiology. 1985;37:397–416.
  42. Dickinson A, Balleine B. Izenzo kunye neempendulo: Ipsycholoji yengqondo emibini yokuziphatha. Ku: Eilan N, McCarthy RA, et al., abahleli. Ukumelwa kwendawo: Iingxaki kwifilosofi nakwisayikholoji. Malden, MA, US: Blackwell Publishers Inc.; 1993. iphepha 277-293.
  43. Dickinson A, Balleine B. Indima yokufunda ekusebenzeni kweenkqubo ezikhuthazayo. Ku: Pashler H, Gallistel R, abahleli. Incwadi yesandla kaSteven yovavanyo lwezengqondo (uhlelo lwesithathu), Umqu. 3: Ukufunda, inkuthazo, kunye novakalelo. New York, NY, US: John Wiley & Sons, Inc.; 3. iphepha 2002-497.
  44. UDickinson A, uSmith J, uMirenowicz J. Ukwahlukana kwePavlovian kunye nesixhobo sokufunda esiluncedo phantsi kwabachasi be-dopamine. Behav Neurosci. 2000;114:468–483. [PubMed]
  45. UDickinson A, uCampos J, uVarga ZI, uBalleine B. I-Bidirectional instrumental conditioning. Ijenali yekota yePsychology yoMfuniselo: Uthelekiso & nePhysiology Psychology. 1996;49:289–306. [PubMed]
  46. U-Ellison GD, uKonorski J. Ukwahlulwa kwe-salivary kunye neempendulo zeemoto kwi-instrumental conditioning. Inzululwazi. 1964;146:1071–1072. [PubMed]
  47. I-everitt BJ, iRobbins TW. Iinkqubo ze-Neural zokuqiniswa kweziyobisi: ukusuka kwizenzo ukuya kwimikhwa ukuya kunyanzelo. Nat Neurosci. I-2005; 8: 1481-1489. [PubMed]
  48. Ukusilela A, Haberland U, Conde F, El Massioui N. I-Lesion ukuya kwinkqubo ye-digamine ye-nigrostriatal iphazamisa ukwakheka kokuphendula komkhuba. J Neurosci. I-2005; 25: 2771-2780. [PubMed]
  49. I-Fiorillo CD, iTobler PN, Schultz W. Ukukhowaniswa kweekhowudi komvuzo wokufumana kunye nokungaqiniseki yi-dopamine neurons. Inzululwazi. I-2003; 299: 1898-1902. [PubMed]
  50. UFuster JM. Inkumbulo kwi-cortex ye-cerebral. Cambridge: MIT press; 1995.
  51. I-Gallistel CR, i-Fairhurst S, i-Balsam P. I-curve yokufunda: iimpembelelo zohlalutyo lobungakanani. Proc Natl Acad Sci US A. 2004;101:13124–13131. [Inkcazelo yamahhala ye-PMC] [PubMed]
  52. Yiya kuY, Grace AA. Ukuguqulwa kwe-Dopaminergic ye-limbic kunye ne-cortical drive ye-nucleus accumbens ekuziphatheni okujoliswe kuko. Nat Neurosci. 2005;8:805–812. [PubMed]
  53. UGrace AA, Floresco SB, Goto Y, Lodge DJ. Ukulawulwa kokudutyulwa kwee-dopaminergic neurons kunye nolawulo lweempawu ezijolise ngqo kwinjongo. Iindlela zokuziphatha Neurosci. I-2007; 30: 220-227. [PubMed]
  54. Groenewegen HJ, Berendse HW, Wolters JG, Lohman AH. Ubudlelwane be-anatomical ye-prefrontal cortex kunye nenkqubo ye-striatopallidal, i-thalamus kunye ne-amygdala: ubungqina bentlangano efanayo. Prog Brain Res. 1990;85:95–116. ingxoxo 116–118. [PubMed]
  55. Guthrie ER. Ipsychology yokufunda. ENew York: AbakwaHarpers; 1935.
  56. UHaber SN. Iprimate basal ganglia: uthungelwano oluhambelanayo kunye noludibanisayo. J Chem Neuroanat. 2003;26:317–330. [PubMed]
  57. Haber SN, Fudge JL, McFarland NR. Iindlela ze-Striatonigrostriatal kwii-primates zenza indawo enyukayo ukusuka kwigobolondo ukuya kwi-dorsolateral striatum. J Neurosci. I-2000; 20: 2369-2382. [PubMed]
  58. Hammond LJ. Isiphumo semeko enokwenzeka kwimeko yokukhanuka kokuziphatha okusebenzayo. Ijenali yoVavanyo loMfuniselo lokuziphatha. 1980;34:297–304. [Inkcazelo yamahhala ye-PMC] [PubMed]
  59. UHaruno M, uKawato M. Imodeli yokufunda yokuqinisa i-Heterarchical yokuhlanganiswa kwee-loops ezininzi ze-cortico-striatal: uviwo lwe-fMRI kwi-stimulus-action-reward association association. INeural Netw. 2006a;19:1242–1254. [PubMed]
  60. UHaruno M, uKawato M. Ii-neural correlates ezahlukeneyo zokulindela umvuzo kunye nempazamo yokulindela umvuzo kwi-putamen kunye ne-caudate nucleus ngexesha lokufunda i-stimulus-action-reward association. J Neurophysiol. 2006b;95:948–959. [PubMed]
  61. UHaruno M, uKuroda T, uDoya K, uToyama K, uKimura M, uSamejima K, u-Imamizu H, uKawato M. I-neural correlate yokufunda ngokuziphatha okusekwe kumvuzo kwinucleus ye-caudate: isifundo esisebenzayo somfanekiso wemagnethi womsebenzi wesigqibo sestochastic. J Neurosci. 2004;24:1660–1665. [PubMed]
  62. Hernandez PJ, Sadeghian K, Kelley AE. Ukudityaniswa kwangoko kwezixhobo zokufunda kufuna iprotein synthesis kwi-nucleus accumbens. Nat Neurosci. 2002;5:1327–1331. [PubMed]
  63. Hernandez PJ, Andrzejewski ME, Sadeghian K, Panksepp JB, Kelley AE. I-AMPA / kainate, i-NMDA, kunye ne-dopamine D1 receptor umsebenzi kwi-nucleus accumbens core: indima elinganiselweyo nomxholo kwi-encoding kunye nokudityaniswa kwememori yesixhobo. Funda uMem. 2005;12:285–295. [Inkcazelo yamahhala ye-PMC] [PubMed]
  64. Hershberger WA. Indlela yokujonga ngeglasi. Ukufunda ngezilwanyana kunye nokuziphatha. 1986;14:443–451.
  65. Heye CM, Dawson GR. Umboniso wokufunda ngokuqwalasela kwiimpuku usebenzisa ulawulo lokuya kabini. Ijenali yekota yePsychology yoMfuniselo. 1990;42(1):59–71. [PubMed]
  66. Hikosaka O, Sakamoto M, Usui S. Iipropati ezisebenzayo ze-monkey caudate neurons. III. Imisebenzi enxulumene nolindelo lwethagethi kunye nomvuzo. J Neurophysiol. 1989;61:814–832. [PubMed]
  67. PC yaseHolland. Ubudlelwane phakathi kwePavlovian-instrumental transfer kunye nokuqinisa ukuhla kwexabiso. J Exp Psychol Anim Behav Inkqubo. 2004;30:104–117. [PubMed]
  68. Holland PC, Rescorla RA. Isiphumo seendlela ezimbini zokuthoba ixabiso le-stimulus engaguqukiyo emva komyalelo wokuqala kunye nowesibini we-appetitive conditioning. J Exp Psychol Anim Behav Inkqubo. 1975;1:355–363. [PubMed]
  69. Hollerman JR, Tremblay L, Schultz W. Impembelelo yokulindela umvuzo kumsebenzi onxulumene nokuziphatha kwe-neuronal kwiprimate striatum. J Neurophysiol. 1998;80:947–963. [PubMed]
  70. Houk JC, Adams JL, Barto AG. Imodeli yendlela i-basal ganglia eyenza ngayo kwaye isebenzise imiqondiso ye-neural eqikelela ukuqinisa. Ku: Houk JC, JD, DB, abahleli. Iimodeli zokwenziwa kolwazi kwi-basal ganglia. Cambridge, MA: MIT Press; 1995. iphepha 249-270.
  71. Hull C. Imigaqo yokuziphatha. ENew York: Appleton-Century-Crofts; 1943.
  72. IHyman SE, iMalenka RC, uNestler EJ. Iindlela zokuzibonakalisa: Inxaxheba yokufunda okunxulumene nomvuzo kunye nememori. Annu Rev Neurosci. I-2006; 29: 565-598. [PubMed]
  73. Jedynak JP, Uslaner JM, Esteban JA, Robinson TE. Iplastiki yolwakhiwo lweMethamphetamine kwi-dorsal striatum. I-Eur J Neurosci. 2007;25:847–853. [PubMed]
  74. UJoel D, u-Weiner I. Ulungelelwaniso lweesekethe ze-basal ganglia-thalamocortical: i-open interconnected kunokuba ivaliwe yahlulwe. Inzululwazi yemithambo-luvo. 1994;63:363–379. [PubMed]
  75. UJoel D, Weiner I. Udibaniso lwenkqubo ye-dopaminergic kunye ne-striatum kwiimpuku kunye neeprimates: uhlalutyo ngokubhekiselele kumbutho osebenzayo kunye nombutho we-striatum. Inzululwazi yemithambo-luvo. 2000;96:451–474. [PubMed]
  76. Jueptner M, Frith CD, Brooks DJ, Frackowiak RS, Passingham RE. I-Anatomy yokufunda kweemoto. II. Izakhiwo ze-subcortical kunye nokufunda ngolingo kunye nempazamo. J Neurophysiol. 1997a;77:1325–1337. [PubMed]
  77. Jueptner M, Stephan KM, Frith CD, Brooks DJ, Frackowiak RS, Passingham RE. I-Anatomy yokufunda kweemoto. I. I-cortex yangaphambili kunye nokuqwalaselwa kwisenzo. J Neurophysiol. 1997b;77:1313–1324. [PubMed]
  78. I-Kanazawa I, i-Murata M, i-Kimura M. Iindima ze-dopamine kunye ne-receptors yayo kwisizukulwana sokunyakaza kwe-choreic. I-Adv Neurol. 1993;60:107–112. [PubMed]
  79. Kawagoe R, Takikawa Y, Hikosaka O. Ukulindela umvuzo kulungelelanisa imiqondiso yokuqonda kwi-basal ganglia. Nat Neurosci. 1998;1:411–416. [PubMed]
  80. Kimura M, Aosaki T, Ishida A. Imiba ye-Neurophysiological yeendima ezihlukeneyo ze-putamen kunye ne-caudate nucleus ekuhambeni ngokuzithandela. I-Adv Neurol. 1993;60:62–70. [PubMed]
  81. I-Konorski J. Umsebenzi odibeneyo wengqondo. Chicago: IYunivesithi yaseChicago Press; 1967.
  82. Lerchner A, La Camera G, Richmond B. Ukwazi ngaphandle kokwenza. Nat Neurosci. 2007;10:15–17. [PubMed]
  83. I-Ljungberg T, i-Apicella P, i-Schultz W. Iimpendulo ze-monkey dopamine neurons ngexesha lokufunda kwindlela yokuziphatha. J Neurophysiol. I-1992; 67: 145-163. [PubMed]
  84. Lohrenz T, McCabe K, Camerer CF, Montague PR. Utyikityo lwe-Neural lweempawu zokufunda ezintsonkothileyo kumsebenzi wotyalo-mali olandelelanayo. Proc Natl Acad Sci US A. 2007;104:9493–9498. [Inkcazelo yamahhala ye-PMC] [PubMed]
  85. Lovibond PF. Ukuququzelelwa kokuziphatha kwezixhobo ngePavlovian appetitive conditioned stimulus. J Exp Psychol Anim Behav Inkqubo. 1983;9:225–247. [PubMed]
  86. Mackintosh NJ. Psychology yokufunda izilwanyana. eLondon: Ushicilelo lwezeMfundo; 1974.
  87. UMiller EK, uCohen JD. Ithiyori edibeneyo ye-prefrontal cortex function. U-Annu uMfundisi Neurosci. 2001;24:167–202. [PubMed]
  88. Miller R. Intsingiselo kunye neNjongo kuBuchotho obuNgaguqukiyo. ENew York: iOxford University Press; 1981.
  89. I-Miyachi S, i-Hikosaka O, uLu X. Ukusetyenziswa okungafaniyo kwe-monkey striatal neurons kumanqanaba okuqala kunye nasekupheleni kwenkqubo yokufunda. Exp Brain Res. 2002;146:122–126. [PubMed]
  90. Miyachi S, Hikosaka O, Miyashita K, Karadi Z, Rand MK. Iindima ezahlukeneyo zemonkey striatum ekufundeni ngokulandelelana kwezandla. Exp Brain Res. 1997;115:1–5. [PubMed]
  91. IMontague PR, iHyman SE, uChenhen JD. Iindima ezidibeneyo zedopamine kulawulo lokuziphatha. Indalo. I-2004; 431: 760-767. [PubMed]
  92. Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H. Midbrain dopamine neurons encode izigqibo zesenzo esizayo. Nat Neurosci. I-2006; 9: 1057-1063. [PubMed]
  93. I-Murschall A, i-Hauber W. Ukungasebenzi kwendawo ye-ventral tegmental kuphelise impembelelo ye-excitatory jikelele ye-Pavlovian cues ekusebenzeni kwezixhobo. Funda uMem. 2006;13:123–126. [PubMed]
  94. Nauta WJ, Smith GP, Faull RL, Domesick VB. Ukudibanisa okusebenzayo kunye ne-nigral afferents ye-nucleus accumbens septi kwi-rat. Inzululwazi yemithambo-luvo. 1978;3:385–401. [PubMed]
  95. Nauta WJH. Amakhonkco abuyelayo e-corpus striatum ene-cerebral cortex kunye ne-limbic system: I-substrate eqhelekileyo yokuhamba kunye nokucinga? Ku: Mueller, umhleli. I-Neurology kunye ne-psychiatry: intlanganiso yeengqondo. iBasel: iKarger; 1989. iphepha 43–63.
  96. U-Niv Y, Daw ND, Joel Joel, Dayan P. Tonic dopamine: iindleko zamathuba kunye nolawulo lwamandla okuphendula. I-Psychopharmacology (Berl) 2007; 191: 507-520. [PubMed]
  97. O'Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ. Iindima ezingahambelaniyo ze-ventral kunye ne-dorsal striatum kwimeko yesixhobo. Inzululwazi. I-2004; 304: 452-454. [PubMed]
  98. Ostlund SB, Balleine BW. Ukubandakanyeka okungafaniyo kwe-amygdale ye-basolateral kunye ne-mediodorsal thalamus ekukhethweni kwesenzo sesixhobo. J Neurosci. 2008;28:4398–4405. [Inkcazelo yamahhala ye-PMC] [PubMed]
  99. Parkinson JA, Willoughby PJ, Robbins TW, Everitt BJ. Ukuqhawulwa kwe-anterior cingulate cortex kunye ne-nucleus accumbens core iphazamisa indlela yokuziphatha ye-Pavlovian: ubungqina obongezelelweyo beenkqubo ze-limbic cortical-ventral striatopallidal. Behav Neurosci. 2000;114:42–63. [PubMed]
  100. Parkinson JA, Dalley JW, Cardinal RN, Bamford A, Fehnert B, Lachenal G, Rudarakanchana N, Halkerston KM, Robbins TW, Everitt BJ. I-Nucleus accumbens i-dopamine depletion iyonakalisa zombini ukufumana kunye nokusebenza kwendlela yokuziphatha ye-Pavlovian enomdla: iimpembelelo ze-mesoaccumbens dopamine function. Behav Brain Res. 2002;137:149–163. [PubMed]
  101. I-Paxinos G, uFranklin K. Ubuchopho bemouse kwi-stereotaxic coordinates. ENew York: Ushicilelo lwezeMfundo; 2003.
  102. Pecina S, Smith KS, Berridge KC. Iindawo ezishushu ze-Hedonic kwingqondo. Isazi ngemithambo-luvo. 2006;12:500–511. [PubMed]
  103. Pothuizen HH, Jongen-Relo AL, Feldon J, Yee BK. Ukuqhawulwa kabini kweziphumo ze-nucleus accumbens undoqo kunye nezilonda zeqokobhe ekuziphatheni okungxamisekileyo kunye nokufunda okubukhali kwiimpuku. I-Eur J Neurosci. 2005;22:2605–2616. [PubMed]
  104. Rescorla RA. Ithuba lokutshatyalaliswa kobukho kunye nokungabikho kwe-CS kwimeko yokwesaba. J Comp Physiol Psychol. 1968;66:1–5. [PubMed]
  105. Rescorla RA. Izifundo zokuziphatha zePavlovian conditioning. U-Annu uMfundisi Neurosci. 1988;11:329–352. [PubMed]
  106. Rescorla RA, uSolomon RL. Ithiyori yokufunda yenkqubo ezimbini: ubudlelwane phakathi kwemeko yePavlovian kunye nokufunda kwezixhobo. Psychology Rev. 1967;74:151–182. [PubMed]
  107. Restle F. Ucalucalulo lweempawu kwi-mazes: isisombululo sombuzo othi "indawo-vs.-impendulo". Uphononongo lwezeNgqondo. 1957;64:217. [PubMed]
  108. Reynolds JN, Wickens JR. Iplastiki exhomekeke kwi-Dopamine ye-corticostriatal synapses. INeural Netw. 2002;15:507–521. [PubMed]
  109. Rice ME, Cragg SJ. INicotine ikhulisa imiqondiso ye-dopamine enxulumene nomvuzo kwi-striatum. Nat Neurosci. 2004;7:583–584. [PubMed]
  110. Rice ME, Cragg SJ. I-Dopamine spillover emva kokukhululwa kwe-quantal: Ukucinga kwakhona ukuhanjiswa kwe-dopamine kwindlela ye-nigrostriatal. Res Brain Rev. 2008 [Inkcazelo yamahhala ye-PMC] [PubMed]
  111. Robinson S, Rainwater AJ, Hnasko TS, Palmiter RD. Ukubuyiselwa kwentsholongwane kokubonisa i-dopamine kwi-dorsal striatum ibuyisela imeko yesixhobo kwiimpuku eziswele i-dopamine. I-Psychopharmacology (Berl) 2007; 191: 567-578. [PubMed]
  112. Roitman MF, Wheeler RA, Carelli RM. I-Nucleus accumbens neurons ilungelelaniswe ngaphakathi ukuze ibe nomvuzo kunye ne-aversive incasa ye-stimuli, ikhowudi yokuqikelela kwabo, kwaye inxulunyaniswe nemveliso yemoto. Neuron. 2005;45:587–597. [PubMed]
  113. Samejima K, Ueda Y, Doya K, Kimura M. Ukumelwa kwamaxabiso emivuzo ethe ngqo kwi-striatum. Inzululwazi. 2005;310:1337–1340. [PubMed]
  114. Schultz W. Umqondiso wephasic womvuzo weprimate dopamine neurons. Adv Pharmacol. 1998a;42:686–690. [PubMed]
  115. Schultz W. Umqondiso womvuzo oqikelelweyo we-dopamine neurons. J Neurophysiol. 1998b;80:1–27. [PubMed]
  116. Schultz W, Dayan P, Montague PR. I-subicate ye-neural yokuqikelela kunye nomvuzo. Inzululwazi. I-1997; 275: 1593-1599. [PubMed]
  117. U-Schwartz B, uGamzu E. Ulawulo lwePavlovian lokuziphatha okusebenzayo. Ku: Honig W, Staddon JER, abahleli. Incwadi yokuziphatha okusebenzayo. ENew Jersey: IHolo yasePrentice; 1977. iphepha 53–97.
  118. Sheffield FD. Ubudlelwane phakathi kwe-classical kunye ne-instrumental conditioning. Ku: Prokasy WF, umhleli. iClassical Conditioning. ENew York: Appleton-Century-Crofts; 1965. iphepha 302–322.
  119. Skinner B. Indlela yokuziphatha kwezinto eziphilayo. ENew York: Appleton-Century-Crofts; 1938.
  120. USmith-Roe SL, uKelley AE. Ukusebenza ngengozi kwe-NMDA kunye ne-dopamine D1 receptors ngaphakathi kwe-nucleus accumbens core iyafuneka kwisixhobo sokufunda. J Neurosci. 2000;20:7737–7742. [PubMed]
  121. Sotak BN, Hnasko TS, Robinson S, Kremer EJ, Palmiter RD. Ukonakaliswa kokubonakaliswa kwe-dopamine kwi-dorsal striatum inqanda ukondla. Ubuchopho Res. 2005;1061:88–96. [PubMed]
  122. Spence K. Indima yokomelezwa kwesekondari ekulibazisekeni ukufunda ngomvuzo. Uphononongo lwezeNgqondo. 1947; 54:1–8.
  123. Spence K. Ithiyori yokuziphatha kunye nokufunda. Englewood Cliffs, NJ: Prentice-Hall; 1960.
  124. Sutton RS, Barto AG. UkuFunda okomeleza. Cambridge: MIT Press; 1998.
  125. Swanson LW. Ukulawulwa kwe-Cerebral hemisphere yokuziphatha okukhuthazwayo. Ubuchopho Res. 2000;886:113–164. [PubMed]
  126. Taha SA, Imimandla HL. Ukufakwa kwekhowudi yobumnandi kunye nokuziphatha okunomdla ngabantu abahlukeneyo be-neuronal kwi-nucleus accumbens. J Neurosci. 2005;25:1193–1202. [PubMed]
  127. Taha SA, Imimandla HL. Izithintelo ze-nucleus accumbens neurons zifakela uphawu lokungena kwindlela yokuziphatha eqondiswe ngumvuzo. J Neurosci. 2006;26:217–222. [PubMed]
  128. Thorndike EL. Ubukrelekrele bezilwanyana: izifundo zovavanyo. ENew York: eMacmillan; 1911.
  129. I-Tobler PN, i-Dickinson A, i-Schultz W. Ukufakwa kwekhowudi yokukhutshwa kwangaphambili komvuzo yi-dopamine neurons kwi-paradigm ene-conditioned inhibition. J Neurosci. 2003;23:10402–10410. [PubMed]
  130. I-Tobler PN, i-O'Doherty JP, i-Dolan RJ, i-Schultz W. Ukufundwa kwe-neural yabantu kuxhomekeke kwiimpazamo zokubikezela umvuzo kwi-paradigm yokuthintela. J Neurophysiol. 2006;95:301–310. [Inkcazelo yamahhala ye-PMC] [PubMed]
  131. I-Tobler PN, i-O'Doherty JP, i-Dolan RJ, i-Schultz W. ikhowudi yexabiso lomvuzo eyahlukileyo kwisimo sengqondo esinxulumene nomngcipheko-ikhowudi yokungaqiniseki kwiinkqubo zomvuzo womntu. J Neurophysiol. 2007;97:1621–1632. [Inkcazelo yamahhala ye-PMC] [PubMed]
  132. Trapold MA, Overmier JB. I-Classical Conditioning II: Uphando lwangoku kunye nethiyori. Appleton-Century-Crofts; 1972. Inkqubo yokufunda yesibini ekufundeni ngezixhobo; iphepha 427–452.
  133. Tricomi EM, Delgado MR, Fiez JA. Ukumodareyithwa komsebenzi we-caudate ngesenzo esingalindelekanga. Neuron. 2004;41:281–292. [PubMed]
  134. I-Waelti P, i-Dickinson A, i-Schultz W. Iimpendulo ze-Dopamine zihambelana nokuqikelela okusisiseko kwethiyori yokufunda ngokusesikweni. Indalo. I-2001; 412: 43-48. [PubMed]
  135. NM emhlophe. I-hypothesis esebenzayo malunga ne-matrix yokubetha kunye neepatches: ulamlo lwenkumbulo ye-SR kunye nomvuzo. Ubomi beSayensi. 1989;45:1943–1957. [PubMed]
  136. Wickens JR, Budd CS, Hyland BI, Arbuthnott GW. Igalelo le-striatal ukuvuza kunye nokwenza izigqibo: ukwenza intsingiselo yeeyantlukwano zengingqi kwi-matrix yokucubungula ephindaphindiweyo. Ann NY Acad Sci. 2007;1104:192–212. [PubMed]
  137. Williams DR. Imeko yeklasiki kunye nenkuthazo yenkuthazo. Ku: Prokasy WF, umhleli. iClassical Conditioning. ENew York: Appleton-Century-Crofts; 1965. iphepha 340–357.
  138. UWilliam DR, uWilliam H. Ukuzigcina ngokuzenzekelayo kwihobe: i-pecking eqhubekayo nangona i-contingent non-reinforcement. Ijenali yovavanyo loVavanyo lokuziphatha. 1969; 12:511–520. [Inkcazelo yamahhala ye-PMC] [PubMed]
  139. Wiltgen BJ, Law M, Ostlund S, Mayford M, Balleine BW. Impembelelo yeempawu zePavlovian ekusebenzeni kwesixhobo kulamlwa ngumsebenzi weCaMKII kwi-striatum. I-Eur J Neurosci. 2007;25:2491–2497. [PubMed]
  140. I-Wyvell CL, iBerridge KC. I-Intra-accumbens amphetamine yonyusa imeko ekhuthaziweyo yomvuzo we-sucrose: ukuphuculwa komvuzo "ufuna" ngaphandle kokuphucula "ukuthanda" okanye ukuqiniswa kwempendulo. J Neurosci. I-2000; 20: 8122-8130. [PubMed]
  141. Yin HH. ISebe lePsychology. eLos Angeles: UCLA; 2004. Indima ye-dorsal striatum kwizenzo ezijoliswe kwiinjongo.
  142. Yin HH, Knowlton BJ. Ukuthotyelwa kwexabiso kubhangisa ukhetho olumiselweyo: ubungqina bonxulumano lwe-stimulus-stimulus. Behav Neurosci. 2002;116:174–177. [PubMed]
  143. Yin HH, Knowlton BJ. Igalelo lemimandla yababeleleyo ekubekeni nasekuphenduleni ukufunda. Funda uMem. 2004;11:459–463. [Inkcazelo yamahhala ye-PMC] [PubMed]
  144. Yin HH, Knowlton BJ. Umlutha kunye nokufunda. Ku: Stacy A, umhleli. Incwadi yolwazi olucacileyo kunye nokulutha. Iwaka leMioki: Sage; 2005.
  145. Yin HH, Knowlton BJ, Balleine BW. Izilonda ze-dorsolateral striatum zigcina iziphumo ezilindelekileyo kodwa ziphazamisa ukwakheka komkhwa ekufundeni kwezixhobo. I-Eur J Neurosci. 2004;19:181–189. [PubMed]
  146. Yin HH, Knowlton BJ, Balleine BW. Ukuvalwa kwee-receptors ze-NMDA kwi-dorsomedial striatum kuthintela ukufundwa kwesiphumo sokusebenza kwimeko yesixhobo. I-Eur J Neurosci. 2005a;22:505–512. [PubMed]
  147. Yin HH, Knowlton BJ, Balleine BW. Ukungasebenzi kwe-dorsolateral striatum kwandisa ubuntununtunu kutshintsho kwisiphumo sesenzo esingalindelekanga kwimeko yesixhobo. Behav Brain Res. 2006a;166:189–196. [PubMed]
  148. Yin HH, Zhuang X, Balleine BW. Ukufunda kwezixhobo kwiimpuku ze-hyperdopaminergic. Neurobiol Funda Mem. 2006b;85:283–288. [PubMed]
  149. Yin HH, Ostlund SB, Knowlton BJ, Balleine BW. Indima ye-dorsomedial striatum kwimeko yesixhobo. I-Eur J Neurosci. 2005b;22:513–523. [PubMed]
  150. Zahm DS. Umbono odibeneyo we-neuroanatomical kwezinye ii-subcortical substrates zokuphendula okuguquguqukayo kunye nogxininiso kwi-nucleus accumbens. I-Neurosci Biobehav Rev. 2000; 24: 85-105. [PubMed]
  151. Zahm DS. Ithiyori eguqukayo ye-basal forebrain functional-anatomical 'macrosystems'. I-Neurosci Biobehav Rev. 2005 [PubMed]