Event-related potential studies of outcome processing and feedback-guided learning.
San Martín R. · 2012
Read Event-related potential studies of outcome processing and feedback-guided learning. by San Martín R. (2012) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc3491353.txt.
Introduction
Brains judge outcomes within a few hundred milliseconds, and René San Martín reviews the electrical signals that reveal that split-second scoring in 2012. His solo review covers event-related potentials, voltage waves recorded from the scalp, with focus on two components tied to feedback and learning.
The feedback-related negativity peaks near 250 milliseconds, runs larger for bad outcomes, and links to the anterior cingulate cortex. The later P3 wave, between 300 and 600 milliseconds, grows with outcome size and draws on spread-out cortical sources. San Martín weighs rival theories of what each signal computes. General rules remain elusive: the review closes honestly on how much about these components stays unsettled.
Catalog record
| CREATOR | San Martín R. |
|---|---|
| YEAR | 2012 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 114 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Event-related potential studies of outcome processing and feedback-guided learning By René San Martín Published in: Frontiers in Human Neuroscience DOI: 10.3389/fnhum.2012.00304 ABSTRACT In order to control behavior in an adaptive manner the brain has to learn how some situations and actions predict positive or negative outcomes. During the last decade cognitive neuroscientists have shown that the brain is able to evaluate and learn from outcomes within a few hundred milliseconds of their occurrence. This research has been primarily focused on the feedback-related negativity (FRN) and the P3, two event-related potential (ERP) components that are elicited by outcomes. The FRN is a frontally distributed negative-polarity ERP component that typically reaches its maximal amplitude 250 ms after outcome presentation and tends to be larger for negative than for positive outcomes. The FRN has been associated with activity in the anterior cingulate cortex (ACC). The P3 (~300–600 ms) is a parietally distributed positive-polarity ERP component that tends to be larger for large magnitude than for small magnitude outcomes. The neural sources of the P3 are probably distributed over different regions of the cortex. This paper examines the theories that have been proposed to explain the functional role of these two ERP components during outcome processing. Special attention is paid to extant literature addressing how these ERP components are modulated by outcome valence (negative vs. positive), outcome magnitude (large vs. small), outcome probability (unlikely vs. likely), and behavioral adjustment. The literature offers few generalizable conclusions, but is beset with a number of inconsistencies across studies. This paper discusses the potential reasons for these inconsistencies and points out some challenges that probably will shape the field over the next decade. INTRODUCTION The global function of the nervous system can be characterized as the adaptive control of behavior, a process that involves learning which action is relevant in a given context and switching to a different behavioral policy or scenario when outcomes are less optimal than expected. Hence “outcome” refers to the consequences that an organism faces as direct result of its own actions (e.g., financial losses due to impulsive investments) or resulting from its situation (e.g., receiving an unexpected gift). In order to successfully adapt behavior the brain has to determine, as quickly and as accurately as possible, whether the current scenario and behavioral policy results in positive or negative outcomes. This paper reviews the extant literature on how two event-related potential (ERP) components, the feedback-related negativity (FRN), and the P3, shed light on the neural substrate of outcome processing. The relevance of outcome processing is highlighted by the association between individual differences in its functioning and personality constructs (Kramer et al., 2008; Onoda et al., 2010; Smillie et al., 2011), economic preferences (Coricelli et al., 2005; Kuhnen and Knutson, 2005; De Martino et al., 2006; Kable and Glimcher, 2007; Venkatraman et al., 2009), and pathological conditions such as compulsive gambling (Reuter et al., 2005; Goudriaan et al., 2006), drug abuse (Shiv et al., 2005; Everitt et al., 2007; Fein and Chang, 2008; Franken et al., 2010; Fridberg et al., 2010; Park et al., 2010), depression (Foti and Hajcak, 2009), and schizophrenia (Gold et al., 2008; Morris et al., 2008). In the past decade neuroimaging studies have contributed enormously to identifying brain regions and patterns of functional connectivity supporting outcome processing in the human brain (e.g., Delgado et al., 2000, 2003; Breiter et al., 2001; Elliott et al., 2003; O'Doherty et al., 2003b; Ullsperger and Von Cramon, 2003; Holroyd et al., 2004b; Huettel et al., 2006; Kim et al., 2006; Mullette-Gillman et al., 2011). The discovery of this underlying physiology has been accompanied by a wealth of new knowledge about the functional properties of these mechanisms. In particular, non-invasive electrophysiological methods have provided important information about the temporal properties of the neural mechanisms mediating outcome evaluation in humans. Notably, by recording ERPs while participants perform learning-guided choice tasks or simple gambling games, researchers have begun to describe how the brain processes outcomes within a few hundred milliseconds from their onset. Among the potential neural correlates of outcome evaluation, the FRN is by far the most studied ERP component. The FRN is a frontocentral negative-going ERP component that peaks ~250 ms following outcome presentation and is typically larger for negative outcomes than for positive outcomes (Figure 1A). According to source localization, the FRN is generated in the medial prefrontal cortex (mPFC), most probably in the anterior cingulate cortex (ACC; Miltner et al., 1997; Gehring and Willoughby, 2002; Ruchsow et al., 2002; van Schie et al., 2004; Muller et al., 2005; Nieuwenhuis et al., 2005b; Hewig et al., 2007; Yu and Zhou, 2009; Yu et al., 2011). Consistent with ERP studies, results implicating the ACC in processing negative feedback have been reported using fMRI (Kiehl et al., 2000; Holroyd et al., 2004b). [Figure: A schematic representation of ERP waveforms typically elicited by outcomes (based on Gehring and Willoughby, 2002; Yeung and Sanfey, 2004; Goyer et al., 2008; Gu et al., 2011a). The horizontal axis represents the elapsed time relative to the onset of behavioral feedback (at 0 ms). (A) Example of ERP waveform for negative and positive outcomes recorded at a frontocentral electrode site. The scalp topography represents the contrast between the two waveforms at the time when the FRN peaks (~250 ms). (B) Example of ERP waveform for large and small magnitude outcomes recorded at a central-parietal electrode site. The scalp topography represents the contrast between the two waveforms at the time when the P3b peaks (~300–600 ms).] The P3 is another outcome-related ERP component. The P3 is a positive-polarity component most pronounced at the centroparietal recording sites at about 300–600ms after stimuli presentation (Figure 1B). According to a model proposed by Yeung and Sanfey (2004) outcome magnitude (i.e., large vs. small) and outcome valence (i.e., loss vs. gains) are coded separately in the brain, with the P3 being sensitive to outcome magnitude and the FRN to outcome valence. Despite controversial evidence (Hajcak et al., 2005, 2007; Bellebaum and Daum, 2008; Goyer et al., 2008; Wu and Zhou, 2009; Pfabigan et al., 2011) the independent coding model is presently the dominant account of the relationship between the FRN and the P3 during outcome processing. The number of ERP studies of outcome have multiplied over the last decade. Yet the last systematic review of such studies focused exclusively on the FRN, and dates back 8 years (Nieuwenhuis et al., 2004a). This paper intends to provide an updated perspective about current knowledge from ERP research of outcome processing in the human brain. In order to achieve this goal, the paper reviews the historical antecedents and dominant theoretical accounts of the FRN and P3. These theories are evaluated in light of studies addressing how FRN and P3 are modulated by outcome valence (negative vs. positive), outcome magnitude (large vs. small), outcome probability (unlikely vs. likely), and behavioral adjustment. Finally, this paper discusses some challenges that ERP studies of outcome processing will probably have to address over the next decade in order to integrate FRN and P3 effects in a unitary account of outcome processing in the brain. THE FEEDBACK-RELATED NEGATIVITY Historical antecedents of the FRN The study of the neural basis of outcome evaluation and feedback-guided learning has been