Serotonergic neurons signal reward and punishment on multiple timescales.
Cohen JY, Amoroso MW, Uchida N. · 2015
Read Serotonergic neurons signal reward and punishment on multiple timescales. by Cohen JY, Amoroso MW, Uchida N. (2015) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc4389268.txt.
Introduction
Jeremiah Cohen, Mackenzie Amoroso, and Naoshige Uchida recorded serotonin neurons in mice. Their study ran in eLife in 2015. Serotonin is a brain signal chemical. Its exact job has long been debated. One barrier was watching the right neurons during behavior. The team tagged serotonin neurons with a light-sensitive protein. Light pulses could then identify those cells. They recorded from the dorsal raphe area of the brain. The mice worked through blocks of trials. Rewards and punishments varied from block to block.
Many serotonin neurons shifted their steady firing over minutes. Their rate tracked whether the block was good or bad. Most also fired sharply at punishments. A subset fired at cues that predicted reward. Dopamine neurons showed no such slow shift. Serotonin thus reports good and bad outcomes at once. It does so on timescales from seconds to minutes.
Catalog record
| CREATOR | Cohen JY, Amoroso MW, Uchida N. |
|---|---|
| YEAR | 2015 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Serotonergic neurons signal reward and punishment on multiple timescales By Jeremiah Y Cohen, Mackenzie W Amoroso, Naoshige Uchida, Timothy Behrens Published in: eLife DOI: 10.7554/eLife.06346 ABSTRACT Abstract Serotonin's function in the brain is unclear. One challenge in testing the numerous hypotheses about serotonin's function has been observing the activity of identified serotonergic neurons in animals engaged in behavioral tasks. We recorded the activity of dorsal raphe neurons while mice experienced a task in which rewards and punishments varied across blocks of trials. We ‘tagged’ serotonergic neurons with the light-sensitive protein channelrhodopsin-2 and identified them based on their responses to light. We found three main features of serotonergic neuron activity: (1) a large fraction of serotonergic neurons modulated their tonic firing rates over the course of minutes during reward vs punishment blocks; (2) most were phasically excited by punishments; and (3) a subset was phasically excited by reward-predicting cues. By contrast, dopaminergic neurons did not show firing rate changes across blocks of trials. These results suggest that serotonergic neurons signal information about reward and punishment on multiple timescales. DOI: http://dx.doi.org/10.7554/eLife.06346.001 Research organism: mouse INTRODUCTION Reward and punishment play critical roles in shaping animal behavior over short and long timescales (Rolls, 2005; Somerville et al., 2013). On short timescales, moment-to-moment expectations of reward or punishment increase or decrease motivation to perform a specific action associated with the reward or punishment. On long timescales, repeated exposure to reward or punishment can elicit long-lasting positive or negative emotional states (often called ‘mood’), that can increase or decrease the frequency of performing reward-seeking actions more generally (Niv et al., 2006; Cools et al., 2011; Somerville et al., 2013; Wang et al., 2013). The midbrain raphe nuclei contain the majority of forebrain-projecting serotonergic neurons in mammals (Jacobs and Azmitia, 1992). This small population of neurons (approximately 9000 in the mouse dorsal raphe; Ishimura et al., 1988) projects to almost the entire forebrain (Azmitia and Segal, 1978; Moore et al., 1978; Steinbusch, 1981; O'Hearn and Molliver, 1984; Vertes, 1991; Gagnon and Parent, 2014). The diffuse projection targets of the serotonergic system have led to many theories about its function. Serotonin has been proposed to be involved in processing reward and punishment (Maswood et al., 1998; Daw et al., 2002; Maier and Watkins, 2005; Nakamura et al., 2008; Ranade and Mainen, 2009; Tops et al., 2009; Cools et al., 2011; Amo et al., 2014). One theory proposes that serotonin regulates aversive learning and negative motivation in response to punishments (Soubrié, 1986; Deakin and Graeff, 1991; Daw et al., 2002; Dayan and Huys, 2009). According to this theory, serotonin opposes the positive reinforcement and behavioral activation regulated by dopamine. Whereas dopaminergic neurons signal appetitive prediction errors (Schultz et al., 1997), serotonergic neurons could signal punishments, thereby adjusting future behavior to avoid those punishments or inhibiting specific actions that are associated with punishments. This theory has support from lesion, stimulation, tryptophan depletion, and pharmacological studies (Tye et al., 1977; Graeff and Silveira Filho, 1978; Liu and Ikemoto, 2007; Crockett et al., 2009; Shin and Ikemoto, 2010), but there is little evidence that serotonergic neurons signal punishments in awake animals (cf. Aghajanian et al., 1978; Montagne-Clavel et al., 1995; Schweimer and Ungless, 2010). A second theory proposes that serotonin signals global reward states, such as tracking average reward (Daw et al., 2002) and modulating mood (Savitz et al., 2009). Here, serotonin is thought to provide its diffuse targets with long-term signals about the value of the environment, which, at the extreme, is correlated with changes in mood. These long-term signals inhibit behavior or increase the vigor of taking actions in a relatively action-general manner. This theory has support from clinical observations (Fava and Kendler, 2000) and genetic studies (Donaldson et al., 2013). However, there is little neurophysiological evidence for such a function. A third theory proposes that serotonin is involved in waiting for reward (Miyazaki et al., 2011a, 2011b, 2014; Fonseca et al., 2015). In this theory, activation of serotonergic neurons promotes patience (Miyazaki et al., 2014) or slows movements that allow an animal to wait for a delayed reward. This theory could explain how waiting for reward could be linked to behavioral inhibition (Soubrié, 1986; Fonseca et al., 2015). Clarifying whether and how serotonin exerts these functions requires understanding how serotonergic neuron firing correlates with both global features of the environment, such as changes in average reward value, and with punishments. These data have been challenging to collect because of the heterogeneity of neurons in and around the raphe nuclei. About two-thirds of dorsal raphe neurons are serotonergic, but others contain GABA, glutamate, dopamine, acetylcholine, or various peptides (Hökfelt et al., 2000; Commons, 2009; Fu et al., 2010; Hioki et al., 2010). Many previous studies have relied on spike waveform characteristics to identify serotonergic neurons in extracellular recordings. This approach may lead to false positives and misses, however (Allers and Sharp, 2003; Kirby et al., 2003; Marinelli et al., 2004; Urbain et al., 2006; Hajós et al., 2007; Schweimer et al., 2011). Given this chemical diversity and the difficulty of identifying neuron types in extracellular recordings, it would be unsurprising to find corresponding physiological diversity. Indeed, previous studies found significant heterogeneity in the activity of dorsal raphe neurons in relation to behavioral tasks (Fornal et al., 1996; Nakamura et al., 2008; Ranade and Mainen, 2009; Bromberg-Martin et al., 2010; Miyazaki et al., 2011a; Inaba et al., 2013; Li et al., 2013). One set of experiments demonstrated that dorsal raphe neurons fired in a reward-value-dependent manner during trials of a saccade-to-target task, but that the modulation disappeared before the next trial (Nakamura et al., 2008; Bromberg-Martin et al., 2010). Another set of experiments showed tonic firing rate modulations correlating with waiting for reward from putative dorsal raphe serotonergic neurons (Miyazaki et al., 2011a). These studies suggested that serotonergic neurons signal reward expectation or waiting time (or patience) on the scale of hundreds of milliseconds, but does not determine whether serotonin could be involved in longer-term changes in value. In the present study, we sought to test whether dorsal raphe serotonergic neuron firing correlated with rewards and punishments on different timescales. To address this question, we used a task in which reward value changed on slow and fast timescales. Importantly, we recorded from optogenetically-identified serotonergic neurons. Our results show that serotonergic neurons signal information about reward and punishment across multiple timescales. RESULTS Behavioral task We classically conditioned head-fixed, thirsty mice with different odor cues that predicted a reward (water), neutral outcome (nothing), or punishment (a puff of air delivered to the animal's face; Cohen et al., 2012). Each behavioral trial began with a conditioned stimulus (CS; an odor, 1 s), followed by a 1-s delay and an unconditioned stimulus (US; the outcome; Figure 1A). Mice licked toward the water-delivery tube in the delay period before rewards arrived, but not during neutral or punishment trials, indicating that they had learned the CS-US associations (analysis of variance (ANOVA), t-tests, p < 0.001 for each session; Figure 1B). We varied the structure of the task so that animals received blocks of 10 reward trials, alternating with 10 punishment trials, with a tone indicating transitions between blocks (or, in 35% of sessions, block order was random;