Interacting adaptive processes with different timescales underlie short-term motor learning.

Smith MA, Ghazizadeh A, Shadmehr R. · 2006

Read Interacting adaptive processes with different timescales underlie short-term motor learning. by Smith MA, Ghazizadeh A, Shadmehr R. (2006) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc1463025.txt.

Introduction

Learning a reach takes more than one kind of memory. Smith, Ghazizadeh, and Shadmehr showed in 2006 that two learning processes run at once, on time scales of minutes. One reacts weakly to errors but holds its gains well. The other reacts strongly but forgets fast.

Their model made an odd forecast. After training, if error feedback is held at zero, skill should partly bounce back on its own. Tests with human reaching confirmed it. Smith argues the two-process view also explains savings, where old skills return fast, and why new learning can clash with old. The brain seems to run two learners at different speeds.

Catalog record

CREATORSmith MA, Ghazizadeh A, Shadmehr R.
YEAR2006
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC1463025

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning By Maurice A Smith, Ali Ghazizadeh, Reza Shadmehr, James Ashe Published in: PLoS Biology DOI: 10.1371/journal.pbio.0040179 ABSTRACT Multiple processes may contribute to motor skill acquisition, but it is thought that many of these processes require sleep or the passage of long periods of time ranging from several hours to many days or weeks. Here we demonstrate that within a timescale of minutes, two distinct fast-acting processes drive motor adaptation. One process responds weakly to error but retains information well, whereas the other responds strongly but has poor retention. This two-state learning system makes the surprising prediction of spontaneous recovery (or adaptation rebound) if error feedback is clamped at zero following an adaptation-extinction training episode. We used a novel paradigm to experimentally confirm this prediction in human motor learning of reaching, and we show that the interaction between the learning processes in this simple two-state system provides a unifying explanation for several different, apparently unrelated, phenomena in motor adaptation including savings, anterograde interference, spontaneous recovery, and rapid unlearning. Our results suggest that motor adaptation depends on at least two distinct neural systems that have different sensitivity to error and retain information at different rates. INTRODUCTION Savings is a fundamental property of memory. It refers to the ability of prior learning to speed subsequent relearning even after behavioral manifestations of the prior learning have been washed out. A typical experiment that demonstrates savings has three parts. First, a novel response to a stimulus is gradually learned over the course of many trials. Next, this stimulus-response relationship is unlearned or extinguished so that the stimulus no longer evokes the learned response. Finally, the initially learned stimulus-response relationship is relearned under the original learning conditions. If savings is present, relearning will proceed more quickly than initial learning. Savings has been studied in several classical conditioning [ 1] and operant conditioning paradigms [ 2] but until recently had not been demonstrated in motor adaptation. Motor adaptation is a type of learning in which motor commands are altered to compensate for disturbances in the external environment or in the motor system itself. A recent study of eye saccade gain adaptation by Kojima et al. [ 3] elucidated several properties of savings in motor adaptation. This study showed that (1) savings can occur in a motor adaptation task, (2) it can cause a sudden jump in performance if a block of no-feedback (dark) trials is inserted between the extinction and re-adaptation blocks, and (3) it can be washed out if a block of baseline trials is inserted between the extinction and re-adaptation blocks. Current models of trial-to-trial motor adaptation cannot account for these results. While these models have been successfully used to predict motor responses to novel, randomly generated disturbance sequences [ 4, 5] and to assess the patterns of generalization [ 6, 7], these models all predict a single time constant of adaptation. However, in addition to savings, several other experimental observations suggest that time constants of adaptation may increase or decrease from baseline depending on the specifics of the training regimen. One well-known effect is anterograde interference. This refers to the finding that learning an initial motor adaptation reduces not only the initial performance but also the time constant for subsequently learning the opposite adaptation [ 8– 10]. Two other important observations are rapid de-adaptation [ 10, 11] and rapid downscaling [ 10], where fully or partially unlearning a motor adaptation can be faster than initial learning of this adaptation. In summary, current models of trial-to-trial adaptation fail to account for the effects of savings, spontaneous recovery, anterograde interference, rapid unlearning, and rapid downscaling. To account for the results of their savings experiments, Kojima et al. suggested a novel two-state model in which distinct mechanisms specialized in increasing the gain of saccades versus decreasing it [ 3]. This gain-specific model successfully produced savings and washout of savings observed by these authors. However, it failed to account for the spontaneous recovery of the initially adapted state when monkeys were held in darkness following the extinction trials (allowing saccades to take place without error feedback). This model is also unable to explain the phenomenon of anterograde interference in which secondary learning is slower than baseline. Saccade adaptation in monkeys [ 12– 14] and humans [ 15, 16], as well as a host of motor adaptation paradigms [ 17– 20], depends on the cerebellum. In the cerebellum, motor state and error information simultaneously arrive in two structures: the cerebellar cortex and the cerebellar nuclei. We wondered whether a two-state model in which each state learned at a different rate, rather than in a different direction, might be able to account for the full pattern of savings these authors saw, and simultaneously explain the effects of anterograde interference, rapid unlearning, and rapid downscaling. Here we show this to be the case. RESULTS Figure 1 shows simulations of the experimental paradigm that demonstrated savings in saccade adaptation [ 3]. We simulated the progression of motor output in this learn-unlearn-relearn paradigm with three different models: (1) a single-state, single time-constant model, (2) a two-state, gain-specific model, and (3) a two-state, gain-independent, multi-rate model. All of these models modify motor output on a particular trial as a function of the current motor state and the error experienced on that trial (see Materials and Methods). The learning rules for these models are shown below: [Figure: Simulations of Motor Adaptation Experiments That Show Savings(A) Paradigm for basic savings experiment. This paradigm consists of four blocks: (1) a baseline period, (2) initial learning, (3) unlearning, and (4) relearning. Note that adaptation stimulus for the unlearning block is opposite that used in learning blocks, and the number of trials in the unlearning block is adjusted so that on this block's last trial performance is at the baseline level.(B and C) Model simulations of the experiment paradigm shown in (A). The first row (B) shows the raw results of these simulations, while the second row (C) shows a direct comparison of simulated performance in the initial learning and relearning blocks. The different columns display simulation results from the single-state, gain-specific, and multi-rate models, respectively. The single-state model fails to show savings (faster relearning), but the gain-specific and multi-rate models show savings.(D) Paradigm for savings experiment with washout. Note that this paradigm is similar to the paradigm shown in (A), except that a washout block of variable length is inserted prior to the relearning block.(E) The amount of savings found in simulation, as a function of the number of washout trials. The amount of savings is measured as the percent improvement in performance on the 30th trial in the relearning block compared to the 30th trial in the initial learning block. The columns are the same as in (B). The gain-specific and multi-rate models show similar washout of savings; however, in the single-state model there is no savings to wash out.] In all these models error arises because there is a difference between the motor output x( n) and the state of the environment f( n) such that: e( n) = f ( n) − x( n). While a single-state system cannot reproduce a motor output pattern that

Read the complete text