Distinct Roles of Directional and Positional Experience in De Novo Visuomotor Learning Authors: Tomoya Kawano, Shota Hagio Published: 2026 ABSTRACT Humans can flexibly acquire entirely new sensorimotor mappings, a process known as de novo motor learning. A central challenge in de novo motor learning is that the learner must discover a viable solution from scratch within a highly redundant control space, without predefined task constraints. Understanding what types of sensorimotor information contribute to the formation of accurate motor behavior in such situations is therefore critical for explaining how novel sensorimotor skills are acquired. While previous studies have suggested that novel visuomotor mappings can be formed based on movement direction and target position, it remains unclear how these two types of information contribute to the learning process. To address this question, we trained 25 human participants (13 males and 12 females) to learn arbitrary joystick-to-cursor mapping. We then employed a generalization paradigm to selectively restrict learning experience to either movement direction or target position. Three distinct target conditions were designed: one emphasized target position (P), another emphasized movement direction (D), and a third (P&D) encouraged learning of both components separately. Results showed direction experience reduced initial direction error, whereas the lack of position experience was associated with increased final position error. However, in the P&D condition, combining these experiences did not yield additive generalization. Instead, endpoint accuracy was positively correlated with the alignment between direction- and position-based outputs in the redundant control space. These results suggest that accurate formation of a novel sensorimotor map depends on the coordinated use of directional and positional experiences. Significance Statement How do humans build entirely new sensorimotor relationships from scratch? This study examined how distinct sensorimotor experiences (movement direction and target position) contribute to the acquisition of a novel joystick-to-cursor mapping. By isolating these experiences, we found that direction experience improved movement initiation, while the lack of position experience reduced movement termination accuracy. However, combining these experiences did not lead to more accurate movements as a whole. Instead, the accuracy was related to how well directional and positional joystick outputs were aligned in redundant control space. These findings suggest that de novo motor learning requires the coordinated use of directional and positional information. Introduction Humans possess a remarkable ability to learn arbitrary sensorimotor maps, a process known as de novo motor learning (Krakauer et al., 2019). This capability underlies many everyday skills, such as playing musical instruments or using unfamiliar tools. For example, when first operating a remote-controlled device (e.g., a drone or robotic manipulator), individuals must learn how their motor commands applied to a handheld device translate into movements of a spatially separate external effector. De novo motor learning refers to the process of establishing this novel relationship (i.e., forming a new sensorimotor map). Previous studies have primarily focused on motor adaptation, where pre-existing sensorimotor maps are recalibrated in response to environmental changes (Shadmehr and Mussa-Ivaldi, 1994; Krakauer et al., 2000). However, information regarding how such sensorimotor maps are built from scratch remains limited. To experimentally induce de novo motor learning, researchers have devised a variety of tasks. A commonly used approach is to create an arbitrary mapping between the position of a body part and on-screen cursor position (Mosier et al., 2005; Haith et al., 2022; Kawano et al., 2024). For example, in a bimanual task, vertical movements of one hand control horizontal cursor movements and vice versa, forcing participants to acquire a novel visuomotor map through practice (Yang et al., 2021; Haith et al., 2022). While participants initially struggle to direct the cursor toward intended targets, they gradually acquire precise control with training. Although these tasks evoke de novo motor learning, how the brain constructs a new sensorimotor map remains poorly understood. Unlike motor adaptation, de novo motor learning requires establishing entirely new mappings between actions and sensory consequences. This distinction raises a fundamental question: what aspects of the sensorimotor experience does the brain rely on when constructing a novel sensorimotor mapping from scratch? It has been proposed that the brain can represent visuomotor map based on two distinct types of information (Wang and Sainburg, 2005; Wu and Smith, 2013; Van der Graaff et al., 2017). One is to transform a movement direction into a change in hand posture (vector coding); and the other is to transform a target position into a specific hand posture (position coding). Several studies suggested that de novo motor learning relies on vector coding (Mosier et al., 2005; Ranganathan et al., 2013). Supporting this idea, it has been observed that the cursor trajectory tended to became straight even without explicit instruction (Mosier et al., 2005). In addition, the final hand posture at the target has been shown to depend on the movement direction toward the target (Ranganathan et al., 2013). Conversely, other findings suggested the involvement of position coding. Several studies have demonstrated that de novo motor learning tasks can be learned without continuous visual feedback of a cursor (Liu and Scheidt, 2008; Kim et al., 2024; Park et al., 2024). This finding implies that the brain can construct visuomotor maps using only information about the target position (i.e., position coding). Together, these findings suggest that the brain can build a novel visuomotor map using information about both movement direction and target position. In this study, we aimed to elucidate how two types of information—movement direction and target position—contribute to de novo motor learning. To this end, we employed a generalization paradigm (Malfait et al., 2002; Donchin et al., 2003; Shadmehr, 2004), which allows us to dissociate the contributions of direction and position experiences by examining how restricted learning experience generalizes to untrained movements. We conducted two experiments. In Experiment 1, three distinct target conditions were designed to elicit generalization from experience with specific components: one target emphasized target position alone, another emphasized movement direction alone, and a third encouraged learning of both elements separately. We define “separately” as experiencing both the matched position and direction of an untrained movement through distinct training contexts, whereas “alone” refers to experiencing only one of these matched components. This experimental design is crucial for examining whether the sensorimotor system can integrate separate learning experiences. We reasoned that if direction and position information additively contribute to the construction of a sensorimotor map, then acquiring both components should lead to greater generalization than experiencing either component alone. Experiment 2 served as a control experiment in which a separate group of participants was trained only on one target condition. This experiment tested whether the generalization pattern observed in Experiment 1 was influenced by interleaving different target conditions within the same participants. Materials and Methods Experiment 1 Participants Twenty-five right-handed individuals without a history of neurological or motor disorders were included in this study [13 males and 12 females; aged 20.8 ± 1.87 years, mean ± standard deviation (SD)]. All participants provided written informed consent after receiving a detailed description of the purpose, potential benefits, and risks of the experiment. One female participant was excluded due to failure to complete the whole task within the 1.5-h experiment time (complete up to the 12th block out of 20). All procedures used in this study were performed in accordance with the Declaration of Helsinki and were approved by the Ethics Committee for Human Experimentation at the Graduate School of Human and Environmental Studies, Kyoto University (24-H-15). Experimental setup The participants sat in front of two three-axis joysticks (Model: 9SA50RR-22-47; APEM) equipped on an adjustable table with a 27-in LCD monitor (1,920 × 1,080-pixel resolution, 165 Hz refresh rate; ASUS; Fig. 1A). Both joysticks were positioned symmetrically with respect to the participant’s midline, placed 30 cm forward from the face, and separated laterally by 22.5 cm. Participants could not see their hands, and their head motion was limited by a chinrest. Participants manipulated the two joysticks with both hands using three fingers (thumb, index, and middle finger). Each joystick measured 3-axis positions (i.e., X: horizontal, Y: vertical, and Z: roll axis), acquiring a total of 6 input signals in 16-bit at a sampling rate of 50 Hz. Both joysticks were spring-loaded, meaning they passively returned to the center position when the fingers were removed. We performed preprocessing on these inputs in real time using a custom LabVIEW program as follows: Initially, joystick inputs were normalized such that each axis could vary independently within the range of [ − 1, 1], where ±1 corresponded to ±14.4° tilt for the X- and Y-axes, and ±27° rotation for the Z-axis. Thereafter, the five-point moving average was applied to reduce the intrinsic noise of the joysticks. The post-processing 6-dimensional vector h, representing the joystick positions, was linearly mapped onto the lateral and vertical cursor position p using the equation below (Mosier et al., 2005; Ranganathan et al., 2013; Choi et al., 2020; Fig. 1B): [xy]=[a1,1a1,2…a1,6a2,1a2,2…a2,6]×[h1h2…h5h6]T, i.e., p = Ah, where the mapping matrix A was determined from the calibration task (described below). Experimental setup. A, Participants manipulated two joysticks to control the on-screen cursor. B, Cursor position was determined by the joystick position. Two joysticks measured a total of six input signals. The six-dimensional joystick position vector was linearly translated into the cursor position. Figure 1-1 shows the individual joystick-to-cursor mapping matrices (PC1 and PC2 loadings) for all participants. Individual mapping matrices of all participants are shown. Blue and red bars represent PC1 and PC2, respectively. Download Figure 1-1, TIF file. Experimental task There were two tasks in the experiment: a calibration task and point-to-point reaching task. Calibration task To determine the mapping matrix A for each participant, calibration task was conducted. In this task, participants were instructed to move the joysticks freely for 1 min. To encourage participants to explore various joystick movements, we presented six bar graphs visualizing the real-time variance of joystick positions for each axis (Choi et al., 2020). The acquired calibration data was standardized for each axis to ensure that all axes contributed to the mapping matrix A. Principal component analysis (PCA) was then performed on the standardized calibration data. PCA identifies orthogonal directions in the data that successively capture the largest variance, such that each principal component represents a dominant pattern of coordinated joystick movements. The first two principal components (PC1 and PC2) were used to form the first and second rows of the mapping matrix A. Therefore, the scores of the PC1 and PC2 were converted to the lateral and vertical cursor position, respectively. We used first two PCs to avoid requiring participants to perform unfamiliar joystick movements in the following reaching task. Individual mapping matrices for all participants are shown in Figure 1-1. Point-to-point reaching task Participants were required to move the on-screen cursor (5 mm radius) to a series of targets (10 mm radius). During the task, targets were presented sequentially, with a sequence of trials referring to a group of consecutive reaches toward these targets (Fig. 2A). Details regarding the locations and order of the targets are described below (Experimental conditions). All trials were classified into either a training trial or a test trial. Each trial was defined as one reaching movement toward a single target. In the training trial, participants were given continuous visual feedback of the cursor. Based on this visual information, participants moved the cursor toward the target. When the cursor stayed within a target for 500 ms, it moved to a new location. At the end of every 2 or 3 training trials (referred to as a sequence of trials), the visual feedback of the cursor was removed and participants were instructed to relax the joysticks (i.e., release their hands so that the spring force passively returned each joystick to the center position) to reset the cursor position at the center of the workspace (Fig. 2B). The number of trials in each sequence differed across experimental conditions (see Experimental conditions). To control the amount of time spent across participants, a time limit of 12 s was imposed only on the final trial of each sequence. If the elapsed time exceeded 12 s, the trial was terminated and participants were instructed to relax the joysticks. Participants were instructed to move the cursor to the target as fast as possible. To motivate them to follow this instruction, we provided a score calculated based on the elapsed time after the start of the trial, which reflects how quickly they reached the target. The score was calculated as follows: score={100(time≤1.5)100−10012−1.5×(time−1.5)(1.5