Interleaved Multitask Learning with Energy Modulated Learning Progress

Hanne Say, Suzan Ece Ada, Emre Ugur, Minoru Asada, Erhan Oztop · 2025

Read Interleaved Multitask Learning with Energy Modulated Learning Progress by Hanne Say, Suzan Ece Ada, Emre Ugur, Minoru Asada, Erhan Oztop (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00707.txt.

Introduction

Hanne Say, Suzan Ece Ada, Emre Ugur, Minoru Asada, and Erhan Oztop test human-like task switching for learning robots in a 2025 paper. People rarely master one skill fully before moving to the next; they mix tasks as mood and setting shift. Machine learners, by contrast, often grind one task to the end before starting fresh.

Their system swaps tasks based on how fast the learner gains ground and how much brain-like energy it burns. A robot arm in a fake world practiced a set of outcome-guessing tasks. The mixed plan beat both random mixing and one-task-at-a-time runs on mean accuracy. Adding the energy term kept scores strong while cutting the energy spent.

Catalog record

CREATORHanne Say, Suzan Ece Ada, Emre Ugur, Minoru Asada, Erhan Oztop
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-00707

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Interleaved Multitask Learning with Energy Modulated Learning Progress Hanne Say, Suzan Ece Ada, Emre Ugur, Minoru Asada, Erhan Oztop Abstract As humans learn new skills and apply their existing knowledge while maintaining previously learned information, ‘continual learning’ in machine learning aims to incorporate new data while retaining and utilizing past knowledge. However, existing machine learning methods often does not mimic human learning where tasks are intermixed due to individual preferences and environmental conditions. Humans typically switch between tasks instead of completely mastering one task before proceeding to the next. To explore how human-like task switching can enhance learning efficiency, we propose a multi task learning architecture that alternates tasks based on task-agnostic measures such as ‘learning progress’ and ‘neural computational energy expenditure’. To evaluate the efficacy of our method, we run several systematic experiments by using a set of effect-prediction tasks executed by a simulated manipulator robot. The experiments show that our approach surpasses random interleaved and sequential task learning in terms of average learning accuracy. Moreover, by including energy expenditure in the task switching logic, our approach can still perform favorably while reducing neural energy expenditure. Journal: Neural Networks 1 Introduction Humans has the ability to learn continuously by integrating new information while exploiting and retaining previously acquired knowledge. This lifelong learning process is characterized by constant interleaving of tasks and goals. We switch tasks in response to environmental and cognitive constraints, adjusting our learning behavior in real time - for example, deciding to disengage from a task when it becomes less efficient or more mentally demanding. [ 1 ] . This dynamic task switching not only enhances memory consolidation but also adapts us to dynamic environments by shifting attention toward differences between tasks and forcing us to be more mentally engaged [ 2 ] . Traditional machine learning approaches often rely on isolated task learning, which optimizes performance for a specific task without considering knowledge transfer from related tasks, limiting cross-domain generalization and adaptability [ 3 ] . Multi-task learning , on the other hand, aims to improve generalization by training models on multiple tasks simultaneously [ 4 ] . In continual learning , sequential task acquisition is addressed by learning tasks one after another without forgetting the earlier ones and making use of the previous tasks where possible [ 5 , 6 ] , which is called condensed learning in [ 7 ] as opposed to dispersed or interleaved learning. The order of the tasks however, affect the learning and transfer performance in these paradigms [ 7 , 8 ] . Instead of a static task scheduling, humans exhibit online dynamic task selection leading to an emergent interleaved task learning schedule. The human brain has evolved to optimize energy efficiency, favoring strategies that maximize information transmission per unit energy [ 9 ] . With mechanisms such as synaptic pruning and neural plasticity [ 10 ] , it optimizes its neural pathways, ensuring efficient cognitive function while reducing its metabolic costs [ 11 , 12 ] . Along with the brain’s drive toward efficient information processing, we also get inspiration from learning progress (LP) , which has been proposed as an intrinsic motivation mechanism that guides exploration based on the rate of improvement in performance. Schmidhuber [ 13 , 14 ] introduced LP as a measure of how quickly an agent reduces its prediction error, encouraging the agent to focus on experiences that yield the highest learning gains. This aligns well with biological principles, as the brain appears to allocate information encoding resources preferentially to stimuli that are neither too simple nor too complex, maximizing informational value relative to effort [ 15 , 16 ] . In this paper, we propose a novel approach that integrates interleaved multi-task learning with energy-modulated learning progress (IMTL-EMLP) approach. By designing a system that not only has capacity to switch between tasks in an interleaved fashion but also adjusts its learning dynamics based on energy efficiency. Our method is evaluated in a simulated robotic environment where the robot is tasked with learning the effects of its action in different environmental and task settings. The experimental results demonstrate that suitable task switching leads to an interleaved learning regime, which improves learning performance across different tasks. Additionally, introduction of energy-modulation to the learning progress based task selection results in reduced energy consumption without a significant drop in learning efficiency. Overall the contributions of our work is as follows: 1. First time multi-task learning using neural energy and learning progress for learning arbitration is realized leading to interleaved learning similar to that of humans 2. A novel multi-task learning architecture is introduced that uses shared attention layers to enable bi-directional skill transfer in interleaved learning 3. Realization of the proposed interleaved multi-task learning framework on effect prediction tasks in a simulated robotic environment. 4. Empirical demonstration that integrating energy-aware learning progress criteria reduces neural energy expenditure without degrading the agent’s learning performance The remainder of the paper is organized as follows: Section 2 reviews related work on multi-task learning, interleaved learning, intrinsic motivation, and energy-efficient computation; Section 3 formulates the problem of dynamic task arbitration formally; Section 4 introduces our proposed interleaved multi-task learning framework with energy-modulated learning progress; Section 5 presents the experimental setup and evaluates the performance of our approach across various metrics and baselines; and Section 6 concludes the paper with a summary of findings and directions for future research. 2 Related Work 2.1 Multi-task Learning Multi-task learning (MTL) [ 17 ] is a machine learning paradigm in which several tasks are learned jointly so that knowledge contained in one task can help improve the performance of the others. Unlike transfer learning—where the emphasis is on improving one target task, MTL treats all tasks as equally important and seeks to boost them collectively. MTL is also distinct from multi-label learning and multi-output regression because in MTL, the tasks typically do not share the same data records (i.e., each task has its own dataset). The key questions pertaining to MTL are (1) when to use MTL to share knowledge, (2) what to share (features, instances, or parameters), and (3) how to share, e.g., by feature learning, clustering, or parameter sharing. The most commonly studied question in the literature is “how" [ 4 ] , as we discuss next. In feature learning, it is common to map the original features [ 18 , 19 , 20 , 21 ] to a common space or choose a subset of the original task features [ 22 , 23 ] . One of the notable architectures in the feature learning category is the Cross-Stitch Networks [ 24 ] . It dynamically combines feature maps from parallel task-specific networks, by a cross-stitch unit that learns a linear combination of the activation maps from the previous layer, allowing the model to adaptively determine which features to share based on the input data. Cross-Stitch Networks has inspired our earlier skill transfer model [ 25 ] and shares conceptual elements with the proposed model of the current study. Yet, our model differs in several critical aspects. Cross-Stitch Networks are typically initialized with task-specific single-task networks, finetuned on the respective task, and then combined using cross-stitch units to perform joint training. In

Read the complete text