mjlab A Lightweight Framework for GPU-Accelerated Robot Learning github.com/mujocolab/mjlab
Kevin Zakka, Qiayuan Liao, Brent Yi, Louis Le Lay, [2pt] Koushil Sreenath, Pieter Abbeel, [4pt] UC Berkeley · 2026
Read mjlab A Lightweight Framework for GPU-Accelerated Robot Learning github.com/mujocolab/mjlab by Kevin Zakka, Qiayuan Liao, Brent Yi, Louis Le Lay, [2pt] Koushil Sreenath, Pieter Abbeel, [4pt] UC Berkeley (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22074.txt.
Introduction
Kevin Zakka and co-authors release a lightweight framework for robot learning called mjlab. Robot learning needs fast simulation, since policies improve through millions of trial actions. Heavyweight simulators with painful setup slow that loop and shut out smaller labs.
mjlab pairs GPU-accelerated simulation with composable environments and minimal setup friction. It adopts a manager-based design where users assemble modular blocks for observations, rewards, and events, and it runs on MuJoCo Warp for GPU speed. Their 2026 preprint presents the framework as open source. Lowering the cost of entry to robot learning research could widen who gets to train the next generation of capable robots.
Catalog record
| CREATOR | Kevin Zakka, Qiayuan Liao, Brent Yi, Louis Le Lay, [2pt] Koushil Sreenath, Pieter Abbeel, [4pt] UC Berkeley |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22074
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
mjlab A Lightweight Framework for GPU-Accelerated Robot Learning github.com/mujocolab/mjlab Kevin Zakka, Qiayuan Liao, Brent Yi, Louis Le Lay, [2pt] Koushil Sreenath, Pieter Abbeel, [4pt] UC Berkeley Abstract We present mjlab , a lightweight, open-source framework for robot learning that combines GPU-accelerated simulation with composable environments and minimal setup friction. mjlab adopts the manager-based API introduced by Isaac Lab ( 9 ) , where users compose modular building blocks for observations, rewards, and events, and pairs it with MuJoCo Warp ( 5 ) for GPU-accelerated physics. The result is a framework installable with a single command, requiring minimal dependencies, and providing direct access to native MuJoCo data structures. mjlab ships with reference implementations of velocity tracking, motion imitation, and manipulation tasks. Figure 1: Unitree G1 humanoids performing a dance trained with the motion tracking pipeline from BeyondMimic ( 7 ) . Thousands of parallel environments are simulated on a single GPU and visualized in mjlab ’s web-based Viser viewer. 1 Introduction Reinforcement learning has become a powerful tool for training robot controllers in simulation and transferring them to real hardware. The fidelity of this sim-to-real pipeline hinges on getting simulation details right: actuator dynamics, contact modeling, sensor noise, and domain randomization all require careful implementation. Middleware that handles this infrastructure, ideally written and vetted by the people closest to the simulator, frees researchers to focus on what matters most: shaping reward functions, designing curriculums, and iterating on policies. Several frameworks address this need. Isaac Lab ( 9 ) provides a comprehensive, GPU-accelerated platform with a rich manager-based API for composing RL environments. However, it requires the Omniverse runtime, which adds installation complexity and startup latency. Its physics engine, PhysX, was closed-source until recently, making low-level debugging and introspection difficult. MuJoCo Playground ( 14 ) takes the opposite approach: minimal abstractions and monolithic environment definitions that are easy to hack and quick to prototype. This design excels for one-off experiments, but code duplication across robots and tasks accumulates quickly, making multi-robot or multi-task codebases difficult to maintain. There remains a gap for a framework that is both lightweight and built on a proven orchestration API with access to best-in-class physics. mjlab fills this gap. It adopts Isaac Lab’s manager-based design, where users compose self-contained building blocks for observations, rewards, events, and commands, and pairs it with MuJoCo Warp for GPU-accelerated physics simulation. The result is a framework with minimal dependencies, fast startup, direct access to native MuJoCo model and data structures, and a PyTorch ( 2 ) -native interface for policy training. mjlab ships with three robot morphologies and three reference tasks. The remainder of this report describes the design philosophy (Section 2 ), architecture (Section 3 ), core components (Section 4 ), the manager-based API (Section 5 ), shipped tasks (Section 6 ), and software design (Section 7 ). 2 Design Philosophy and Scope mjlab is designed around three core engineering commitments: (1) minimal installation friction, (2) transparent and inspectable physics, and (3) tight integration with the MuJoCo ecosystem. These commitments motivate deliberate trade-offs in implementation and scope, which we make explicit below. Physics backend. mjlab targets a single physics stack, MuJoCo Warp, to prioritize simulation transparency and debuggability. The framework exposes MuJoCo-native MjModel and MjData structures for direct inspection and state access. A non-goal is cross-simulator portability ( 1 ) ; mjlab favors precise control and interpretability over backend generality. Sensing and rendering. mjlab provides depth and raycast sensors for geometric perception. High-fidelity RGB rendering is out of scope. This does not preclude vision-based policies: a common approach is to train privileged policies using full state, then distill into vision-based controllers using external rendering. Environment composition. mjlab adopts Isaac Lab’s manager-based API, where environments are built from reusable, composable components rather than monolithic definitions. Modular terms for observations, rewards, events, and curricula reduce code duplication across tasks. The implementation remains fully MuJoCo-native; users work directly with MuJoCo models and conventions. Scope and extensibility. mjlab provides infrastructure for rigid-body robot learning that is intended to be extended to custom robots, tasks, sensors, and actuators. The framework includes three example robots and tasks that demonstrate use of the API. Together, these choices reflect a focus on fast iteration, transparent physics, and MuJoCo-native workflows, rather than feature completeness or broad simulator support. 3 Architecture Entity 1 (G1 robot) MJCF + configs Entity 2 (Cube) MJCF Entity 3 (Terrain) Python MjSpec MjModel MuJoCo Warp (GPU, N worlds) ManagerBasedRlEnv Obs Action Reward Term Event Cmd Curric RSL-RL Trained Policy Figure 2: Entities are composed into an MjSpec, compiled, and transferred to MuJoCo Warp for GPU simulation. The ManagerBasedRlEnv orchestrates the MDP; RSL-RL handles training. MuJoCo Warp. MuJoCo Warp 5 ( docs ) is a GPU-accelerated backend for MuJoCo built on NVIDIA Warp ( 8 ) . It preserves MuJoCo ’s ( 12 ) familiar MjModel / MjData paradigm: MjModel holds the static kinematic and dynamic description of the scene, while MjData carries the time-varying simulation state. The key addition is a leading world dimension: a single MjData object holds the state of N independent simulation instances in parallel, enabling thousands of environments to be stepped in parallel. Model parameters are shared across all worlds by default, and individual fields can be expanded to vary per-world when domain randomization requires it. mjlab further captures the simulation step as a CUDA graph: the kernel execution sequence is recorded once and replayed on subsequent calls, eliminating CPU-side dispatch overhead. Scene pipeline. mjlab constructs scenes by composing entity descriptions defined via MJCF into a single MjSpec . This specification is compiled into an MjModel on the CPU, then transferred to the GPU via MuJoCo Warp’s put_model and put_data routines. Manager-based paradigm. On top of the simulation layer, mjlab adopts the manager-based environment design introduced by Isaac Lab. Users define their environment by composing small, self-contained terms —reward functions, observation computations, domain randomization events—and register them with the appropriate manager. Each manager handles the lifecycle of its terms: calling them at the right point in the simulation loop, aggregating their outputs, and exposing diagnostics. Terms can be plain functions for stateless computations or classes that inherit from ManagerTermBase when they need to cache expensive setup (e.g., resolving regex patterns to joint indices at initialization) or maintain state across steps with a per-episode reset() hook. This abstraction introduces overhead compared to writing monolithic step functions, but benefits in modularity, testability, and rapid iteration outweigh the cost—a lesson reinforced by our experience with the more minimal MuJoCo Playground API, where the absence of such structure made environments harder to maintain and extend. 4 Components mjlab provides a set of core components that managers operate on during the simulation lifecycle. Entities. An entity represents a physical object in the scene, such as robots, manipulated objects, or static fixtures. While Isaac Lab splits this concept across multiple specialized classes ( Articulation , RigidObject , DeformableObject , RigidObjectCollection , and others), mjlab uses a single Entity class that covers all variations through two independent properties: base type (fixed or floating) and articulation (with or without joints). Runtime queries such as is_fixed_base and is_articulated let downstream code branch where needed without requiring a class hierarchy. Each entity maintains an EntityData structure that aggregates kinematic quantities such