Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning

NVIDIA · 2025

Read Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning by NVIDIA (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-20848.txt.

Description

NVIDIA's large team presents Nemotron 3 Nano, an open language model built for agent-style reasoning. The design mixes two architectures, Mamba and Transformer, and a mixture-of-experts layout that wakes only part of the network per pass. Training used twenty-five trillion text tokens, then fine-tuning and reinforcement learning across many task settings.

The model beats its predecessor, Nemotron 2 Nano, on accuracy while activating under half the parameters each step. Throughput runs more than three times higher than similar open rivals, and context can stretch to a million tokens. Both base and post-trained versions are released openly on Hugging Face for others to use and study.

Catalog record

CREATORNVIDIA
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-20848

Browse the full library · About the Tower of Babel