Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
NVIDIA · 2025
Read Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning by NVIDIA (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-20848.txt.
Description
NVIDIA's large team presents Nemotron 3 Nano, an open language model built for agent-style reasoning. The design mixes two architectures, Mamba and Transformer, and a mixture-of-experts layout that wakes only part of the network per pass. Training used twenty-five trillion text tokens, then fine-tuning and reinforcement learning across many task settings.
The model beats its predecessor, Nemotron 2 Nano, on accuracy while activating under half the parameters each step. Throughput runs more than three times higher than similar open rivals, and context can stretch to a million tokens. Both base and post-trained versions are released openly on Hugging Face for others to use and study.
Catalog record
| CREATOR | NVIDIA |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-20848