Humains-Junior: A 3.8B Language Model Achieving GPT-4o-Level Factual Accuracy by Directed Exoskeleton Reasoning

Nissan Yaron, Dan Bystritsky, Ben-Etzion Yaron · 2025

Read Humains-Junior: A 3.8B Language Model Achieving GPT-4o-Level Factual Accuracy by Directed Exoskeleton Reasoning by Nissan Yaron, Dan Bystritsky, Ben-Etzion Yaron (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25933.txt.

Description

Nissan Yaron, Dan Bystritsky, and Ben-Etzion Yaron present a small language model that they report matches a much larger model on factual grounding. Their model, named Humains-Junior in the record, has three point eight billion parameters and is tested on the FACTS Grounding public set, which checks whether answers stay tied to given sources. They compare it with GPT-4o under the same judges on five hundred questions.

Scores for the two models differ by less than one percentage point, and a formal equivalence test passes at a five point margin. Their method adds directed reasoning scaffolds, called exoskeleton reasoning, plus fine tuning that teaches protocol discipline rather than facts. The two parts together gave a large gain and lower variance.

Catalog record

CREATORNissan Yaron, Dan Bystritsky, Ben-Etzion Yaron
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-25933

Browse the full library · About the Tower of Babel