SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing

Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. Acuna · 2026

Read SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing by Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. Acuna (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29468.txt.

Description

Almene De Meran Meguimtsop and colleagues introduce SciIntBench, a benchmark testing language model respect for honesty norms under framing. The benchmark contains 1,350 prompts across 270 cases in ten groups. Each case appears in five levels, from overt to covert prompts, plus a benign one. This measures refusal that shifts with framing and help on requests. 16 paid and open models were tested, judged by language models and checked by humans. Under the most covert framing, models fail to refuse requests for misconduct in 72 percent, with weakest around clarity, copying, and faking.

Catalog record

CREATORAlmene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. Acuna
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46603
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29468

Browse the full library · About the Tower of Babel