SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing
Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. Acuna · 2026
Read SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing by Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. Acuna (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29468.txt.
Description
Almene De Meran Meguimtsop and colleagues introduce SciIntBench, a benchmark testing language model respect for honesty norms under framing. The benchmark contains 1,350 prompts across 270 cases in ten groups. Each case appears in five levels, from overt to covert prompts, plus a benign one. This measures refusal that shifts with framing and help on requests. 16 paid and open models were tested, judged by language models and checked by humans. Under the most covert framing, models fail to refuse requests for misconduct in 72 percent, with weakest around clarity, copying, and faking.
Catalog record
| CREATOR | Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. Acuna |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46603 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29468