AICD Bench: A Challenging Benchmark for AI-Generated Code Detection

Daniil Orel, Dilshod Azizov, Indraneil Paul, Yuxia Wang, Iryna Gurevych, Preslav Nakov · 2026

Read AICD Bench: A Challenging Benchmark for AI-Generated Code Detection by Daniil Orel, Dilshod Azizov, Indraneil Paul, Yuxia Wang, Iryna Gurevych, Preslav Nakov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02079.txt.

Description

Daniil Orel and colleagues offer AICD Bench, the biggest AI-made code benchmark, spanning 2M cases, 77 models, 11 groups, 9 codes. Large language models write working source code, raising credit and security concerns, while older benchmarks are narrow, limited to binary sorting. Beyond scale, AICD Bench adds three real tasks: robust binary sorting under shifts; model family credit by design lineage; and fine-grained sorting of human, machine, and hybrid code. Tests on neural and older tools show scores far below real use, notably for hybrid or hostile code.

Catalog record

CREATORDaniil Orel, Dilshod Azizov, Indraneil Paul, Yuxia Wang, Iryna Gurevych, Preslav Nakov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60112
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.02079

Browse the full library · About the Tower of Babel