Archaeology at SemEval-2026 Task 13: Fine-Tuning Pre-Trained Code Models for AI-Generated Code Detection
Jany-Gabriel Ispas, Sergiu Nisioi · 2026
Read Archaeology at SemEval-2026 Task 13: Fine-Tuning Pre-Trained Code Models for AI-Generated Code Detection by Jany-Gabriel Ispas, Sergiu Nisioi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01596.txt.
Description
Jany-Gabriel Ispas and Sergiu Nisioi, competing as team Archaeology, report their system for a shared task on spotting AI-written code. The SemEval-2026 task asks two things: a binary call on whether code is human or machine written, and, harder, naming which of eleven models wrote it.
Starting from a word-weight baseline, the pair fine-tune four pre-trained code models, each with a strategy fitted to its subtask. For the binary call they hold out one programming language at a time, augment data, and average trimmed scores over chunks with a calibrated threshold. For attribution they pack tokens in a sandwich layout, balance the class loss, and ensemble across seeds with test-time augmentation. Their best entries place sixth of 81 teams on the binary task and seventh of 34 on attribution, a solid showing on a task where style cues are faint.
Catalog record
| CREATOR | Jany-Gabriel Ispas, Sergiu Nisioi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.01596