Beyond Fine-Tuning: In-Context Learning and Chain-of-Thought for Reasoned Distractor Generation
Elaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, [1mm] School of Computing, Macquarie University, Australia · 2026
Read Beyond Fine-Tuning: In-Context Learning and Chain-of-Thought for Reasoned Distractor Generation by Elaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, [1mm] School of Computing, Macquarie University, Australia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17574.txt.
Description
Alhazmi, Sheng, and Zhang explore how language models can generate distractors, plausible wrong options on multiple-choice questions. A distractor must fit the context and mislead test-takers through implicit reasoning, yet they depend on experts. A recent method pairs fine-tuned encoder-decoder models with contrastive learning, but misses how experts reason when picking distractors. The authors test in-context learning with unsupervised semantic retrieval for examples, and design a framework that generates distractors and rationales. Six benchmarks show it at work across varied lengths and domains.
Catalog record
| CREATOR | Elaf Alhazmi, Quan Z. Sheng, Wei Emma Zhang, [1mm] School of Computing, Macquarie University, Australia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81067 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17574