Which Tokens Need Context? A Reference-Based Analysis of Translation Responsibility Using Fertility and Entropy
Ramakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal · 2026
Read Which Tokens Need Context? A Reference-Based Analysis of Translation Responsibility Using Fertility and Entropy by Ramakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29489.txt.
Description
Appicharla, Gain, Pal, and Ekbal ask which words in a translation truly need the surrounding sentences. Human translators lean on context for pronouns and helper verbs, while names and concrete nouns mostly stand alone. Existing ways to study this rely on special test sets or on opening up one model's internals, so they stay narrow or model-bound.
The team builds a post-hoc framework, meaning it analyses finished translations without touching any model. Two measures come from word alignments: fertility, how many target words each source word produces, and entropy, how stable those patterns stay across contexts. They study three language pairs under four context conditions, using human reference translations. Context shifts generative responsibility from source words to context words without changing overall fertility. The largest fertility drops appear in function words, while content words stay stable. Context, they conclude, resolves ambiguity rather than adding new information.
Catalog record
| CREATOR | Ramakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29489