Reproducing FACTER: Fairness via Conformal Thresholding and Prompt Repair
Oscar Miró López-Feliu [email protected] of Amsterdam, Daimy van Loo [email protected] of Amsterdam, Xanthos Kekkos [email protected] of Amsterdam Mikel Blom [email protected] of Amsterdam Clara Rus [email protected] of Amsterdam · 2026
Read Reproducing FACTER: Fairness via Conformal Thresholding and Prompt Repair by Oscar Miró López-Feliu [email protected] of Amsterdam, Daimy van Loo [email protected] of Amsterdam, Xanthos Kekkos [email protected] of Amsterdam Mikel Blom [email protected] of Amsterdam Clara Rus [email protected] of Amsterdam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28620.txt.
Description
Oscar Miró López-Feliu, Daimy van Loo, Xanthos Kekkos, Mikel Blom, and Clara Rus conducted this reproducibility study of FACTER. The framework promises fair, statistically covered recommendations from language models by setting conformal thresholds and repeatedly repairing its own prompts. Reproduction matters because the original report left its target-set scoring underspecified.
Under a strict reproduction, the team finds recommendation utility diverging from the original report, and traces the gap to that underspecification. In a constrained re-ranking variant, where the candidate set is fixed, FACTER does cut adaptive-threshold violations. But the cuts do not consistently show up under fixed thresholds or global fairness metrics. A static fairness instruction matched the dynamic repair loop's parity outcomes, suggesting the online loop adds little here, a useful deflation of an appealing device.
Catalog record
| CREATOR | Oscar Miró López-Feliu [email protected] of Amsterdam, Daimy van Loo [email protected] of Amsterdam, Xanthos Kekkos [email protected] of Amsterdam Mikel Blom [email protected] of Amsterdam Clara Rus [email protected] of Amsterdam |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28620