Beyond Explanation: Evidentiary Rights for Algorithmic Accountability DOI: XXXXXXX.XXXXXXX Conference: ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montréal, Canada ISBN: 978-1-4503-XXXX-X/26/06 CCS: Human-centered computing Collaborative and social computing systems and tools CCS: Social and professional topics Computing / technology policy
Matthew Stewart · 2026
Read Beyond Explanation: Evidentiary Rights for Algorithmic Accountability DOI: XXXXXXX.XXXXXXX Conference: ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montréal, Canada ISBN: 978-1-4503-XXXX-X/26/06 CCS: Human-centered computing Collaborative and social computing systems and tools CCS: Social and professional topics Computing / technology policy by Matthew Stewart (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22716.txt.
Introduction
Stewart argues that explaining an algorithmic decision is not enough for accountability. A person may hear their risk score yet lack the means to check it. Stewart builds a taxonomy of contest failures, based on 168 legal cases. Most tools fix only opacity, one of five failure modes. Cases without evidence access won just 9 percent of the time. With access, win rates neared 97 percent where no liability shield applied. Stewart proposes evidentiary rights, including tests with changed inputs. The aim is to shift accountability from transparency to procedure.
Catalog record
| CREATOR | Matthew Stewart |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 100633 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22716
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Explanation: Evidentiary Rights for Algorithmic Accountability DOI: XXXXXXX.XXXXXXX Conference: ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montréal, Canada ISBN: 978-1-4503-XXXX-X/26/06 CCS: Human-centered computing Collaborative and social computing systems and tools CCS: Social and professional topics Computing / technology policy Matthew Stewart Abstract . Algorithmic accountability scholarship has focused heavily on explanation, helping affected parties understand why decisions were made. We argue this focus is insufficient. Explanation without evidentiary access does not enable meaningful contestation. A person told “your risk score was 0.73” understands the decision but cannot verify the score, test alternatives, or produce counter-evidence. We introduce a taxonomy of contestation failures, showing that most accountability interventions address only one failure mode (opacity) while leaving four others unaddressed. Drawing on analysis of 168 legal cases spanning algorithmic decision-making contexts, we find that contestation faces a two-gate structure: a procedural gate (evidentiary access) and a doctrinal gate (substantive liability rules). Among litigated cases, those without evidence access almost never succeed (9%); those with access succeed at rates approaching 97% in domains without liability shields. Where doctrinal immunities apply (e.g., Section 230), even full evidentiary scrutiny produces no liability. This association almost certainly reflects selection effects; our empirical contribution is diagnostic rather than causal. The data identify where contestation fails among observable cases, not whether providing access would change outcomes for currently-excluded cases. We propose evidentiary rights as the missing procedural component, and develop counterfactual interrogation rights that allow affected parties to probe decision systems with modified inputs and observe whether outcomes change, without requiring disclosure of model internals. This reframes algorithmic accountability from a transparency problem to a procedural rights problem. 1. Introduction Consider a loan applicant denied credit by an algorithmic system. She receives an explanation: “Your application was denied due to insufficient credit history and high debt-to-income ratio.” This satisfies explanation requirements, but can she contest the decision? Contestation requires more than understanding. She would need to verify her data was accurately assessed, test whether changes would alter the outcome, and compare her treatment to similar applicants. Current frameworks provide none of this, so she understands the decision but cannot challenge it. This paper argues that algorithmic accountability scholarship has conflated explanation (why a decision was made) with contestation (the ability to challenge whether it was correct). You can have perfect explanation with zero contestation capability, which is precisely the situation most frameworks create. Table 1 . Explanation vs. Contestation: Distinct Functions Dimension Explanation Contestation Core question “Why this decision?” “Was it correct?” Information flow One-way (org → person) Interactive (person probes) Control Organization selects content Affected party directs inquiry Evidence type Rationale provided Testable claims verified Assumes Decision is final Decision may be wrong Success metric Recipient understands Recipient can challenge Current coverage High (XAI, GDPR, FCRA) Low (our contribution) Situating the proposal. Legal systems already provide mechanisms for challenging decisions with evidence. Litigation discovery allows parties to compel document production, and administrative procedures require agencies to disclose reasoning. But these mechanisms activate after formal proceedings begin. Our proposal addresses the absence of evidentiary access before litigation, in the administrative appeals, workplace disputes, and platform contexts where most algorithmic contestation occurs. Counterfactual interrogation is not a reinvention of discovery but a pre-litigation mechanism that enables affected parties to generate evidence without filing a lawsuit or hiring counsel. Evidentiary rights can attach to existing enforcement frameworks such as Fair Housing Act testing, CFPB supervision, and GDPR investigations. Where no such framework exists, new legislation or regulatory reinterpretation is needed. The gap. Prior work recognizes limits of explanation-focused approaches ( Edwards and Veale 2017 ; Mulligan and Bamberger 2019 ; Mulligan et al. 2020 ; Kaminski and Malgieri 2021 ) . We build on this foundation with three contributions: (1) a taxonomy of failure modes showing where contestation breaks down; (2) empirical evidence from 168 legal cases revealing a two-gate structure where evidence access is a precondition but not a guarantee; and (3) operational specification of counterfactual interrogation as a procedural mechanism. The evidence. Our survey of 168 legal cases across employment, housing, healthcare, criminal justice, government benefits, credit/insurance, and platform liability in 19 jurisdictions reveals a two-gate structure. At the procedural gate , without evidence access, contestation almost never succeeds, with only 1 of 11 no-access cases (9%) achieving favorable outcomes. At the doctrinal gate , outcomes depend on substantive liability rules. In domains without immunity shields, success rates approach 97% (56 of 58 resolved partial-access cases). But where doctrinal immunities apply, most notably Section 230 for platforms, even full evidentiary examination produces no liability. All six platform cases had full algorithmic scrutiny, and all six were denied on doctrinal grounds. This demonstrates that evidentiary access enables but does not ensure accountability. Our contribution is diagnostic. We identify where contestation systematically fails, not that access causes success. The normative argument rests on procedural fairness, that affected parties deserve the opportunity to present evidence, rather than on causal claims about outcomes. To address this, we propose counterfactual interrogation rights , which allow affected parties to test decisions with modified inputs, observe whether outcomes change, and generate evidence for appeals, all without disclosing model internals. Scope and normative grounding. We focus on consequential algorithmic decisions that produce material adverse effects, including denial of employment, credit, or housing, as well as content removal and account termination. Our normative commitment is that affected parties should be able to meaningfully challenge such decisions ( Tyler 2003 ; Binns 2018 ) . This requires defense, since these domains involve private actors. Three grounds support imposing such obligations. First, existing regulatory precedent : FCRA already requires adverse action disclosures and dispute mechanisms, and ECOA and ADA mandate similar protections. Evidentiary rights extend existing regimes, not create novel obligations. Second, reliance and power asymmetry : when organizations deploy algorithmic systems affecting employment, credit, or housing, affected parties have limited alternatives and substantial reliance interests justifying procedural protections. Third, error correction benefits organizations : evidentiary access reveals system defects otherwise undiscovered, improving decision quality and reducing liability exposure. These grounds do not establish unlimited rights, and graduated implementation (Section 6 ) calibrates access to decision stakes. Why algorithms specifically. Algorithmic decisions warrant evidentiary rights for reasons beyond those justifying scrutiny of human decisions. The first is scale and replicability . Algorithms make identical decisions across thousands of cases, creating verifiable patterns that individual human decisions do not. The second is interrogation limits . Human decisionmakers can be deposed and cross-examined, but algorithms produce no testimony, and without testing access, affected parties have no way to probe the reasoning behind a decision. The third is precision . Algorithmic scores such as 0.73 against a threshold of 0.80 permit exact counterfactual testing in ways that human judgments rarely allow. These features make algorithmic decisions both more amenable to evidentiary testing and more in need of it. Importantly, this does not require disclosing proprietary internals. Counterfactual interrogation provides behavioral testing, not model disclosure, and graduated implementation calibrates access so that high-risk domains warrant mediated access via licensed representatives. 1.1. Related Work We accept that explanation serves legitimate functions ( Lipton 2018 ; Miller 2019 ) but argue it is insufficient for contestation, providing empirical evidence for concerns