Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms

Meghana Bhange, Ulrich Aïvodji, Elliot Creager · 2026

Read Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms by Meghana Bhange, Ulrich Aïvodji, Elliot Creager (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27689.txt.

Introduction

Meghana Bhange, Ulrich Aivodji, and Elliot Creager propose test-time collective action, letting user groups correct algorithmic harms without platform retraining. The collective pools query access to build a proxy of the platform, then tune a per-class universal perturbation that each member applies at submission time. Small collectives narrow most of the subgroup accuracy gap and carry across architectures, improving worst-group accuracy.

Catalog record

CREATORMeghana Bhange, Ulrich Aïvodji, Elliot Creager
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60279
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27689

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms Meghana Bhange, Ulrich Aïvodji, Elliot Creager Abstract When machine learning systems under-perform for particular subgroups, affected users typically have no way to correct these disparities without relying on platform-level fixes. Existing approaches to algorithmic fairness rely on provider-centric approaches to correct these failures, leaving users with no external lever when faced with harm. Recent work in Algorithmic Collective Action shows that coordinated users can steer an algorithmic system toward a collective goal, but the existing mechanisms require the provider to retrain on the collective’s modified data which users may not have control over. We propose Test-Time Collective Action (TTCA) , a framework through which a group of users who share query access to the platform, can correct disparities affecting under-served subgroup without participating in the platform’s training loop. We implement this through a proxy-based mechanism where the collective pools query access to a black-box API to extract a proxy of the platform, then optimizes a per-class universal perturbation against the proxy. Each member applies this perturbation to their own inputs at submission time, requiring no cooperation from the platform. We empirically evaluate the mechanism on CIFAR-10, CIFAR-100, and FairFace, showing that modestly-sized collectives close most of the subgroup accuracy gap, transfer across architectures (a small proxy can attack a larger platform), and improve worst-group accuracy, equal-opportunity gap, and disparate impact. A query-budget analysis comparing a per-user black-box attack baseline shows that pooling is cheaper than each subgroup member attacking alone. Test-time collective action thus offers corrective intervention to users when platform-side remediation is unavailable or delayed. 1 Introduction Figure 1 : Test-Time Collective Action (TTCA) . Top : members pool their per-user query budgets to query the platform with a public image pool \mathcal{D}_{\mathrm{pub}} , then train a collective proxy on the resulting query–response pool \mathcal{D}_{\mathrm{proxy}} , where the proxy boundary tries to approximate platform boundary. The collective optimizes a per-class perturbation \delta_{y} against it. Bottom : at test-time, each member of the under-served subgroup applies \delta_{y} to their own input x , sending x+\delta_{y} to the platform in place of x . Figure 2 : Per-class accuracy before and after the perturbation: Test-time collective action helps the affected subgroup (defined here as bottom-10% under-performing classes, but can alternatively include user demographics where available) for both balanced and unbalanced platform training regimes, without participating in the platform’s training loop (subgroup selection and dataset regimes are defined in § 4.3 and § 4.4 respectively). The plot shows CIFAR-100 classes plotted in balanced-platform subgroup accuracy, unbalanced-platform subgroup accuracy coordinates. Left : bottom-10% classes on the balanced platform ( \bullet ) move rightward after applying \delta_{y} , improving subgroup accuracy for balanced-platform regime. Right : deliberately under-represented classes on the unbalanced platform regime ( \bullet ) move upward after \delta_{y} . Other classes (gray) stay near the y=x diagonal in both panels, so the perturbation acts as corrective recourse for the targeted subgroup rather than as a system-wide attack. Machine learning systems can exhibit performance disparities across different user groups, with documented examples in computer vision ( 5 ) , safety features of language models ( 7 ) and automated speech recognition ( 24 ) . 35 describe such failures as quality-of-service (QoS) harms. When users encounter these harms, provider-centric fairness interventions such as pre-processing, in-processing, and post-processing methods are commonly used to address them ( 6 ) . This could be considered reasonable if platforms are willing to act towards reducing these harms; however, when remediation is unavailable, it leaves affected users with no lever of their own to address the situation. Recent work in Protective Optimization Technologies ( 26 ) and Algorithmic Collective Action ( 15 ) identifies promising avenues for user-side interventions that allow affected users to regain agency in machine learning systems. Algorithmic Collective Action ( 15 ) shows how even a small, organized collective can have an out-sized effect in steering a platform’s outputs in the collective’s favor. However, these mechanisms require the platform to re-train on user contributions, a condition that users rarely have control over in real-world settings. 32 also discusses this limitation by showing that data poisoning-style interventions, as user-side protections, do not always work because providers can train on data collected before an attack was discovered, or simply wait for a more robust model before processing poisoned data. Hence, it is important for users to also have methods for taking corrective action at test time. In this work, we explore a test-time method that allows a group of users to pool their data contributions to generate a perturbation that mitigates the algorithmic harms of a frozen black-box model using only API query access. The high-level pipeline is shown in Figure 1 . which involves extracting a collective proxy from pooled queries, then applying the resulting perturbation at test-time. 35 define algorithmic harms as adverse experiences arising from the interaction between technical system components and societal power dynamics (we refer the reader to their survey for a full taxonomy on algorithmic harm). This work focuses on quality-of-service (QoS) harms , in which a system disproportionately under-performs for particular groups while maintaining strong performance for others. We focus on two regimes which could be the source of disparity: (i) a balanced (or entire) platform , where the platform sees the full training distribution and the under-served subgroup is whichever groups the model happens to perform worst on, and (ii) an unbalanced platform , where a controlled fraction of groups is deliberately under-sampled before training so that the under-served subgroup is the one the platform was systematically under-trained on. In both cases, the collective’s goal is to close the accuracy gap on the affected subgroup without degrading performance for other groups. In both settings, we assume that affected users are non-adversarial with respect to the platform’s task objective and their goal is to attain the same quality of service that the rest of the population already receives. We assume scenarios in which the model is broadly useful to users but fails to deliver comparable performance or utility to a particular subgroup due to data imbalance or even deployment choices. Our framing thus treats this collective intervention as a form of a corrective action for unequal outcomes when platform-side remediation is unavailable or delayed. As an example of this setting, consider a user-driven photo-sharing platform deploys an image classifier that auto-tags every uploaded image and feeds those tags into its search and recommendation systems. The tool is broadly useful for users: most users’ photos surface for the searches they should, reach an audience whose interests match. But for some users, the classifier produces systematically more errors than it does for the rest of the user base. The affected users do not want to break the search for the rest of the platform; they want their content surfaced as fairly as everyone else’s. We study this setting empirically on standard image-classification benchmarks throughout this paper and evaluate the feasibility of such an intervention. Figure 2 shows the intervention in action on CIFAR-100 across both balanced and unbalanced platform training where a single per-class perturbation considerably improves the accuracy of the worst-off subgroup without disturbing the rest of the label space.

Read the complete text