Deep Learning-Accelerated Shapley Value for Fair Allocation in Power Systems: The Case of Carbon Emission Responsibility PubID: pubid:

Yuanhao Feng, Tao Sun, Yan Meng, Xuxin Yang, Donghan Feng · 2025

Read Deep Learning-Accelerated Shapley Value for Fair Allocation in Power Systems: The Case of Carbon Emission Responsibility PubID: pubid: by Yuanhao Feng, Tao Sun, Yan Meng, Xuxin Yang, Donghan Feng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01229.txt.

Introduction

Yuanhao Feng and colleagues make the Shapley value practical for power systems. The Shapley value divides costs or responsibilities fairly among participants by averaging each one's marginal contribution, but computing it exactly explodes combinatorially, which kept it to small systems. Their test case is allocating carbon emission responsibility across a power network.

Their framework, SurroShap, pairs efficient coalition sampling with deep learning surrogate models that cheaply evaluate what each coalition would emit. They prove time averaged allocations converge to within a stated tolerance of the exact values. On nine systems, up to nearly two thousand entities, the method finished inside real time operational windows. It ran ten thousand to one hundred thousand times faster than other sampling methods. Year long simulations on a Texas sized grid confirmed real world use.

Catalog record

CREATORYuanhao Feng, Tao Sun, Yan Meng, Xuxin Yang, Donghan Feng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01229

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deep Learning-Accelerated Shapley Value for Fair Allocation in Power Systems: The Case of Carbon Emission Responsibility PubID: pubid: Yuanhao Feng, Tao Sun, Yan Meng, Xuxin Yang, Donghan Feng Abstract Allocating costs, benefits, and emissions fairly among power system participant entities represents a persistent challenge. The Shapley value provides an axiomatically fair solution, yet computational barriers have limited its adoption beyond small-scale applications. This paper presents SurroShap, a scalable Shapley value approximation framework combining efficient coalition sampling with deep learning surrogate models that accelerate characteristic function evaluations. Exemplified through carbon emission responsibility allocation in power networks, SurroShap enables Shapley-based fair allocation for power systems with thousands of entities for the first time. We derive theoretical error bounds proving that time-averaged SurroShap allocations converge to be ε \varepsilon -close to exact Shapley values. Experiments on nine systems ranging from 26 to 1,951 entities demonstrate completion within the real-time operational window even at maximum scale, achieving 10 4 − 10 5 10^{4}-10^{5} × speedups over other sampling-based methods while maintaining tight error bounds. The resulting Shapley-based carbon allocations possess six desirable properties aligning individual interests with decarbonization goals. Year-long simulations on the Texas 2000-bus system validate real-world applicability, with regional analysis revealing how renewable-rich areas offset emission responsibility through exports while load centers bear responsibility for driving system-wide generation. I Introduction Fair allocation of costs, benefits, emissions, and resources among diverse entities in power systems has been a long-standing challenge [ 1 ] . As the power industry undergoes transformative changes such as energy transition, market deregulation, and distributed generation proliferation, the number of participating entities has expanded dramatically [ 2 ] . This includes not only traditional generators and utilities but also prosumers, aggregators, virtual power plants, and energy communities [ 3 , 4 ] , making fair allocation among these diverse and numerous entities increasingly complex yet critical for system operation and market efficiency. The Shapley value represents the game-theoretic gold standard for fair allocation, determining each entity’s contribution by averaging their marginal impact across all possible coalitions [ 5 ] . This solution concept has demonstrated its versatility across diverse application domains, ranging from infrastructure and business operations such as telecommunications cost-sharing [ 6 ] , risk capital allocation [ 7 ] , and supply chain profit distribution [ 8 ] , to its recent emergence as a fundamental tool for feature importance quantification in explainable artificial intelligence [ 9 ] . The Shapley value’s reputation for fairness stems from its unique position as the only allocation method simultaneously satisfying four fundamental axioms: efficiency, symmetry, additivity, and dummy player [ 10 ] . However, implementing Shapley values for complex real-world systems faces a critical computational barrier: calculating exact values requires evaluating all 2^{n} possible coalitions, making the method intractable beyond modest entity counts. To address this exponential complexity, researchers have developed various approximation strategies. Early work introduced Monte Carlo sampling of random permutations to estimate marginal contributions [ 11 ] . Subsequent advances improved convergence through stratified [ 12 ] and quasi-Monte Carlo [ 13 ] methods, alongside tailored allocation strategies including Neyman allocation [ 14 ] and empirical Bernstein sampling [ 15 ] . The recent surge in explainable AI has catalyzed development of sophisticated approximation methods such as Kernel SHAP [ 16 ] , Leverage SHAP [ 17 ] , and Gradient SHAP [ 18 ] , enabling efficient Shapley value computation for high-dimensional machine learning models. In power systems, Shapley value and its computationally efficient approximations have found diverse applications including congestion cost allocation [ 19 ] , network loss distribution [ 20 , 21 ] , generation start-up cost sharing [ 22 ] , energy community benefit distribution [ 23 , 1 , 24 ] , microgrid cost allocation [ 25 ] , demand response and virtual power plant profit distribution [ 26 , 27 , 28 ] , transmission expansion cost and benefit allocation [ 29 , 30 ] , and carbon emission responsibility (CER) assignment [ 31 ] . However, these Shapley-based allocations have been predominantly limited to small-scale systems: most implementations involve fewer than 20 entities [ 22 , 23 , 24 , 25 , 27 , 28 , 29 , 30 , 31 , 19 , 26 ] , with only a few reaching several dozen entities [ 20 , 21 ] . A rare exception is [ 1 ] , which handles 200 entities but relies on application-specific consumer clustering to reduce the actual number of entities being allocated. This scalability limitation stems from a unique computational challenge in power system allocations beyond coalition explosion: determining each coalition’s characteristic function often requires solving optimization problems, equilibrium computations, or systems of equations [ 32 ] . For instance, CER allocation requires solving an optimal power flow (OPF) for each coalition to determine generation dispatch and resulting emissions; generation start-up cost sharing necessitates security-constrained unit commitment optimization; and transmission planning cost allocation demands solving models that minimize operational and investment costs. While solving a single such problem is computationally trivial, Shapley value computation for larger systems can require evaluating tens or even hundreds of millions of coalitions, creating a compound computational barrier that has restricted practical implementations to small-scale systems even when efficient sampling techniques are employed. We propose SurroShap, a novel approximation method for Shapley allocations in power systems that synergistically combines KernelSHAP’s efficient coalition sampling [ 33 ] with deep neural network surrogate models that rapidly approximate characteristic function evaluations, addressing both computational barriers simultaneously. We demonstrate this approach through CER allocation among generators and loads in power networks, where the characteristic function (total system carbon emissions) normally requires solving an OPF. The proposed framework readily extends to other power system allocation problems by training appropriate surrogate models for their respective characteristic functions. This paper makes two primary contributions. First, we enable accurate Shapley value-based fair allocation for large-scale power systems, achieving speedups of tens of thousands of times compared to existing sampling-based methods and completing allocation for thousands of entities within the 5-minute real-time operational window. Second, we advance fair CER allocation, which is critical for climate change mitigation, by providing fairness benchmarks for existing methods (carbon emission flow [ 34 , 35 ] , marginal carbon intensity [ 36 ] , Aumann-Shapley [ 37 , 38 ] ) and scaling Shapley-based CER allocation from dozens to thousands of entities, enabling deployment in real-world power systems. The remainder of this paper is organized as follows. Section II formulates the fair CER allocation problem using Shapley values. Section III presents the SurroShap methodology, including its theoretical error bounds. Section IV provides comprehensive case studies across multiple systems. Section V concludes the paper and discusses future research directions. II Fair allocation of carbon emission responsibility II-A Problem Formulation This paper studies the problem of allocating the responsibility of carbon emissions from power generation among all generators and loads in the power network in a fair manner based on the Shapley value [ 5 ] , the well-recognized fair allocation method from cooperative game theory. The premise of such allocation is that carbon emissions are not merely the responsibility of generators themselves but also of loads, as electricity consumption is the ultimate driver

Read the complete text