GHGbench: A Unified Multi-Entity, Multi-Task Benchmark for Carbon Emission Prediction

Yifan Duan, Siyuan Zheng, Lihuan Li, Chao Xue, Flora Salim, [email protected] · 2026

Read GHGbench: A Unified Multi-Entity, Multi-Task Benchmark for Carbon Emission Prediction by Yifan Duan, Siyuan Zheng, Lihuan Li, Chao Xue, Flora Salim, [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13743.txt.

Introduction

Yifan Duan and four colleagues offer GHGbench, an open data set and benchmark covering company- and building-level carbon guesses. The building track merges 491,591 building-year records from 13 sources into one schema across 26 city areas, with climate factors and multi-sense remote-sensing codes. Three findings emerge: building outputs are by design harder than company outputs. The in-to-out gap dwarfs within-model gaps, and multi-sense codes help exactly where tabular carry-over breaks.

Catalog record

CREATORYifan Duan, Siyuan Zheng, Lihuan Li, Chao Xue, Flora Salim, [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE119725
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13743

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GHGbench: A Unified Multi-Entity, Multi-Task Benchmark for Carbon Emission Prediction Yifan Duan, Siyuan Zheng, Lihuan Li, Chao Xue, Flora Salim, [email protected] Abstract Open datasets and benchmarks for entity-level carbon-emission prediction remain fragmented across access, scale, granularity, and evaluation. We introduce GHGbench , an open dataset and benchmark for company- and building-level greenhouse-gas prediction. The company track contains 32,000+ company-year records from 12,000+ firms with Scope 1+2 and Scope 3 disclosures and financial/sectoral signals; the building track harmonises 491,591 building-year records from 13 open sources into a single schema across 26 metropolitan areas (10 U.S., 15 Australian, 1 Singaporean), with climate covariates and multimodal remote-sensing embeddings. GHGbench defines canonical splits with in-distribution and cross-region/city transfer as primary tasks and temporal hold-out plus short-horizon forecasting as supplementary appendix evidence; headline baselines span gradient-boosted trees, a tabular foundation model, MLP, FT-Transformer, and multimodal fusion, with an LLM panel as auxiliary , all evaluated under multi-seed paired-bootstrap tests. Three benchmark-level findings emerge: (i) building emissions are structurally harder than company emissions ; (ii) the in-distribution to out-of-distribution gap dwarfs any within-model gap across both the company track and the building track, and a tabular foundation model is, to our knowledge, the first baseline to open a paired-bootstrap-significant gap over tuned trees on a multi-city building-emissions task; (iii) multimodal remote-sensing embeddings help precisely where tabular generalisation breaks . GHGbench also exposes catastrophic city transfer and the sector-factor lookup ceiling as systematic failure modes. Code and reconstruction recipes are available at GHGbench . 1 Introduction Global commitments to net-zero greenhouse-gas (GHG) emissions have made quantitative emission prediction a practical requirement for climate policy [ 23 ] , finance [ 6 ] , and urban operations [ 10 ] . Although emissions accounting has long been a policy concern [ 41 ] , machine-learning-based entity-level prediction is still an emerging area [ 34 ] , and the open benchmarking ecosystem has not caught up [ 29 ] . Company-level studies often rely on licensed disclosure or financial feeds [ 30 , 35 ] , while building-level data remain scattered across city portals with incompatible schemas [ 44 , 26 ] . As a result, it remains difficult to compare models on open, reproducible, entity-level tasks that reflect the geographic, temporal, and schema shifts encountered in real emissions-accounting workflows. Existing approaches cluster into three lines of work, each with structural limits. Company-level studies show that financial, sectoral, and disclosure features can predict Scope 1/2 and Scope 3 emissions, but they often depend on licensed feeds such as CDP, Bloomberg, Refinitiv, or Compustat [ 30 , 21 , 35 , 29 ] . Building-energy and operating-carbon benchmarks provide valuable data, but are typically limited by geography, incompatible public schemas, or non-reusable splits [ 27 , 15 , 44 , 26 ] . Sector-level emission-factor resources support enrichment, but aggregate above the firms and buildings where predictions are needed [ 36 , 19 , 20 ] . These limitations motivate a benchmark that evaluates company and building emissions under shared tasks, canonical splits, metrics, and uncertainty reporting. To address this gap, we introduce GHGbench , to our knowledge the first open dataset and benchmark to jointly evaluate company- and building-level carbon-emission prediction under a shared task suite that spans in-distribution regression, cross-region/city transfer, short-horizon forecasting, and multimodal fusion, with paired-bootstrap uncertainty reporting on the headline structured-baseline comparisons. The company track evaluates Scope 1+2 and Scope 3 emissions from corporate disclosures enriched with financial and sectoral signals, released through reconstruction recipes that respect source-data terms. The building track harmonises 491,591 building–year records from 13 open sources across 26 metropolitan areas in the United States, Australia, and Singapore, with unified units, property types, coordinates, and annual GHG targets. Across both tracks, GHGbench provides canonical splits, shared metrics, and uncertainty reporting, while auxiliary weather and satellite-derived signals [ 28 , 14 ] support multimodal evaluation. Figure 1 summarises this flow. Figure 1 : GHGbench overview. Left: fragmented emissions resources. Middle: harmonised company + building records with climate and satellite signals. Right: canonical tasks, metrics, and uncertainty protocols. Specifically, the company track starts from public corporate greenhouse-gas disclosures: we normalise identifiers and units, construct Scope 1+2 and Scope 3 panels with deduplication and outlier filtering, and enrich each company-year with financial fields, sectoral emission factors, sub-sector target encoding, and business-summary text for LLM baselines, producing matched wide and strict feature regimes. The building track harmonises 13 public disclosure sources into one schema with a canonical 22-category property taxonomy, per-building-year NASA POWER [ 28 ] climate covariates, geocoded coordinates, and Sentinel-2 [ 14 ] + Clay multimodal embeddings, yielding 491,591 building-year rows from 100,984 buildings. Both tracks share a multi-task suite spanning in-distribution regression, cross-region/city transfer, temporal hold-out, cross-property-type stress testing, and short-horizon forecasting; we evaluate tuned gradient-boosted trees, TabPFN v2 [ 22 ] , MLP, FT-Transformer [ 17 ] , time-series foundation models [ 1 , 11 , 40 ] , and an LLM panel under multi-seed runs, bootstrap confidence intervals, and 1000-resample paired bootstrap on shared test rows. Three benchmark-level findings emerge. (i) Building emissions are structurally harder than company emissions : companies are dominated by firm size, while building emissions also depend on occupancy, runtime, and behaviour that public disclosure does not capture. (ii) The in-distribution to out-of-distribution gap dwarfs any within-model gap on both tracks ; on the harder building OOD setting, a pretrained tabular foundation model is, to our knowledge, the first baseline to open a paired-bootstrap-significant gap over tuned trees on a real-world, multi-city, multi-source benchmark. (iii) Multimodal remote-sensing embeddings help precisely where tabular generalisation breaks : a no-op in-distribution, measurable gain on cross-city transfer. The benchmark also exposes systematic failure modes (catastrophic city transfer and the sector-factor lookup ceiling) that mark where deep, multimodal, and foundation models must improve next. Our contributions are: (i) an open dataset and benchmark with 32,000+ company-year records reconstructable from free public APIs and 491,591 harmonised building-year records across 26 metros in three countries; (ii) a multi-task suite with canonical splits for in-distribution, temporal, cross-region/city, cross-property-type, and forecasting evaluation, aligned climate and remote-sensing signals, and a paired-bootstrap protocol; (iii) three benchmark-level findings (cross-entity difficulty asymmetry, ID-to-OOD gap dominating within-model variation, and multimodal embeddings helping where tabular generalisation breaks); and (iv) an open-source release with code, data, and a one-command quickstart kit. 2 Related Work Company-level emissions prediction and ESG disclosure. Machine-learning approaches to corporate emissions estimation have largely focused on company-level financial, sectoral, and ESG features. Prior work estimates Scope 1+2 emissions from firm attributes and disclosure-linked financial data [ 30 , 21 , 4 ] , extends prediction to Scope 3 categories [ 42 , 35 ] , and documents the large divergence among commercial Scope 3 providers [ 29 ] . A related line estimates emissions through sector classification: EXIOBASE input–output factors [ 36 ] are packaged as ML-ready benchmarks in ExioML [ 19 ] , while GREEN/ExioNAICS [ 20 ] maps free-text company descriptions to NAICS sectors. Corporate climate text has also become an NLP target, including ClimateBERT [ 39 ] , GHG-extraction benchmarks [ 5 ] , and open LLM-finetuning corpora [ 31 ] . These studies typically isolate one target family, one data source, or one text-extraction task;

Read the complete text