ScaleBox: Enabling High-Fidelity and Scalable Code Verification for Large Language Models

Jiasheng Zheng, Xin Zheng, Boxi Cao, Pengbo Wang, Zhengzhao Ma, Qiming Zhu, Jiazhen Jiang, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun · 2026

Read ScaleBox: Enabling High-Fidelity and Scalable Code Verification for Large Language Models by Jiasheng Zheng, Xin Zheng, Boxi Cao, Pengbo Wang, Zhengzhao Ma, Qiming Zhu, Jiazhen Jiang, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27467.txt.

Introduction

Zheng and ten others present ScaleBox, a high-quality, scalable system for checking code made by large language models, for both RL training and tests. It makes and manages special judges, runs test cases at once across nodes, and offers a test suite. Tests show it lifts checking accuracy and speed, and RL trials show gains on LiveCodeBench and stable training, ahead of simple-matching rivals. By supplying a high-throughput setup, it supports better large code training research.

Catalog record

CREATORJiasheng Zheng, Xin Zheng, Boxi Cao, Pengbo Wang, Zhengzhao Ma, Qiming Zhu, Jiazhen Jiang, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28832
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27467

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ScaleBox: Enabling High-Fidelity and Scalable Code Verification for Large Language Models Jiasheng Zheng, Xin Zheng, Boxi Cao, Pengbo Wang, Zhengzhao Ma, Qiming Zhu, Jiazhen Jiang, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun Abstract Code sandboxes have emerged as a critical infrastructure for advancing the coding capabilities of large language models, providing verifiable feedback for both RL training and evaluation. However, existing systems fail to provide accurate verification and efficiency under high-concurrency workloads. We present ScaleBox , a high-fidelity and scalable system designed to address these limitations in large-scale code training. ScaleBox introduces automated special-judge generation and management, fine-grained parallel execution across test cases with seamless multi-node coordination, and a configuration-driven evaluation suite for reproducible benchmarking. A series of experiments demonstrates that ScaleBox significantly enhances code verification accuracy and efficiency. Our further RLVR experiments show that ScaleBox substantially improves both performance on LiveCodeBench and training stability, significantly outperforming heuristic-matching baselines. By providing a reliable and high-throughput infrastructure, ScaleBox 1 1 1 The demonstration video is available at: https://youtu.be/TGW-qxRFb5s . facilitates more effective research and development in large-scale code training. 1 Introduction Figure 1: Comparison between Exact Match and Special Judge evaluation. Large Language Models (LLMs) have achieved substantial advances in code intelligence ( 42 ; 39 ) , reshaping code agents and automated software engineering ( 11 ; 35 ; 17 ; 20 ) . A central enabler of this progress is the code sandbox ( 16 ; 23 ; 22 ) , an essential infrastructure that provides executable ground-truth feedback for both evaluation and Reinforcement Learning from Verifiable Rewards (RLVR). In this paradigm, the accuracy and throughput of sandbox feedback have become key bottlenecks for evaluation reliability and training efficiency. However, when scaling to large-scale code training, existing sandbox systems exhibit substantial deficiencies in both verification accuracy and efficiency. First, current systems suffer from a verification accuracy gap due to their excessive reliance on exact match (EM) or heuristic-based matching evaluation ( 7 ; 12 ; 3 ) . Such mechanisms incorrectly assume a single canonical output, ignoring tasks with multiple valid solutions or precision requirements (Figure 1 ). Our analysis of 34,757 problems reveals that 14.57% of tasks require specialized verification (Special Judges), and 59.01% of their correct solutions are falsely rejected by EM. This misclassification injects significant noise into learning signals, leading to biased gradients and suboptimal convergence. Second, existing code verification pipelines suffer from a critical efficiency bottleneck . Most systems employ static deployment and coarse-grained task scheduling ( 7 ; 13 ) , hindering horizontal scaling in multi-node clusters. This leads to a severe computational asymmetry: accelerators (e.g., GPUs and NPUs) are heavily utilized while host processors remain underused for parallel code execution and testing, leading to host–accelerator imbalance that limits throughput and scalability in large-scale training. To this end, we present ScaleBox , a high-fidelity and scalable sandbox system engineered for large-scale code RLVR training and evaluation. First, ScaleBox introduces an automated synthesis and management mechanism for special judges, together with a unified verification framework. This design enables adaptive judgment logic, substantially fortifying the accuracy and stability of rewards. Second, ScaleBox implements hybrid parallelism at both the instance and unit-test levels, along with seamless multi-node deployment. Controlled via a centralized web-based dashboard, the system supports hot-update operations across distributed clusters, as well as real-time resource and log monitoring, thereby fully leveraging idle CPU resources for high-throughput execution. Third, ScaleBox provides a configuration-driven evaluation suite supporting major code benchmarks, offering the research community a stable, efficient, and reproducible evaluation platform. A series of experiments demonstrates that ScaleBox significantly enhances both verification accuracy and efficiency. Accuracy evaluation on AetherCode ( 36 ) reveals that our synthetic special judges achieve over 84% per-solution precision, indicating high-fidelity verification. Efficiency evaluation shows that ScaleBox achieves a 59% speedup over verl’s native execution and exhibits substantial throughput scalability across multi-node clusters. To further assess its practical impact, we conduct RLVR training using ScaleBox as the verification backbone. Experimental results show that the high-fidelity feedback provided by ScaleBox substantially reduces reward noise, leading to significant improvements in training performance and stability. Specifically, Qwen3-8B ( 38 ) trained with ScaleBox achieves substantial performance gains on the widely used LCB-V5 and LCB-V6 benchmarks ( 19 ) , significantly outperforming heuristic-matching baselines. Our main contributions are summarized as: • We propose ScaleBox , a high-fidelity and scalable system designed to enhance verification accuracy and efficiency for large-scale code training and evaluation. • We develop a configuration-driven evaluation framework supporting major code benchmarks to streamline assessment workflows. • Experiments show that ScaleBox significantly improves verification accuracy and efficiency, leading to better performance and stability in RLVR training. 2 Related Works 2.1 Reinforcement Learning with Verifiable Rewards Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing LLM reasoning via objective feedback ( 16 ) . While discussions continue regarding whether RL elicits latent behaviors or expands intrinsic capabilities ( 41 ) , recent empirical evidence suggests that RLVR can synthesize novel strategies surpassing distillation-based limits ( 37 ; 28 ; 6 ) . To ensure stable policy scaling and prevent entropy collapse ( 10 ) , algorithms like DAPO ( 40 ) , Dr. GRPO ( 30 ) , and GSPO ( 43 ) introduce diversity-preserving and bias-correction mechanisms. However, the efficacy of these methods is strictly bounded by the fidelity and scalability of the verification signal ( 29 ; 4 ) . Although tool-augmented ( 14 ) and reasoning-augmented approaches ( 44 ) have been proposed, providing high-fidelity judgment for RL training remains a critical frontier. 2.2 Code Execution Environment The emergence of RLVR in the code domain demands execution environments that provide both high-throughput scaling and high-precision reward generation. However, existing systems remain fragmented. MultiPL-E ( 3 ) pioneered large-scale multi-language evaluation, but its offline execution is unsuitable for the iterative feedback loops required in RL. While recent works like SandboxFusion ( 7 ) and MPLSandbox ( 12 ) introduce RL integration for training, they lack either the distributed infrastructure for high-throughput scaling or the specialized judging logic necessary for generating the precise, verifiable rewards that RLVR depends on. Conversely, systems like Judge ( 15 ) prioritize evaluation accuracy through special judges but lack RL compatibility and scalability. ScaleBox fills this critical gap by providing a scalable sandbox system that simultaneously optimizes for efficiency and accuracy to support the full lifecycle of RLVR. Figure 2: Overview of the ScaleBox Architecture. A distributed architecture featuring NGINX load balancing, test-case parallelism, and unified verification with special judge support, optimized for high-throughput and reproducible code training and evaluation. 3 Preliminary Study: The Fragility of Exact Match Evaluation Current code execution frameworks predominantly rely on Exact Match (EM) of string outputs to verify program correctness ( 12 ; 7 ) . While computationally efficient, EM fails to capture the semantic correctness of tasks where multiple valid representations exist. For instance, problems involving multiple valid outputs (e.g., “output any valid sequence”) or floating-point arithmetic (with precision tolerances) are inherently incompatible with string-based evaluation. To quantify this misalignment, we perform a systematic study of the PrimeIntellect ( 31 ) dataset, covering 34,757 Python problems. We use Qwen3-235B ( 38 ) to determine whether each problem

Read the complete text