ZeroCoder: Can LLMs Improve Code Generation Without Ground-Truth Supervision? DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06

Lishui Fan, Mouxiang Chen, Tingwei Zhu, Kui Liu, Xin Xia, Shanping Li, Zhongxin Liu · 2026

Read ZeroCoder: Can LLMs Improve Code Generation Without Ground-Truth Supervision? DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 by Lishui Fan, Mouxiang Chen, Tingwei Zhu, Kui Liu, Xin Xia, Shanping Li, Zhongxin Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-07864.txt.

Introduction

Fan and six colleagues present ZeroCoder, a way to improve code generation without ground-truth supervision. Reinforcement learning with verifiable rewards normally depends on costly human-curated tests, and self-generated tests often lack the power to discriminate good code from bad. ZeroCoder co-evolves a Coder and a Tester, training both jointly on execution feedback from self-generated cases. As each side improves, their interaction yields progressively more informative supervision. The fully label-free framework aims to lift code generation where curated tests are scarce or absent.

Catalog record

CREATORLishui Fan, Mouxiang Chen, Tingwei Zhu, Kui Liu, Xin Xia, Shanping Li, Zhongxin Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59708
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.07864

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ZeroCoder: Can LLMs Improve Code Generation Without Ground-Truth Supervision? DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Lishui Fan, Mouxiang Chen, Tingwei Zhu, Kui Liu, Xin Xia, Shanping Li, Zhongxin Liu Abstract . Code generation is an important task in software engineering, and Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful paradigm for improving it through execution-based feedback. However, most RLVR pipelines rely on human-curated unit tests as verifiers, making further progress bottlenecked by the cost and scarcity of supervision. Existing work has tried to use self-generated tests to ground rewards, but the effect is constrained by the lack of discriminative tests due to the sub-optimal performance of the model on test generation. Our idea is to improve code generation without ground-truth supervision by co-evolving both code and test generation, so that their interactions produce progressively more informative supervision. To this end, we present ZeroCoder, a fully label-free co-evolutionary framework that jointly trains a Coder, which generates solutions, and a Tester, that generates tests, using only execution feedback from self-generated code–test interactions. For each problem, ZeroCoder executes sampled solutions against sampled tests to form a passing matrix, identifies a consensus subset of likely-correct solutions and consistent tests via a pluggable selection algorithm, and derives role-specific rewards accordingly. To ensure reward quality, ZeroCoder filters low-information instances via rank-based pre-filtering and trains the Tester with a curriculum balancing validity and mutation-driven discriminativeness. We further identify selector drift, the progressive miscalibration of fixed selection rules during co-evolution, and introduce D ​ y ​ ℬ 4 Dy\mathcal{B}^{4} , a Bayesian selector that uses as few as 10 labeled instances to dynamically recalibrate its priors. Across three model families and six benchmarks, ZeroCoder consistently improves both code generation and test generation. In the fully label-free setting, ZeroCoder yields strong gains. For example, on Qwen2.5-Coder-7B-Instruct, it improves code generation by up to 14.5% over the base model. With D ​ y ​ ℬ 4 Dy\mathcal{B}^{4} , the gain reaches 21.6%, while test generation improves by 24.3%, approaching oracle-supervised performance. 1. Introduction Code generation is an important task in software engineering ( Zhang et al. 2025c ; Yu et al. 2024 ) . Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a dominant paradigm for improving it, delivering substantial gains by optimizing large language models (LLMs) against execution-based feedback ( Guo et al. 2025 ; Yang et al. 2025 ) . Yet this success still depends heavily on the availability of ground-truth supervision: in practice, RLVR pipelines typically rely either on human-curated unit tests or on tests automatically generated from reference solutions as verifiers ( Ma et al. 2025 ; Du et al. 2023 ; Liu et al. 2024a ) , both requiring substantial manual effort and high-quality guarantees. As these resources become increasingly expensive to scale ( Du et al. 2023 ; Wang et al. 2023 ) , further progress is bottlenecked by supervision scarcity. This raises a pressing question: can LLMs improve code generation without relying on ground-truth supervision? A growing line of work has explored self-rewarding mechanisms to improve LLM reasoning without external labels, where models generate their own feedback to serve as a training signal. One line constructs rewards from model-side self-assessment signals, such as confidence or entropy ( Jang et al. [n. d.] ; Zhang et al. 2025b ; Prabhudesai et al. 2025 ) ; another derives supervision from consensus-based selection over multiple self-generated candidates, such as majority voting ( Zuo et al. 2025 ; Huang et al. 2025 ) . Although different in form, both depend on internal model agreement as a proxy for correctness, which may reinforce spurious yet self-consistent trajectories and even induce performance collapse ( Shafayat et al. 2025 ) . For code generation, a more objective proxy is program execution. Rather than relying on internal model agreement, one can assess solution quality by whether the code actually runs correctly. Along this direction, recent work uses self-generated tests and execution feedback to evaluate candidate programs ( Chen et al. 2025 ; Wang et al. 2025 ) . However, this route remains fundamentally bottlenecked by the quality of self-generated tests: due to the inherent scarcity of high-quality tests compared to code in training corpora ( Lin et al. 2025 ; Prasad et al. 2025 ) , self-generated tests often lack discriminative power, allowing spurious solutions to pass and yielding noisy, low-information reward signals. Consequently, in the absence of ground-truth supervision, improving code generation requires strengthening the model’s test-generation capability. Since code generation and test generation are dual tasks relying on a shared understanding of the code problem ( Xiong et al. 2024 ; Chen et al. [n. d.] ) , our idea is to co-evolve the two tasks during reinforcement learning. A single model alternates between two roles, acting as a coder to produce candidate solutions and as a tester to produce candidate tests. Rather than treating one role as fixed while optimizing the other, both roles are jointly trained and mutually improve through role-specific reward signals derived from the resulting code-test interactions: stronger tests place greater pressure on the coder to produce correct solutions, and a stronger coder, in turn, raises the bar for the tester to generate more discriminative tests. Crucially, in our label-free setting, these code-test interactions are the only source of supervision. The success of co-evolution, therefore, depends on whether they can yield informative reward signals for both roles. Realizing this idea requires addressing two challenges. From the training data perspective, problems that are too easy or too hard lead to degenerate code-test interactions with nearly identical rewards (e.g, either all pass or fail), driving group-normalized advantages toward zero and resulting in vanishing policy gradients that destabilize training ( Yu et al. 2025 ; Yang et al. 2025 ) . From the training process perspective, since the model’s ability as a tester is initially weaker than as a coder, naively optimizing both roles together may fail to bootstrap the tester into a reliable and discriminative verifier. In this paper, we propose ZeroCoder, a fully label-free framework that improves code generation by learning from self-generated code-test interactions, without relying on any ground-truth supervision. For each problem, ZeroCoder samples candidate solutions from the coder and tests from the tester, and executes them to form a passing matrix that summarizes pairwise execution outcomes. Based on this matrix, a selection algorithm, which we refer to as a selector , identifies a consensus subset of likely-correct solutions and consistent tests, i.e., a subset in which solutions exhibit mutually consistent execution behavior with respect to the selected tests, and ZeroCoder derives role-specific rewards for both the coder and the tester. To address the two challenges above, ZeroCoder incorporates two mechanisms. First, ZeroCoder performs an offline rank-based pre-filtering step before training, retaining only problems whose passing matrices exhibit sufficient interaction diversity measured by matrix rank. Second, ZeroCoder introduces a mutation-based reward for tester training, which is integrated into a curriculum designed to balance validity and discriminativeness. This curriculum rewards tests for agreeing with selector-induced consensus solutions, and gradually shifts emphasis toward mutation-based discriminativeness by encouraging tests to expose subtly faulty implementations. Built on

Read the complete text