When Hard Negatives Hurt : Bridging the Generative- Discriminative Gap in Hard Negative Synthesis for Retrieval Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3818118 CCS: Information systems Retrieval models and ranking

Zhicheng Zhang, Jiwei Tang, Kuicai Dong, Xiaopeng Li, Jieming Zhu, Jingyu Li, Qianhui Zhu, Fengyuan Lu, Wang Jiaheng, Gang Wang, Hai-Tao Zheng, Zhaocheng Du · 2026

Read When Hard Negatives Hurt : Bridging the Generative- Discriminative Gap in Hard Negative Synthesis for Retrieval Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3818118 CCS: Information systems Retrieval models and ranking by Zhicheng Zhang, Jiwei Tang, Kuicai Dong, Xiaopeng Li, Jieming Zhu, Jingyu Li, Qianhui Zhu, Fengyuan Lu, Wang Jiaheng, Gang Wang, Hai-Tao Zheng, Zhaocheng Du (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01304.txt.

Introduction

Zhang and co-authors warn that synthetic hard negatives can hurt retrieval. Hard negative mining trains most modern retrievers. Mined negatives are capped by what the corpus holds. They also grow polluted with false positives over time. Language models can synthesize negatives with no such caps. But naive use of them often degrades search quality. The team name the cause a generative-discriminative gap. Fluent text is not the same as a hard contrast.

CausalNeg builds negatives by counterfactual edits. It lists why a document fits a query, then breaks one need. Training also spreads negatives across the similarity range. This cuts shortcuts based on source identity. The code is public for other teams to use.

Catalog record

CREATORZhicheng Zhang, Jiwei Tang, Kuicai Dong, Xiaopeng Li, Jieming Zhu, Jingyu Li, Qianhui Zhu, Fengyuan Lu, Wang Jiaheng, Gang Wang, Hai-Tao Zheng, Zhaocheng Du
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01304

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When Hard Negatives Hurt : Bridging the Generative- Discriminative Gap in Hard Negative Synthesis for Retrieval Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3818118 CCS: Information systems Retrieval models and ranking Zhicheng Zhang, Jiwei Tang, Kuicai Dong, Xiaopeng Li, Jieming Zhu, Jingyu Li, Qianhui Zhu, Fengyuan Lu, Wang Jiaheng, Gang Wang, Hai-Tao Zheng, Zhaocheng Du Abstract . Hard negative mining has become the dominant strategy for training retrievers, yet it faces intrinsic limitations: negatives are bounded by corpus availability, selected by retriever score rather than diagnostic value, and increasingly contaminated by false positives as the retriever improves. LLM-based synthesis offers a principled alternative, where negatives that are unconstrained, targeted, and free from false positive risk. But we show that naïvely incorporating generated negatives into contrastive learning often degrades retrieval performance . We identify and formalize the root cause as a generative–discriminative gap : LLM generation optimizes for fluent, plausible text, while contrastive learning demands strategic violations of relevance at the decision boundary. Our analysis reveals two compounding failure modes: discriminative-agnostic generation , where the LLM lacks an explicit model of query information needs and defaults to generic or topic-drifted text that provides no contrastive signal; and source-dependent shortcuts , where distributional artifacts enable the model to distinguish negatives by origin rather than relevance, causing gradient drift that actively corrupts optimization. To close this gap, we propose CausalNeg consisting of two main modules: (1) CoT-guided counterfactual perturbation for data construction : decomposes why a document satisfies a query into explicit information requirements, then surgically violates individual requirements to construct negatives with controlled, interpretable hardness. (2) Query-view entropy maximization during training: disperses generated negatives across the similarity spectrum, minimizing the mutual information between source identity and similarity scores to suppress shortcut exploitation. Experiments on 4 retrieval benchmarks show that CausalNeg outperforms mining-only and naïve generation baselines, validating causally grounded synthesis and entropy-regularized training as complementary solutions to the generative–discriminative gap. † † cc-license: by Resource Availability: The source code of this paper has been made publicly available at https://doi.org/10.5281/zenodo.20404602 . The code repository is available at https://github.com/mzhangzhicheng/CausalNeg . 1. Introduction Figure 1 . Illustrative comparison of negative types. (a) Mined negatives are constrained by corpus availability and suffer from blind spots and false-negative risk. (b) Vanilla generated negatives carry style artifacts and factual errors, creating source-dependent shortcuts. (c) CausalNeg -generated negatives violate specific information requirements while preserving topical coherence, yielding well-distributed samples that refine semantic boundaries. Information retrieval (IR) seeks to identify relevant documents from a large corpus given a user query ( 43 ) . Modern retrievers ( 14 ) are typically initialized from pre-trained LLMs ( 45 ; 16 ) , and optimized via contrastive learning that teaches the model to distinguish relevant documents from irrelevant ones. Such discriminative objective ( 37 ; 5 ) relies heavily on the quality of positive and negative training pairs. In particular, hard negatives (documents that appear superficially relevant to a query yet fail to satisfy its actual information need) are essential for shaping a fine-grained decision boundary. Without sufficiently challenging negatives, the contrastive loss provides near-zero gradient ( 41 ) , and the model plateaus at a coarse level of discrimination ( 49 ) . Hard negative mining ( 40 ; 44 ) , which retrieves high-scoring but irrelevant passages from the corpus using an existing retriever, has become the dominant strategy for constructing such training signals and has driven substantial gains across retrieval benchmarks ( 36 ; 23 ) . Despite its effectiveness, hard negative mining has several intrinsic limitations. (1) lack of diversity . They are bounded by what exists in the corpus ( 41 ; 1 ) : if no passage exhibits a particular failure mode (e.g., subtle factual deviation, entity confusion, or logical inversion), it simply cannot be mined. (2) Uncontrolled intentionality. Even among negatives that do exist, mining selects them by retriever score rather than by diagnostic value. A passage is surfaced because it scores high, not because it tests a specific aspect of the query’s information need. This leads to accidental hardness (e.g., lexical overlap or topical proximity) rather than targeted at fine-grained semantic or factual discrimination. (3) False negative risk. As the retriever improves during iterative mining, the highest-scoring negatives increasingly tend to be unlabeled positives that genuinely satisfy the query. Training against these mislabeled examples pushes relevant documents away from the query, actively corrupting the decision boundary ( 24 ) . Collectively, these limitations impose a quality ceiling: mining alone cannot fully exploit the representational capacity of modern LLM-based retrievers. A natural alternative is to leverage LLMs to generate hard negatives on demand. In principle, synthesis offers a compelling solution to mining’s limitations: generated negatives are unconstrained by corpus availability, can be designed to target specific failure modes, and avoid false negative contamination. However, our study (§ 2 ) reveals that naïvely incorporating LLM-generated negatives into contrastive learning often fails, and may even degrade retrieval performance. The core issue lies in a fundamental mismatch: LLM generation is a generative process optimized for producing fluent, plausible text, while contrastive learning is a discriminative task that requires maximizing separation at the relevance decision boundary. This generative-discriminative gap manifests in two critical challenges: (1) Discriminative-agnostic generation (§ 2.3 ). The LLM lacks explicit knowledge of what constitutes a “negative” in the retrieval sense. It generates plausible text, not strategically non-responsive text. Vanilla prompting thus produces samples that violate contrastive semantics: overly generic descriptions, topic-drifted passages, or incorrect query answers. Such samples fail to provide meaningful training signals and exhibit pathological embedding behaviors such as isolated clusters and diversity collapse. (2) Source-dependent shortcuts (§ 2.4 ). The generated negatives (even semantically satisfying the discriminative requirements) carry a distributional signature distinct from real corpus data. This source-specific fingerprint enables the model to discriminate negatives by their stylistic artifacts rather than by relevance, creating a shortcut that bypasses genuine semantic learning. We show that exploiting such shortcuts causes gradient drift, pulling optimization away from the retrieval objective toward an artifact-biased solution. To address these challenges, we propose CausalNeg (Causal Negative Synthesis), a unified framework that leverages causal reasoning to systematically construct hard negatives through counterfactual perturbation of query information requirements. Our framework introduces two synergistic components. First, Chain-of-Thought Guided Counterfactual Perturbation reconceptualizes negative generation as structured reasoning: given query q and positive document d^{+} , we decompose why d^{+} satisfies q ’s information requirements into a reasoning chain, then systematically perturb critical nodes to construct negatives that violate specific requirements. This transforms generation from discriminative-agnostic text synthesis into targeted construction of interpretable failure modes with controlled diagnostic value. Second, Query-View Entropy Maximization (QEM) addresses source-dependent shortcuts through a theoretically grounded training intervention. We maximize the entropy of generated negatives’ query-conditioned similarity distribution while enforcing probability balance across sources, thereby minimizing the mutual information between source identity and similarity scores. Critically, QEM backpropagates only through generated embeddings, using mined negatives as a fixed reference distribution to harmonize both sources

Read the complete text