LBM: Hierarchical Large Auto-Bidding Model via Reasoning and Acting Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3792202 ISBN: 979-8-4007-2307-0/2026/04 CCS: Information systems Computational advertising

Yewen Li, Zhiyi Lyu, Peng Jiang, Qingpeng Cai, Fei Pan, Bo An, Peng Jiang · 2026

Read LBM: Hierarchical Large Auto-Bidding Model via Reasoning and Acting Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3792202 ISBN: 979-8-4007-2307-0/2026/04 CCS: Information systems Computational advertising by Yewen Li, Zhiyi Lyu, Peng Jiang, Qingpeng Cai, Fei Pan, Bo An, Peng Jiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05134.txt.

Introduction

Yewen Li and team offer LBM, a hierarchical auto-bidding model using large language model reasoning. Current auto-bidding methods use offline reinforcement learning or generative methods but can behave counterintuitively from black-box training. applying LLMs faces difficulties from precise action needs and missing specialized auto-bidding knowledge, causing hallucinations and suboptimal choices. LBM pairs LBM-Think for reasoning with LBM-Act for action making. It uses a dual embedding mechanism fusing language and number inputs plus offline reinforcement fine-tuning called GQPO to mitigate hallucinations.

Catalog record

CREATORYewen Li, Zhiyi Lyu, Peng Jiang, Qingpeng Cai, Fei Pan, Bo An, Peng Jiang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56174
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05134

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LBM: Hierarchical Large Auto-Bidding Model via Reasoning and Acting Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3792202 ISBN: 979-8-4007-2307-0/2026/04 CCS: Information systems Computational advertising Yewen Li, Zhiyi Lyu, Peng Jiang, Qingpeng Cai, Fei Pan, Bo An, Peng Jiang Abstract . The growing scale of ad auctions on online advertising platforms has intensified competition, making manual bidding impractical and necessitating auto-bidding to help advertisers achieve their economic goals. Current auto-bidding methods have evolved to use offline reinforcement learning or generative methods to optimize bidding strategies, but they can sometimes behave counterintuitively due to the black-box training manner and limited mode coverage of datasets, leading to challenges in understanding task status and generalization in dynamic ad environments. Large language models (LLMs) offer a promising solution by leveraging prior human knowledge and reasoning abilities to improve auto-bidding performance. However, directly applying LLMs to auto-bidding faces difficulties due to the need for precise actions in competitive auctions and the lack of specialized auto-bidding knowledge, which can lead to hallucinations and suboptimal decisions. To address these challenges, we propose a hierarchical L arge auto- B idding M odel ( LBM ) to leverage the reasoning capabilities of LLMs for developing a superior auto-bidding strategy. This includes a high-level LBM-Think model for reasoning and a low-level LBM-Act model for action generation. Specifically, we propose a dual embedding mechanism to efficiently fuse two modalities, including language and numerical inputs, for language-guided training of the LBM-Act; then, we propose an offline reinforcement fine-tuning technique termed GQPO for mitigating the LLM-Think’s hallucinations and enhancing decision-making performance without simulation or real-world rollout like previous multi-turn LLM-based methods. Experiments demonstrate the superiority of a generative backbone based on our LBM, especially in an efficient training manner and generalization ability. 1 1 1 Code is available at https://github.com/yewen99/LBM-WWW26. † † cc-license: by 1. Introduction Figure 1 . Overview of the training scheme for our hierarchical large auto-bidding model. Training Stage I (left): train the LBM-Act with language-guided decision training via a dual embedding mechanism to fuse two modalities; Training Stage II (right): reinforcement fine-tuning the LBM-Think via group relative-Q policy optimization. The rapid digitization of commerce has significantly expanded the reach of online advertising platforms on the web, leading to a surge in advertisers competing for millions or even billions of impression opportunities through ad auctions ( 43 ; 10 ) . Previously, advertisers relied on experienced human experts to manually adjust bids, but it is becoming impractical due to the increasing competitiveness of auctions ( 30 ) . Therefore, auto-bidding has become essential for helping advertisers achieve their commercial goals in the face of competition ( 38 ) . Auto-bidding can be modeled as a sequential decision-making task, where the objective is to maximize conversions while adhering to specific economic constraints, such as cost-per-action (CPA), by adjusting bidding parameters over a bidding period ( 29 ; 18 ) . Current auto-bidding methods are mainly built on offline reinforcement learning (RL) or generative methods, leveraging bidding logs collected from online advertising platforms ( 25 ; 13 ) . These methods aim to learn optimal policies by stitching sub-optimal trajectories from datasets to achieve reward-maximizing trajectories ( 1 ) . Offline RL typically performs trajectory stitching using dynamic programming with a value function ( 20 ) . Generative auto-bidding methods, which do not rely on a value function, perform stitching through a conditional generation approach utilizing the powerful generative models ( 7 ; 1 ; 19 ) . For instance, the Decision Transformer (DT) employs an auto-regressive transformer to generate bid actions based on historical sequences that encompass return-to-go, states, and actions ( 7 ; 26 ) . However, these RL and generative methods can occasionally act counterintuitively, such as increasing bidding parameters even when the CPA significantly exceeds the constraint, which is unlikely to occur in manual bidding. This issue arises because these methods primarily rely on reward design to acquire desired properties ( 1 ; 19 ; 24 ) . Consequently, it becomes challenging to ensure that the model fully understands the task status, resulting in a fully black-box approach. Additionally, since it’s impossible to capture every corner case into datasets, these methods are inherently restricted by the mode coverage of the offline dataset and lack guarantees for generalization performance in dynamic advertising environments, especially in unforeseen situations ( 25 ) . These limitations present significant challenges and could be major obstacles to the progress and adoption of advanced auto-bidding services, as frequent abnormal model behavior can undermine the trust of advertisers ( 44 ) . Fortunately, large language models (LLMs) are revolutionizing decision-making by harnessing prior human knowledge to boost performance ( 3 ; 36 ) . These LLMs effectively follow human instructions and utilize their reasoning ability with pre-trained knowledge to comprehend the task status and reasoning for optimal actions, showcasing superior performance and generalization ability in tasks like math and code ( 16 ) . Thus, incorporating LLMs as a new generative backbone for auto-bidding presents promising opportunities for improvement. While LLMs can be directly applied to auto-bidding by converting sequential numerical information into language token inputs and generating bidding parameters as a response, their performance is constrained via prompt engineering ( 9 ; 47 ) in large-scale auctions due to the generated suboptimal actions. This limitation arises from the intense competition among advertisers, where their bids can be very close, and thus, the need for precise actions is critical for optimality ( 17 ; 42 ) . A suboptimal bidding parameter could lead to budget waste or limited gains in impressions. For instance, if the bidding parameter is set too high, the budget may be exhausted fast, missing later opportunities; conversely, if set too low, it may result in no acquired impressions. To our knowledge, current public LLMs have not been specially pretrained or fine-tuned on auto-bidding data, as there is no public auto-bidding data in text format; thus, they could still suffer from the notorious hallucinations issue and lack optimal sequential decision-making ability ( 11 ; 54 ) . There have been many attempts to enhance LLMs for decision-making tasks, though they are not well-suited for the auto-bidding task. To leverage the reasoning capabilities of LLMs, some approaches, such as reinforcement learning with verifiable rewards (RLVR) ( 16 ) , aim to enhance performance in tasks like mathematical reasoning, code generation, and computer control ( 11 ) . These methods primarily focus on reasoning abilities rather than continuous control, where the action space is typically discrete, such as in tool-use agents ( 2 ) , whereas auto-bidding operates in a continuous numerical action space. For applications of LLMs in tasks with continuous state and action spaces, there is one challenge that representing numerical inputs as language tokens can be costly ( 40 ; 53 ) ; for instance, a numerical state like "12.34" requires five tokens, potentially resulting in thousands of tokens when using extensive historical data in complex tasks. Even if it is done in this way, the attention mechanism of LLMs could be limited, leading to hallucinations and suboptimal

Read the complete text