Evaluating the Effectiveness of Black-Box Prompt Optimization as the Scale of LLMs Continues to Grow
Ziyu Zhou, Yihang Wu, Jingyuan Yang, Zhan Xiao, Rongjun Li · 2025
Read Evaluating the Effectiveness of Black-Box Prompt Optimization as the Scale of LLMs Continues to Grow by Ziyu Zhou, Yihang Wu, Jingyuan Yang, Zhan Xiao, Rongjun Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08303.txt.
Introduction
Ziyu Zhou, Yihang Wu, and colleagues test whether automatic prompt tuning still pays as language models grow in a 2025 study. Black-box prompt optimization refines a model's instructions by trial, using only its outputs, and it lifted results on the smaller and older models most studies used. Frontier models are now hundreds of times larger, and their prompts behave differently.
Whether the same tuning tricks keep working at that scale is the open question the authors put to experiment. If gains shrink, effort should shift from prompt search to other levers. If gains hold, tuning remains a cheap upgrade for the largest deployments.
Catalog record
| CREATOR | Ziyu Zhou, Yihang Wu, Jingyuan Yang, Zhan Xiao, Rongjun Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08303
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating the Effectiveness of Black-Box Prompt Optimization as the Scale of LLMs Continues to Grow Ziyu Zhou, Yihang Wu, Jingyuan Yang, Zhan Xiao, Rongjun Li Abstract Black-Box prompt optimization methods have emerged as a promising strategy for refining input prompts to better align large language models (LLMs), thereby enhancing their task performance. Although these methods have demonstrated encouraging results, most studies and experiments have primarily focused on smaller-scale models (e.g., 7B, 14B) or earlier versions (e.g., GPT-3.5) of LLMs. As the scale of LLMs continues to increase, such as with DeepSeek V3 (671B), it remains an open question whether these black-box optimization techniques will continue to yield significant performance improvements for models of such scale. In response to this, we select three well-known black-box optimization methods and evaluate them on large-scale LLMs (DeepSeek V3 and Gemini 2.0 Flash) across four NLU and NLG datasets. The results show that these black-box prompt optimization methods offer only limited improvements on these large-scale LLMs. Furthermore, we hypothesize that the scale of the model is the primary factor contributing to the limited benefits observed. To explore this hypothesis, we conducted experiments on LLMs of varying sizes (Qwen 2.5 series, ranging from 7B to 72B) and observed an inverse scaling law, wherein the effectiveness of black-box optimization methods diminished as the model size increased. 1 Introduction Prompt optimization methods have emerged as an effective strategy for enhancing task performance by carefully refining input prompts to better align with LLMs ( Brown et al. 2020 ) . Broadly speaking, existing prompt optimization methods can be classified into two categories: white-box and black-box prompt optimization methods. White-box prompt optimization techniques typically involve utilizing gradient information to refine prompts. For instance, AutoPrompt ( Shin et al. 2020 ) uses gradient-based methods to iteratively replace discrete prompt tokens, refining the initial prompt and improving performance on downstream tasks. Similarly, prefix tuning ( Liu et al. 2022 ) and prompt tuning ( Lester et al. 2021 ) fine-tune additional soft continuous embeddings, referred to as "soft tokens," to construct more effective task-specific prompts. Although these methods show promising results, they require access to the model’s internal gradients or parameters, limiting their applicability in many closed-source models, such as GPT4o ( Hurst et al. 2024 ) and Gemini ( Anil et al. 2023 ) . Another category of prompt optimization methods is based on nonparametric black-box techniques. These methods typically optimize prompts through calling external APIs, without the need to access the internal model parameters or gradients. For example, EvoPrompt ( Guo et al. 2023 ) utilizes evolutionary algorithms to iteratively search for better task prompts through crossover and mutation. Similarly, methods like ProTeGi ( Pryzant et al. 2023 ) , BPO ( Cheng et al. 2023 ) , and OPRO ( Yang et al. 2023 ) use LLMs themselves as optimizers, generating improved task prompts by leveraging text feedback signals from the LLMs. Despite these methods demonstrating substantial performance improvements, they have primarily been tested on smaller-scale LLMs (e.g., those with fewer than 14B parameters) or earlier versions of LLMs (e.g., GPT-3.5 ( Ye et al. 2023 ) ). As LLMs continue to scale up, it is still uncertain whether these black-box optimization techniques will maintain their ability to deliver substantial performance gains. To address this question, we selected three popular black-box optimization methods and evaluated their performance on large-scale LLMs, DeepSeek V3 ( DeepSeek-AI 2024 ) and Gemini 2.0 Flash ( Pichai et al. 2024 ) , across four NLU and NLG benchmark datasets. The experimental results demonstrate that the performance improvements from these methods have become less significant. For the NLU datasets, the average accuracy improvements for DeepSeek V3 and Gemini 2.0 Flash across these three optimization methods were 0.86% and 1.16%, respectively. Similarly, for the NLG datasets, the corresponding metric improvements for DeepSeek V3 and Gemini 2.0 Flash were 1.04% and 2.03%, respectively. We hypothesize that the limited improvements are primarily due to the issue of model scale. To investigate this further, we conducted experiments on LLMs of varying sizes, specifically the Qwen 2.5 series, with model sizes ranging from 7B to 72B parameters. The results revealed an inverse scaling law, in which the efficacy of black-box optimization methods decreased as the model size increased. In brief, our work offers two key contributions: • We evaluate three black-box optimization methods on large-scale LLMs using four NLU and NLG datasets, finding only limited improvements in performance. • Our findings reveal an inverse scaling pattern, where the effectiveness of black-box optimization decreases as the size of the LLM increases. 2 Related Work 2.1 White-Box Prompt Optimization Methods Early white-box prompt optimization methods, such as AutoPrompt ( Shin et al. 2020 ) , utilize gradients to search for discrete prompt tokens to improve model performance. Wen et al. 2023 expanded these hard prompt optimization methods to multimodal tasks, including text-to-image generation. Prefix-Tuning ( Li and Liang 2021 ) introduced continuous, task-specific vectors as “soft tokens," optimizing them via gradients to boost performance. Furthermore, P-Tuning v2 ( Liu et al. 2022 ) optimized “soft embeddings" across multiple transformer layers, achieving improvements across a broader range of tasks. More recently, GReaTer ( Das et al. 2024 ) incorporated reasoning path information into gradient-based prompt searches, yielding significant performance improvements over prior methods. 2.2 Black-Box Prompt Optimization Black-box prompt optimization methods seek to enhance task performance by refining prompts without accessing the model’s internal parameters or gradients. For example, EvoPrompt ( Guo et al. 2023 ) employs evolutionary algorithms, including crossover and mutation, to iteratively refine prompts. APE ( Zhou et al. 2022 ) frames black-box prompt optimization as a program synthesis problem, refining prompts through top-k sampling and resampling. OPRO ( Yang et al. 2023 ) integrates historical optimization trajectory information to improve the stability of the optimization process. ProTeGi ( Pryzant et al. 2023 ) refines prompts through iterative language feedback, resulting in enhanced performance. Likewise, BPO ( Cheng et al. 2023 ) optimizes prompts using human feedback and utilizes a small LLM as a prompt optimizer, reducing the high costs associated with large-scale LLMs. Model SST-5 (acc.) AG’s News (acc.) SAMSum (ROUGE) ASSET (SARI) DeepSeek V3 + EvoPrompt 56.0 \rightarrow 56.6 83.6 \rightarrow 84.8 34.4 \rightarrow 35.4 45.3 \rightarrow 45.8 + ProTeGi 56.0 \rightarrow 56.4 84.0 \rightarrow 85.8 33.9 \rightarrow 33.7 46.4 \rightarrow 46.9 + BPO 56.0 \rightarrow 56.4 84.6 \rightarrow 83.8 33.9 \rightarrow 34.1 45.3 \rightarrow 45.8 Average % Increase 0.83% 0.88% 0.97% 1.10% Gemini 2.0 Flash + EvoPrompt 56.4 \rightarrow 56.8 82.4 \rightarrow 85.4 37.2 \rightarrow 38.5 45.4 \rightarrow 47.6 + ProTeGi 55.6 \rightarrow 56.2 82.5 \rightarrow 83.5 37.2 \rightarrow 37.6 44.6 \rightarrow 46.0 + BPO 57.6 \rightarrow 58.2 82.8 \rightarrow 82.2 37.2 \rightarrow 36.9 44.2 \rightarrow 44.4 Average % Increase 0.94% 1.38% 1.25% 2.81% Table 1: Performance of Black - Box Prompt Optimization Methods on DeepSeek V3 & Gemini 2.0 Flash. Model Comparison of the Initial and Optimized Prompts on the AG’s News Dataset Initial Identify the category of the text (e.g. Technology, Sports, World, Business). DeepSeek V3 Identify the main topic of the content and select from the categories: World, Sports, Business, or Tech. Gemini 2.0 Flash Categorize the following news article under one of these