Adaptive Experimental Design Using Shrinkage Estimators Evan T. R. Rosenman, Kristen B. Hunter Abstract In the setting of multi-armed trials, adaptive designs are a popular way to increase estimation efficiency, identify optimal treatments, or maximize rewards to individuals. Recent work has considered the case of estimating the effects of K K active treatments, relative to a control arm, in a sequential trial. Several papers have proposed sequential versions of the classical Neyman allocation scheme to assign treatments as individuals arrive, typically with the goal of using Horvitz-Thompson-style estimators to obtain causal estimates at the end of the trial. However, this approach may be inefficient in that it fails to borrow information across the treatment arms. In this paper, we consider adaptivity when the final causal estimation is obtained using a Stein-like shrinkage estimator for heteroscedastic data. Such an estimator shares information across treatment effect estimates, providing provable reductions in expected squared error loss relative to estimating each causal effect in isolation. Moreover, we show that the expected loss of the shrinkage estimator takes the form of a Gaussian quadratic form, allowing it to be computed efficiently using numerical integration. This result paves the way for sequential adaptivity, allowing treatments to be assigned to minimize the shrinker loss. Through simulations, we demonstrate that this approach can yield meaningful reductions in estimation error. We also characterize how our adaptive algorithm assigns treatments differently than would a sequential Neyman allocation. 1 Introduction Adaptive experimental designs offer a powerful tool to improve experimentation. In such designs, the treatment assignment rule used for new arrivals is updated based on the outcomes already observed. These updates can be targeted toward improving the efficiency of estimating causal contrasts (( 12 ) , more rapidly identifying optimal treatments (( 42 ) , or maximizing the utility of individuals in the trial (( 29 ) . We consider the first such objective in the context of a multi-armed randomized experiment in which there are K possible active treatment levels, as well as a control treatment level. We suppose the trial is “online” in the sense that individuals arrive sequentially and, upon arrival, must be assigned to a treatment status k\in\{0,\dots,K\} , where k=0 denotes the control and k=1,\dots,K denote the active treatments. We assume that trial participants are randomly sampled from an infinite super-population. For each individual in this super-population, we define potential outcomes Y(k) corresponding to every possible treatment assignment. The causal quantities of interest are the average treatment effects \tau_{k}=\mathbb{E}\left(Y(k)-Y(0)\right),\hskip 14.22636ptk=1,\dots,K, where the expectation is taken with respect to the super-population distribution of potential outcomes. We collect these parameters into a vector \boldsymbol{\tau}=(\tau_{1},\dots,\tau_{K})\in\mathbb{R}^{K} . Throughout, we assume standard conditions, such as SUTVA, and for simplicity we do not incorporate covariates. A central challenge in adaptive experiments is the design of treatment assignment rules that best exploit the accumulating data. The Neyman allocation (( 27 ) , a classical and much-vaunted sampling result, suggests allocating units to treatments in proportion to their potential outcome standard deviations. Recent work has extended this idea to sequential and adaptive settings (( 12 , 47 , 11 ) , proposing online versions of Neyman-style allocation schemes in which treatment probabilities are updated as outcome data accrue. These approaches are often paired with Horvitz-Thompson-style estimators to retain unbiasedness under adaptive assignment. Such methods may be suboptimal when the goal is to estimate all of the treatment effects simultaneously. In particular, the treatment effects are often related and can beneficially share information. Shrinkage estimators provide a principled way to borrow strength across effect estimates and can achieve lower expected squared error loss than estimating each effect separately, even in heteroscedastic settings. In this manuscript, we study adaptive experimental design when final inference is conducted using a Stein-like shrinkage estimator for the vector of treatment effects. Under standard approximate Gaussian distributions for the arm-level estimators, the expected squared error loss of such shrinkage estimators can be written as a Gaussian quadratic form. This representation allows the risk to be computed efficiently using numerical integration, making it feasible to design adaptive assignment rules that directly target minimization of the shrinkage risk. The remainder of this paper proceeds as follows. Section 2 reviews the relevant literature on Neyman allocation and adaptive designs. Section 3 introduces three candidate shrinkage estimators and explains how their risk can be estimated via an adaptation of Stein’s Unbiased Risk Estimate (( 36 ) . Section 4 considers oracle designs in the case where the potential outcome means and variances are known for each treatment arm. We begin by solving for the Neyman allocation, and then consider the risk-minimizing allocations for each of the candidate shrinkers. Section 5 introduces our greedy adaptivity scheme, demonstrating how shrinker risk can be efficiently computed via numerical integration. Subsequent simulations evince the benefits of adaptivity in practice. Section 6 concludes. 2 Literature Review Adaptive experimental designs can vary widely in their objectives. One fundamental distinction is between designs that prioritize identifying and exploiting the best treatment and those that prioritize precise estimation of causal effects. All adaptive designs make a a tradeoff between exploration and exploitation. Sometimes this tradeoff is explicitly optimized, such as in Thompson sampling; other methods deal with this tradeoff by having a warm-up period. In a multi-armed bandit setting, the primary goal is to maximize the expected reward. The reward is maximized by quickly identifying the best-performing arm, so that the largest possible number of units are assigned to it. A canonical approach is Thompson sampling, which randomly assigns units to arms proportional to the posterior probability that each arm is optimal (( 40 , 1 , 33 ) . More recent work has considered a “top-two” variant of Thompson sampling, where more aggressive exploration is induced by randomizing within the two arms that appear most promising based on the posterior (( 34 , 22 , 30 ) . 13 shows that empirical Bayes shrinkage can be applied to produce results similar to “top-two Thomson sampling”, but with better performance in selecting a set of best arms rather than just the top two. Unlike traditional randomized trials, bandit designs do not typically include a control arm, and the emphasis is not on precise estimation of effect sizes. Instead, the aim is to minimize cumulative regret by rapidly exploiting the reward-maximizing treatment option. As a simple example, consider an A/B test in which a company seeks to determine which color of a website search bar – red or blue – maximizes revenue. The company does not care about pairwise comparisons between colors, nor about estimating revenue levels with high precision. Even if the improvement from red over blue is small, red would be chosen if it yields the highest expected profit. Accordingly, the firm wishes to minimize exposure to inferior designs during the experiment, rather than to learn finely grained effect sizes. By contrast, efficiency-oriented adaptive designs aim to estimate causal effects as precisely as possible. Here, the treatment allocation is chosen to minimize the variance of treatment effect estimators, often under a fixed total sample size. In this setting, trials typically include a control arm, and treatment effects are defined relative to that control. The success of the design is evaluated by the aggregate precision of the effect estimates. For example, consider a clinical trial comparing three new drugs to a standard treatment. The goal is not simply to identify which drug performs best, but to estimate each drug’s causal effect relative to the control with high precision. A drug that is superior, but yields only a marginal clinical benefit, may not be worth pursuing. Similarly, cost, side effects, or scalability considerations may dominate small differences in efficacy. In such settings, precise effect estimation – not just best-arm identification – is essential. Though originally derived as an optimal strategy for stratified sampling, the Neyman allocation is a canonical efficiency-oriented design, minimizing the statistical risk of a simple difference-in-means estimator. Optimal assignment probabilities are proportional to arm-specific potential outcome standard deviations (( 27 , 6 , 4 ) . Because these quantities are unknown at the outset of an adaptive experiment, various papers have proposed schemes to approximate these quantities and update treatment probabilities accordingly. 7 proposes approximating these quantities with a pilot batch, but 10 notes that this approach can yield higher asymptotic variance than a non-adaptive approach when the pilot is small. Other methods consider multistage (( 47 ) and online (( 12 , 11 ) variants. When covariates are observed prior to treatment assignment, adaptive designs can be further enhanced to improve efficiency. A standard approach is to estimate arm-specific variances conditional on covariate values or strata. 18 proposes implementing a Neyman allocation conditional on covariates by estimating outcome variances within treatment and control groups. 39 studies a two-stage randomized controlled trial in which strata are learned rather than prespecified. He proposed using pilot data to estimate a stratification via tree-based methods, and selecting stratum-specific allocations via a Neyman-like approach. 24 characterize optimal allocation rules that minimize the asymptotic variance of treatment effect estimators under general covariate-adaptive designs, providing theoretical guarantees for efficiency gains relative to classical randomization schemes. Moreover, in the presence of covariates, alternative objectives are also possible. For example, 2 introduces a method based on weighted online discrepancy minimization in multiarm trials. Here, the goal is to achieve covariate balance across arms, rather than explicitly improving estimation precision. Hybrid objectives are also common. In many applications, investigators wish to exploit superior treatments while retaining enough control observations to enable stable and interpretable effect estimation. 28 propose Control-Augmented Thompson Sampling, which modifies standard Thompson sampling so that the control arm’s sample size tracks that of the currently best-performing treatment. Similarly, 41 develop a Bayesian adaptive algorithm for multi-armed survival trials that balances patient benefit with reliable control comparisons. Related work explores optimal trade-offs between regret minimization and estimation precision in adaptive trials (( 43 , 42 ) . Another key design choice concerns whether the experiment is run for a fixed sample size or governed by a stopping rule. Adaptive trials may terminate early if one arm is shown to be sufficiently superior, or if continuing the experiment is deemed unlikely to change the decision. While early stopping can substantially reduce cost or ethical burden, it complicates statistical inference, as conventional estimators and confidence intervals may no longer be valid (( 21 ) . A growing literature studies both optimal stopping rules and valid post-selection inference in adaptive experiments (( 19 ) . Our goal in this manuscript is to develop an adaptive allocation rule tailored to shrinkage-based estimation of multi-armed treatment effects. We assume the final analysis will use a Stein-like estimator that borrows strength across the K treatment effect estimates. The allocation method then differs from most efficiency-oriented adaptive designs, which typically seek to minimize the variance of unbiased difference-in-means or Horvitz-Thompson-style estimators. This shift changes the design problem: assignment decisions should be evaluated by their impact on the risk of the shrinkage estimator, not by the marginal variance of each arm in isolation. To make this method feasible in an online trial, we show that, for a broad class of shrinkers, the expected squared-error risk can be written as a linear combination of expectations of ratios of Gaussian quadratic forms, which can be computed efficiently via one-dimensional numerical integration. This result yields a practical sequential algorithm that, at each enrollment, assigns the arriving unit to the arm that minimizes the estimated shrinkage risk under a plug-in model for the currently best estimate of the treatment effects and their covariance matrix. In simulations, we study when shrinkage estimators dominate the difference-in-means benchmark and how the resulting risk-minimizing allocations differ from sequential Neyman-style rules. 3 SURE and Candidate Estimators 3.1 Notation and Assumptions At completion, suppose we have N total individuals who have been enrolled in the trial, with individuals indexed by i=1,\dots,N . Denote by W_{i}\in\{0,1,\dots,K\} the treatment assigned to individual i , and define n_{k}=\sum_{i=1}^{N}\mathbb{I}(W_{i}=k),\hskip 14.22636ptk=0,\dots,K as the number of units assigned to treatment k . As discussed in Section 1 , we operate in the potential outcomes framework (( 31 ) , and assume units are sampled i.i.d. from a super-population. We also make the standard Stable Unit Treatment Value Assumption (( 32 , SUTVA;) , such that we observe outcomes Y_{i}=Y_{i}(W_{i}),\hskip 14.22636pti=1,\dots,N, for each individual i . We also need some notation to define means and variances of potential outcomes. We use the notation \mu_{k}=\mathbb{E}\left(Y(k)\right)\hskip 14.22636pt\text{ and }\hskip 14.22636ptV_{k}=\text{var}\left(Y(k)\right), for k=0,\dots,K , where the expectation and variance here are again over the population from which the experimental units are sampled. Under our definitions, we can also write \tau_{k}=\mu_{k}-\mu_{0},\hskip 14.22636ptk=1,\dots,K. 3.2 Difference-in-Means Estimator The simplest choice of estimator is \boldsymbol{\hat{\tau}}=\left(\hat{\tau}_{1},\dots,\hat{\tau}_{K}\right) where \hat{\tau}_{k}=\frac{1}{n_{k}}\sum_{i=1}^{n}Y_{i}\cdot\mathbb{I}(W_{i}=k)-\frac{1}{n_{0}}\sum_{i=1}^{n}Y_{i}\cdot\mathbb{I}(W_{i}=0)\,. This difference-in-means estimator is unbiased, i.e. \mathbb{E}(\boldsymbol{\hat{\tau}})=\boldsymbol{\tau}. We can also characterize the variance of each component as \sigma_{k}^{2}\equiv\text{var}(\hat{\tau}_{k})=\frac{V_{k}}{n_{k}}+\frac{V_{0}}{n_{0}}\,. The entries of \boldsymbol{\hat{\tau}} will not be independent of one another, since each depends on the estimate from the control arm. It is straightforward to show that \text{cov}(\hat{\tau}_{j},\hat{\tau}_{k})=\frac{V_{0}}{n_{0}},\hskip 28.45274pt\text{ for }j\neq k. We can invoke a Central Limit Theorem on the entries of \boldsymbol{\hat{\tau}} as long as the potential outcomes Y(k) are bounded and we have obtained a reasonably large number of samples in each arm. Recent work (( 17 , see e.g.) has highlighted that adaptivity can undermine asymptotic normality if treatment selection is too responsive to estimated responses under each treatment. For clarity of exposition, we explicitly assume this is not the case, and suppose adaptivity is not so aggressive as to undermine the CLT. Thus, approximately, \boldsymbol{\hat{\tau}}\sim\mathcal{N}\left(\boldsymbol{\tau},\boldsymbol{\Sigma}\right)\hskip 14.22636pt\text{ where }\hskip 14.22636pt\boldsymbol{\Sigma}=\left(\begin{array}[]{cccc}\frac{V_{1}}{n_{1}}+\frac{V_{0}}{n_{0}}&\frac{V_{0}}{n_{0}}&\ldots&\frac{V_{0}}{n_{0}}\\ \frac{V_{0}}{n_{0}}&\frac{V_{2}}{n_{2}}+\frac{V_{0}}{n_{0}}&\ldots&\frac{V_{0}}{n_{0}}\\ \vdots&\vdots&\ddots&\vdots\\ \frac{V_{0}}{n_{0}}&\frac{V_{0}}{n_{0}}&\ldots&\frac{V_{K}}{n_{K}}+\frac{V_{0}}{n_{0}}\end{array}\right). 3.3 Stein’s Unbiased Risk Estimate It is well known that in parallel estimation problems like the one described, researchers can achieve reductions in statistical risk by using some form of shrinkage estimation. The key idea is to introduce a small amount of bias by “shrinking” the estimates toward a fixed point or toward their mean. The compensatory reduction in variance due to the shrinkage is such that one achieves a lower statistical risk than with an unbiased estimator. The most classic estimator of this type is the James-Stein estimator (( 37 ) , which shrinks an estimate of a multivariate normal mean vector towards zero. Though we assume approximate normality of \boldsymbol{\hat{\tau}} , the classical James-Stein estimator is inappropriate for our setting, because its construction assumes the data are homoscedastic and that the entries are independent. There are a number of different adaptations of the James-Stein estimator to the settings of heteroscedasticity and dependence (( 44 , 13 , see e.g.) . Before considering the precise form of our adapted estimator, we introduce a useful tool for construction and evaluation of shrinkage estimators: Stein’s Unbiased Risk Estimate (( 36 ) . The precise statement is given below. Lemma 1 (SURE) . Suppose \boldsymbol{X}\sim\mathcal{N}\left(\boldsymbol{\mu},\boldsymbol{\Sigma}\right)\in\mathbb{R}^{K} for non-degenerate \boldsymbol{\Sigma}\in\mathbb{R}^{K\times K} . We consider an estimator of \boldsymbol{\mu}\in\mathbb{R}^{K} of the form \boldsymbol{\hat{\delta}}(\boldsymbol{X})=\boldsymbol{X}-g(\boldsymbol{X}), for g(\cdot) differentiable and L_{2} integrable. Define \mathcal{J}_{g}(\boldsymbol{X}) as the Jacobian matrix of g(\cdot) evaluated at \boldsymbol{X} . Then, for loss function \mathcal{L}(\boldsymbol{\mu},\boldsymbol{v})=\mathbb{E}\left(||\boldsymbol{\mu}-\boldsymbol{v}||_{2}^{2}\right) , we have \mathbb{E}\left(\mathcal{L}\left(\boldsymbol{\hat{\delta}}(\boldsymbol{X}),\boldsymbol{\mu}\right)\right)=\text{tr}(\boldsymbol{\Sigma})+\mathbb{E}\bigg(||g(\boldsymbol{X})||_{2}^{2}-2\cdot\text{tr}\big(\boldsymbol{\Sigma}\mathcal{J}_{g}(\boldsymbol{X})\big)\bigg). (1) Hence, the estimator \text{SURE}(\boldsymbol{\hat{\delta}}(\boldsymbol{X}))=\text{tr}(\boldsymbol{\Sigma})+||g(\boldsymbol{X})||_{2}^{2}-2\cdot\text{tr}\big(\boldsymbol{\Sigma}\mathcal{J}_{g}(\boldsymbol{X})\big) (2) is unbiased for the risk \mathbb{E}\left(\mathcal{L}\left(\boldsymbol{\hat{\delta}}(\boldsymbol{X}),\boldsymbol{\mu}\right)\right) . Proof. See the Appendix, Section A . ∎ 3.4 Candidate Estimators We consider several candidate shrinkage estimators to apply to the difference-in-means estimator \boldsymbol{\hat{\tau}} . All of these candidates will work with our adaptive treatment allocation method. Bock’s estimator . The first candidate is the shrinker of 8 , which is explicitly designed to work with Gaussian vectors with dependent entries. Denoting as \lambda_{\text{max}}(\boldsymbol{\Sigma}) the largest eigenvalue of \boldsymbol{\Sigma} , the estimator is given by \boldsymbol{\hat{\delta}_{B}}=\left(1-\frac{\tilde{p}-2}{\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\hat{\tau}}}\right)\boldsymbol{\hat{\tau}}\hskip 14.22636pt\text{ where }\hskip 14.22636pt\tilde{p}=\frac{\text{tr}(\boldsymbol{\Sigma})}{\lambda_{\text{max}}(\boldsymbol{\Sigma})}. Note that 0\leq\tilde{p}\leq K . Bock showed that the estimator dominates \boldsymbol{\hat{\tau}} if \text{tr}(\boldsymbol{\Sigma})>2\lambda_{\text{max}}(\boldsymbol{\Sigma}) . The estimator is attractive for its simplicity, and will be used as our primary motivating example. SURE-Min estimator . An alternative estimator can be obtained by directly minimizing Stein’s Unbiased Risk Estimate (Equation 2 ), a tradition with a long history in the statistics literature (( 25 , 44 , see e.g.) . We consider the class of all estimators which shrink \boldsymbol{\hat{\tau}} toward zero by a constant factor \lambda\in\mathbb{R} , i.e. estimators of the form \boldsymbol{\hat{\delta}}(\boldsymbol{\hat{\tau}})=(1-\lambda)\boldsymbol{\hat{\tau}}. An unbiased estimate of the risk of such an estimator is \text{SURE}(\boldsymbol{\hat{\delta}}(\boldsymbol{\hat{\tau}}))=\text{tr}(\boldsymbol{\Sigma})+\lambda^{2}||\boldsymbol{\hat{\tau}}||_{2}^{2}-2\lambda\cdot\text{tr}(\boldsymbol{\Sigma}), which has minimizer \lambda=\text{tr}(\Sigma)\big/||\boldsymbol{\hat{\tau}}||_{2}^{2} . Thus, we define our second candidate estimator as \boldsymbol{\hat{\delta}_{S}}=\left(1-\frac{\text{tr}(\boldsymbol{\Sigma})}{||\boldsymbol{\hat{\tau}}||_{2}^{2}}\right)\boldsymbol{\hat{\tau}}, where ||\boldsymbol{\hat{\tau}}||_{2}^{2}=\sum_{k}\hat{\tau}_{k}^{2} . We can again use Lemma 1 to establish a condition under which \boldsymbol{\hat{\delta}_{S}} dominates \boldsymbol{\hat{\tau}} . Lemma 2 . \boldsymbol{\hat{\delta}_{S}} dominates \boldsymbol{\hat{\tau}} if 4\cdot\lambda_{\text{max}}(\boldsymbol{\Sigma})<\text{tr}(\boldsymbol{\Sigma}). Proof. See the Appendix, Section B . ∎ Dimmery’s estimator . A final alternative is a modified version of the estimator proposed in 13 . Dimmery and co-authors consider the setting of online experiments, in which their objective is to estimate the mean response under each treatment. They use a heteroscedastic version of the James-Stein estimator that shrinks toward the grand mean. Because we are considering contrasts between the mean response under each treatment and the mean response under a control, we modify the estimator to shrink toward 0 instead. We refer to this estimator as \boldsymbol{\hat{\delta}_{\textbf{D}}} , whose entries are given by \hat{\delta}_{\text{D},k}=\left(1-\frac{(K-2)\sigma_{k}^{2}}{||\boldsymbol{\hat{\tau}}||_{2}^{2}}\right)\hat{\tau}_{k},\hskip 28.45274ptk=1,\dots K. We can use Lemma 1 to establish the following condition, under which the risk of \boldsymbol{\hat{\delta}_{\textbf{D}}} is strictly less than that of \boldsymbol{\hat{\tau}} regardless of the true value of \boldsymbol{\tau} . Lemma 3 . \boldsymbol{\delta}_{\textbf{D}} dominates \boldsymbol{\hat{\tau}} if \frac{1}{2}\left(\max_{k}\sigma_{k}^{2}\right)\left((K-2)(\max_{k}\sigma_{k}^{2})+4\lambda_{\text{max}}(\boldsymbol{\Sigma})\right)\leq\sum_{k}\sigma_{k}^{4}. (3) Proof. See the Appendix, Section C . ∎ As with the maximum eigenvalue condition for Bock’s estimator, Lemmas 2 and 3 are useful for practitioners in that they provide a condition that can be checked at the end of the online trial to obtain a guarantee that the risk will be lower than when using \boldsymbol{\hat{\tau}} . 4 Oracle Designs Our goal is to design a treatment allocation approach that minimizes the risk given a particular estimator. We begin by analyzing the non-adaptive setting, focusing only on experimental designs with a fixed total sample size, N . Moreover, we suppose that the potential outcome variances V_{0},\dots,V_{K} are known a priori . These are “oracle” designs, insofar as the V_{k} are essentially never known in practice and must be estimated directly from the data. However, this setting allows us to gain intuition into the behavior of risk-minimizing designs when using the estimators \boldsymbol{\hat{\tau}},\boldsymbol{\hat{\delta}_{B}},\boldsymbol{\hat{\delta}_{S}} and \boldsymbol{\hat{\delta}_{\textbf{D}}} . 4.1 A Modified Neyman Allocation In the standard Neyman Allocation approach, treatment allocation is in proportion to the arm standard deviations \sqrt{V_{k}} . This approach minimizes the expected squared error when estimating the mean for each arm. However, our goal is slightly different; we want to minimize the variance of estimating each treatment effect . Suppose we use the difference-in-means estimator \boldsymbol{\hat{\tau}}=\left(\hat{\tau}_{1},\dots,\hat{\tau}_{K}\right) to estimate \boldsymbol{\tau} . In this case, the risk of our estimator is \mathcal{R}\left(\boldsymbol{\hat{\tau}},\boldsymbol{\tau}\right)=\text{tr}(\boldsymbol{\Sigma})=\sum_{k=1}^{K}\frac{V_{0}}{n_{0}}+\frac{V_{k}}{n_{k}}=\frac{KV_{0}}{n_{0}}+\sum_{k=1}^{K}\frac{V_{k}}{n_{k}}. Hence, obtaining the risk-minimizing allocation of units to treatment arms is equivalent to solving the following optimization problem (Problem 4 ): \displaystyle\min_{n_{0},\dots,n_{K}} \displaystyle\frac{KV_{0}}{n_{0}}+\sum_{k=1}^{K}\frac{V_{k}}{n_{k}} (4) \displaystyle\text{subject to} \displaystyle\sum_{k=0}^{K}n_{k}=N, \displaystyle 02 . Then \mathcal{R}\left(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{0}\right)=\text{tr}(\boldsymbol{\Sigma})\left(1-\frac{2(\tilde{p}-2)}{K}+\frac{(\tilde{p}-2)^{2}}{K(K-2)}\right). (7) Proof. See the Appendix, Section E . ∎ The risk expression in Equation 7 depends on the allocation of units to treatment arms only through the value of \tilde{p}=\text{tr}(\boldsymbol{\Sigma})/\lambda_{\text{max}}(\boldsymbol{\Sigma}) . Recall that 0\leq\tilde{p}\leq K . Moreover, this risk decreases monotonically as \tilde{p} increases. The following result allows us to characterize the \tilde{p} -maximizing allocation. Lemma 6 . Suppose that \left(\max_{k\geq 1}\sqrt{V_{k}}-\min_{k\geq 1}\sqrt{V_{k}}\right)\leq\frac{1}{2}\sqrt{KV_{0}}. (8) Then evaluated at the Neyman allocation \boldsymbol{n^{\star}}=(n_{0}^{\star},\dots,n_{K}^{\star}) , \frac{\partial\tilde{p}}{\partial n_{0}}>\max_{k\geq 1}\frac{\partial\tilde{p}}{\partial n_{k}}. Proof. See the Appendix, Section F . ∎ Lemma 5 tells us that, under \boldsymbol{\tau}=\boldsymbol{0} , the optimizing allocation for Bock’s estimator will be the one that makes \tilde{p} as large as possible. Lemma 6 tells us that, under a mild condition preventing extreme heteroscedasticity across the potential outcome variances, the \tilde{p} -maximizing allocation will assign more units to the control arm than the Neyman allocation. Next, we extend our reasoning from the case in which \boldsymbol{\tau}=\boldsymbol{0} to the low signal-to-noise regime. We define the signal-to-noise ratio as \kappa=\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\tau} and suppose \kappa\leq\epsilon for a sufficiently small value of \epsilon . A first-order expansion of the risk in Eq. 6 around \kappa=0 yields \mathcal{R}\left(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{\tau}\right)=\mathcal{R}\left(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{0}\right)+\frac{1}{K-2}\left(\frac{2(\tilde{p}-2)}{K}-\frac{\tilde{p}^{2}-4}{K^{2}}\right)\text{tr}(\boldsymbol{\Sigma})\cdot\kappa+\mathcal{O}(\kappa^{2}). (9) At the Neyman allocation \boldsymbol{n^{\star}} and under the fixed-budget constraint \sum_{k=0}^{K}n_{k}=N , the first-order variation of \text{tr}(\boldsymbol{\Sigma}) is zero. This means that a Taylor approximation to the function will have zero coefficient on the linear term in any direction that satisfies the constraint. Thus, near the Neyman allocation, the risk expansion in Equation 9 depends on the treatment allocation only through \tilde{p} and \kappa=\boldsymbol{\tau}^{\top}\boldsymbol{\Sigma}^{-1}\boldsymbol{\tau} up to first order. Moreover, the latter dependency is assumed small due to the \kappa\leq\epsilon constraint. Finally, while the second term is increasing in \tilde{p} , this dependency is similarly small due to the multiplicative dependency on small \kappa . Equation 9 shows that, locally to the Neyman Allocation and in the low signal-to-noise regime, \mathcal{R}(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{\tau}) is a small perturbation of \mathcal{R}(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{0}) . Thus, for sufficiently small \kappa , the risk-minimizing allocation for \mathcal{R}(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{\tau}) is close to a \tilde{p} -maximizing allocation at \boldsymbol{\tau}=\boldsymbol{0} . Hence, in the relevant setting, we have shown that the minimizer of Bock’s estimator will tend to assign more units to the control arm than the Neyman allocation. 4.2.2 SURE-Min Estimator The SURE-minimizing estimator \boldsymbol{\hat{\delta}_{S}} does not admit a closed-form risk expression when \boldsymbol{\tau}=0 . Hence, we rely on a sequence of approximations to characterize the behavior of risk-minimizing allocations. Applying Lemma 1 yields \displaystyle\mathcal{R}\left(\boldsymbol{\hat{\delta}_{S}},\boldsymbol{\tau}\right) \displaystyle=\text{tr}(\boldsymbol{\Sigma})+4\text{tr}(\boldsymbol{\Sigma})\,\mathbb{E}\left(\frac{\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\hat{\tau}}}{\|\boldsymbol{\hat{\tau}}\|_{2}^{4}}\right)-\text{tr}(\boldsymbol{\Sigma})^{2}\,\mathbb{E}\left(\frac{1}{\|\boldsymbol{\hat{\tau}}\|_{2}^{2}}\right). (10) The expectations are not analytically tractable. To obtain a usable approximation, we approximate the Gaussian quadratic forms appearing in Equation 10 using the moment-matching approach of 35 . Namely, we approximate \|\boldsymbol{\hat{\tau}}\|_{2}^{2}\sim\text{Gamma}\!\left(\frac{m^{2}}{v},\frac{v}{m}\right), where m:=\mathbb{E}\!\left(\|\boldsymbol{\hat{\tau}}\|_{2}^{2}\right)=\text{tr}(\boldsymbol{\Sigma})+\|\boldsymbol{\tau}\|_{2}^{2},\qquad v:=\text{var}\!\left(\|\boldsymbol{\hat{\tau}}\|_{2}^{2}\right)=2\text{tr}(\boldsymbol{\Sigma}^{2})+4\,\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\tau}. Via this approximation, we obtain a tractable expression for the reciprocal expectation appearing in Equation 10 : \mathbb{E}\left(\frac{1}{\|\boldsymbol{\hat{\tau}}\|_{2}^{2}}\right)\;\approx\;\frac{\text{tr}(\boldsymbol{\Sigma})+\|\boldsymbol{\tau}\|_{2}^{2}}{\big(\text{tr}(\boldsymbol{\Sigma})+\|\boldsymbol{\tau}\|_{2}^{2}\big)^{2}-2\text{tr}(\boldsymbol{\Sigma}^{2})-4\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\tau}}. To approximate the ratio expectation, we employ the crude approximation \boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\hat{\tau}}\;\approx\;\frac{\mathbb{E}\!\left(\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\hat{\tau}}\right)}{\mathbb{E}\!\left(\|\boldsymbol{\hat{\tau}}\|_{2}^{2}\right)}\,\|\boldsymbol{\hat{\tau}}\|_{2}^{2}, which holds exactly when \boldsymbol{\Sigma} is proportional to the identity. Using \mathbb{E}\!\left(\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\hat{\tau}}\right)=\text{tr}(\boldsymbol{\Sigma}^{2})+\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\tau}, this yields the approximation \mathbb{E}\left(\frac{\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\hat{\tau}}}{\|\boldsymbol{\hat{\tau}}\|_{2}^{4}}\right)\;\approx\;\frac{\text{tr}(\boldsymbol{\Sigma}^{2})+\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\tau}}{\text{tr}(\boldsymbol{\Sigma})+\|\boldsymbol{\tau}\|_{2}^{2}}\,\mathbb{E}\left(\frac{1}{\|\boldsymbol{\hat{\tau}}\|_{2}^{2}}\right). Substituting these approximations into Equation 10 yields a closed-form approximation to the risk. In the low signal-to-noise regime, we treat \|\boldsymbol{\tau}\|_{2}^{2} and \boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\tau} as small relative to \text{tr}(\boldsymbol{\Sigma}) and \text{tr}(\boldsymbol{\Sigma}^{2}) , and retain only the leading terms obtained by setting \boldsymbol{\tau}=\boldsymbol{0} inside the approximations. This yields \mathcal{R}(\boldsymbol{\hat{\delta}_{S}},\boldsymbol{\tau})\approx\text{tr}(\boldsymbol{\Sigma})\left(1+\frac{4\text{tr}(\boldsymbol{\Sigma}^{2})-\text{tr}(\boldsymbol{\Sigma})^{2}}{\text{tr}(\boldsymbol{\Sigma})^{2}-2\text{tr}(\boldsymbol{\Sigma}^{2})}\right). (11) We recall that the risk of the difference-in-means estimator is simply \text{tr}(\boldsymbol{\Sigma}) , so the Neyman allocation \boldsymbol{n}^{\star} minimizes \text{tr}(\boldsymbol{\Sigma}) subject to the sample size constraint \sum_{k=0}^{K}n_{k}=N . As a result, small reallocations of units to arms around \boldsymbol{n}^{\star} that respect this constraint leave the value of \text{tr}(\boldsymbol{\Sigma}) essentially unchanged. However, such reallocations generally alter the value of \text{tr}(\boldsymbol{\Sigma}^{2}) . Moreover, for a given value of \text{tr}(\boldsymbol{\Sigma}) , the approximate risk in Equation ( 11 ) increases with \text{tr}(\boldsymbol{\Sigma}^{2}) . Hence, near the Neyman allocation, the SURE-minimizing allocation can be viewed as one that preserves \text{tr}(\boldsymbol{\Sigma}) while making \text{tr}(\boldsymbol{\Sigma}^{2}) as small as possible. We use the derivative to characterize the most efficient means of decreasing \text{tr}(\boldsymbol{\Sigma}^{2}) . Because \text{tr}(\boldsymbol{\Sigma}^{2})=K^{2}\frac{V_{0}^{2}}{n_{0}^{2}}+2\frac{V_{0}}{n_{0}}\sum_{k=1}^{K}\frac{V_{k}}{n_{k}}+\sum_{k=1}^{K}\frac{V_{k}^{2}}{n_{k}^{2}}, we see that \frac{\partial\text{tr}(\boldsymbol{\Sigma}^{2})}{\partial n_{0}}=-\frac{2V_{0}}{n_{0}^{2}}\left(K^{2}\frac{V_{0}}{n_{0}}+\sum_{k=1}^{K}\frac{V_{k}}{n_{k}}\right)\hskip 14.22636pt\text{ and }\hskip 14.22636pt\frac{\partial\text{tr}(\boldsymbol{\Sigma}^{2})}{\partial n_{k}}=-\frac{2V_{k}}{n_{k}^{2}}\left(\frac{V_{0}}{n_{0}}+\frac{V_{k}}{n_{k}}\right),\hskip 5.69054ptk=1,\dots,K. Evaluated at the Neyman allocation, these are \frac{\partial\text{tr}(\boldsymbol{\Sigma}^{2})}{\partial n_{0}}=-2S_{\text{NA}}^{3}\left(\sqrt{KV_{0}}+\frac{1}{K}\sum_{k=1}^{K}\sqrt{V_{k}}\right)\hskip 14.22636pt\text{ and }\hskip 14.22636pt\frac{\partial\text{tr}(\boldsymbol{\Sigma}^{2})}{\partial n_{k}}=-2S_{\text{NA}}^{3}\left(\sqrt{\frac{V_{0}}{K}}+\sqrt{V_{k}}\right). (12) The expressions in ( 12 ) allow us to quantify which arms will be allocated more units. Unless V_{0} is extremely small relative to the other V_{k} values, the derivative with respect to n_{0} will be much larger in magnitude than the other derivatives. Hence, the \mathcal{R}(\boldsymbol{\hat{\delta}_{S}},\tau) -minimizing allocation optimizer will again shift units toward the control arm relative to the Neyman Allocation; this strategy is the most efficient way to decrease \text{tr}(\boldsymbol{\Sigma}^{2}) while leaving \text{tr}(\boldsymbol{\Sigma}) essentially unchanged. Moreover, among the active treatments, we observe that \partial\text{tr}(\boldsymbol{\Sigma}^{2})/\partial n_{k} is more negative when V_{k} is larger. Hence, the SURE-Min risk minimizer will also tend to reallocate units toward the treatment arms with the largest potential outcome variances. 4.2.3 Dimmery’s Estimator Lastly, Dimmery’s estimator \boldsymbol{\hat{\delta}_{\textbf{D}}} also only admits a heuristic analysis, and we again focus on the low signal-to-noise regime. Using Lemma 1 , its risk can be written as \mathcal{R}\left(\boldsymbol{\hat{\delta}_{\textbf{D}}},\boldsymbol{\tau}\right)=\text{tr}(\boldsymbol{\Sigma})+\mathbb{E}\left(\frac{(K-2)^{2}}{||\boldsymbol{\hat{\tau}}||_{2}^{4}}\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}_{\star}^{2}\boldsymbol{\hat{\tau}}+\frac{4(K-2)}{||\boldsymbol{\hat{\tau}}||_{2}^{4}}\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\Sigma}_{\star}\boldsymbol{\hat{\tau}}-\frac{2(K-2)\text{tr}(\boldsymbol{\Sigma}_{\star}^{2})}{||\boldsymbol{\hat{\tau}}||_{2}^{2}}\right), (13) where \boldsymbol{\Sigma}_{\star} is the diagonal matrix whose diagonal entries are equal to the diagonal entries of \boldsymbol{\Sigma} . To estimate this quantity, we assume the signal-to-noise ratio is small such that \boldsymbol{\tau} is small and \boldsymbol{\hat{\tau}} behaves approximately as \mathcal{N}(\boldsymbol{0},\boldsymbol{\Sigma}) . We employ the same two crude approximations from the prior section, namely \mathbb{E}\left(\frac{1}{||\boldsymbol{\hat{\tau}}||_{2}^{2}}\right)\approx\frac{1}{\text{tr}(\boldsymbol{\Sigma})},\hskip 14.22636pt\text{ and }\hskip 14.22636pt\mathbb{E}\left(\frac{\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{A}\boldsymbol{\hat{\tau}}}{||\boldsymbol{\hat{\tau}}||_{2}^{4}}\right)\approx\frac{\mathbb{E}(\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{A}\boldsymbol{\hat{\tau}})}{\text{tr}(\boldsymbol{\Sigma})^{2}}=\frac{\text{tr}(\boldsymbol{A}\boldsymbol{\Sigma})}{\text{tr}(\boldsymbol{\Sigma})^{2}}, where \boldsymbol{A} is any symmetric matrix. Applying these approximations to Equation 13 gives the proxy value \mathcal{R}\left(\boldsymbol{\hat{\delta}_{\textbf{D}}},\boldsymbol{\tau}\right)\approx\text{tr}(\boldsymbol{\Sigma})+\frac{(K-2)^{2}\text{tr}(\boldsymbol{\Sigma}_{\star}^{2}\boldsymbol{\Sigma})+4(K-2)\text{tr}(\boldsymbol{\Sigma}\boldsymbol{\Sigma}_{\star}\boldsymbol{\Sigma})}{\text{tr}(\boldsymbol{\Sigma})^{2}}-\frac{2(K-2)\text{tr}(\boldsymbol{\Sigma}_{\star}^{2})}{\text{tr}(\boldsymbol{\Sigma})}. (14) To make Expression 14 more explicit, recall that each diagonal entry of \boldsymbol{\Sigma} and \boldsymbol{\Sigma}_{\star} is equal to V_{k}/n_{k}+V_{0}/n_{0} . Hence, \displaystyle\text{tr}(\boldsymbol{\Sigma}_{\star}^{2})=\sum_{k=1}^{K}\left(\frac{V_{k}}{n_{k}}+\frac{V_{0}}{n_{0}}\right)^{2},\hskip 7.11317pt \displaystyle\hskip 7.11317pt\text{tr}(\boldsymbol{\Sigma}_{\star}^{2}\boldsymbol{\Sigma})=\sum_{k=1}^{K}\left(\frac{V_{k}}{n_{k}}+\frac{V_{0}}{n_{0}}\right)^{3},\text{ and } \displaystyle\text{tr}(\boldsymbol{\Sigma}\boldsymbol{\Sigma}_{\star}\boldsymbol{\Sigma}) \displaystyle=\sum_{k=1}^{K}\left(\frac{V_{k}}{n_{k}}+\frac{V_{0}}{n_{0}}\right)^{3}+(K-1)\left(\frac{V_{0}}{n_{0}}\right)^{2}\sum_{k=1}^{K}\left(\frac{V_{k}}{n_{k}}+\frac{V_{0}}{n_{0}}\right). Again, we recall that the Neyman allocation \boldsymbol{n}^{\star} minimizes \text{tr}(\boldsymbol{\Sigma}) subject to \sum_{k=0}^{K}n_{k}=N . As for the SURE-Min estimator, small reallocations around \boldsymbol{n}^{\star} that respect the sample size constraint leave \text{tr}(\boldsymbol{\Sigma}) essentially unchanged, but can change \text{tr}(\boldsymbol{\Sigma}_{\star}^{2}),\text{tr}(\boldsymbol{\Sigma}_{\star}^{2}\boldsymbol{\Sigma}), and \text{tr}(\boldsymbol{\Sigma}\boldsymbol{\Sigma}_{\star}\boldsymbol{\Sigma}) . Holding \text{tr}(\boldsymbol{\Sigma}) fixed, Expression 14 decreases with \text{tr}(\boldsymbol{\Sigma}_{\star}^{2}) and increases with \text{tr}(\boldsymbol{\Sigma}_{\star}^{2}\boldsymbol{\Sigma}) and \text{tr}(\boldsymbol{\Sigma}\boldsymbol{\Sigma}_{\star}\boldsymbol{\Sigma}) . Intuitively, we observe that increasing n_{0} reduces every such diagonal entry simultaneously. Thus, increasing the size of the control arm has the effect of most rapidly decreasing the cubic contributions of \sum_{k=1}^{K}\left(\frac{V_{k}}{n_{k}}+\frac{V_{0}}{n_{0}}\right)^{3} within both \text{tr}(\boldsymbol{\Sigma}_{\star}^{2}\boldsymbol{\Sigma}) and \text{tr}(\boldsymbol{\Sigma}\boldsymbol{\Sigma}_{\star}\boldsymbol{\Sigma}) , while increasing the quadratic quantities in \text{tr}(\boldsymbol{\Sigma}_{\star}^{2}) more slowly and leaving \text{tr}(\boldsymbol{\Sigma}) nearly unchanged. Likewise, among active treatment arms, shifting units from a low-variance arm to a high-variance arm (i.e. increasing n_{k} when V_{k} is large and decreasing n_{j} when V_{j} is small, under the sample size constraint) tends to equalize the \frac{V_{k}}{n_{k}} terms. This shift reduces the variability across the \left(\frac{V_{k}}{n_{k}}+\frac{V_{0}}{n_{0}}\right) values and thus again most directly lowers the aggregate cubic contributions. Thus, a heuristic analysis points toward similar behavior among the minimizers of \boldsymbol{\hat{\delta}_{S}} and \boldsymbol{\hat{\delta}_{\textbf{D}}} . Relative to Neyman, both minimizing allocations will tend to increase n_{0} and shift more units toward treatment arms with larger values of V_{k} . In contrast, the minimizer of Bock’s estimator \boldsymbol{\hat{\delta}_{B}} will increase n_{0} , but will not prioritize high-variance arms. 4.3 Simulated Static Allocations To complement our heuristic analysis, we conduct simulations in simple regimes where the potential outcome variances \boldsymbol{V}=(V_{0},\dots,V_{K}) are known. For each setting, we compute the non-adaptive Neyman allocation \boldsymbol{n}^{\star} and compare it to the allocations that minimize the risk of each shrinkage estimator. This strategy allows us to empirically assess how minimizing the risks of \boldsymbol{\hat{\delta}_{B}},\boldsymbol{\hat{\delta}_{S}},\boldsymbol{\hat{\delta}_{\textbf{D}}} perturb the baseline Neyman allocation. 4.3.1 Computing Risk-Minimizing Allocations Denote as \mathcal{R}_{\boldsymbol{\hat{\delta}}}(\boldsymbol{n},\boldsymbol{V},\boldsymbol{\tau}) the risk of estimator \boldsymbol{\hat{\delta}} evaluated at allocation \boldsymbol{n} under potential outcome variances \boldsymbol{V} and true treatment effects \boldsymbol{\tau} . Notably, \mathcal{R}_{\boldsymbol{\hat{\delta}}}(\boldsymbol{n},\boldsymbol{V},\boldsymbol{\tau}) is not a convex function of the allocations n_{0},\dots,n_{K} for any of our shrinkage estimators. Hence, practically, we achieve the risk minimizations through a greedy swapping algorithm. Define \boldsymbol{n^{(j)}}=\{n_{0}^{(j)},\dots,n_{K}^{(j)}\}\in\mathbb{Z}^{K+1} as the allocation of units to treatment arms at iteration j of the algorithm. Next, define the set of potential swaps D^{(j)}=\{\boldsymbol{n}\in\mathbb{Z}^{K+1}\mid\text{ $\boldsymbol{n}$ swaps exactly one unit across treatment arms from }\boldsymbol{n^{(j)}}\}\,. Because there are K+1 treatment arms, the “swap set” D^{(j)} will contain K(K+1) possible allocations. At each iteration of the algorithm, we simply move in the direction of the swap that most reduces the risk. This approach is encoded below, in Algorithm 15 : \displaystyle\texttt{Start with the Neyman allocation $\boldsymbol{n^{(0)}}=\boldsymbol{n^{\star}}$.}\hskip 156.49014pt (15) \displaystyle\texttt{For iteration $j=1,2,\dots$:} \displaystyle\texttt{For each potential allocation $\boldsymbol{n}\in D^{(j-1)}$:} \displaystyle\texttt{Compute $\mathcal{R}_{\boldsymbol{\hat{\delta}}}(\boldsymbol{n},\boldsymbol{V},\boldsymbol{\tau})$. } \displaystyle\texttt{Set $\boldsymbol{n^{(j)}}=\argmin_{\boldsymbol{n}\in D^{(j-1)}}\mathcal{R}_{\boldsymbol{\hat{\delta}}}(\boldsymbol{n},\boldsymbol{V},\boldsymbol{\tau})$} \displaystyle\texttt{If $\mathcal{R}_{\boldsymbol{\hat{\delta}}}(\boldsymbol{n^{(j)}},\boldsymbol{V},\boldsymbol{\tau})>=\mathcal{R}_{\boldsymbol{\hat{\delta}}}(\boldsymbol{n^{(j-1)}},\boldsymbol{V},\boldsymbol{\tau})$} \displaystyle\texttt{Return $\boldsymbol{n^{(j-1)}}$.} For details on how \mathcal{R}_{\boldsymbol{\hat{\delta}}}(\boldsymbol{n},\boldsymbol{V},\boldsymbol{\tau}) is computed, see Section 5.1 . Additionally, while Algorithm 15 could plausibly get stuck at local minima, we find in practice that the algorithm’s output tends to be unchanged regardless of the starting point. 4.3.2 Simulation Setup We simulate data given a variety of data-generating regimes. Throughout, we fix the total sample size at N=1,000 and compute, for each setting, the Neyman allocation \boldsymbol{n}^{\star} as well as the allocations that minimize the risks of \boldsymbol{\hat{\delta}_{B}} , \boldsymbol{\hat{\delta}_{S}} , and \boldsymbol{\hat{\delta}_{\textbf{D}}} using the greedy swapping approach (Algorithm 15 ). We alter four key features across our simulations: the number of treatment arms K ; the magnitude of the control potential outcome variance V_{0} relative to the active treatment-arm variances \{V_{k}\}_{k=1}^{K} ; the sparsity of \boldsymbol{\tau} ; and the signal-to-noise ratio \kappa=\boldsymbol{\tau}^{\top}\boldsymbol{\Sigma_{\textbf{NA}}}^{-1}\boldsymbol{\tau} . To sample the potential outcome variances, we first sample V_{k} for the active treatment arms k=1,\dots K are drawn i.i.d. from a log normal distribution with log-location parameter of \log(350) and log-standard-deviation parameter 0.60 . These values are then sorted such that V_{1}=V_{(1)},\dots,V_{k}=V_{(K)} ; this sorting will later help us to reason about reallocations across active treatment arms according to their relative variances. Next, we consider two control-variance regimes. In the low-control-variance regime, V_{0} is equal to half of the average treatment arm potential outcome variance, i.e. V_{0}=\tfrac{1}{2}\cdot K^{-1}\sum_{k=1}^{K}V_{k} . In the high control-variance regime, V_{0} is equal to four times the average treatment arm variance, i.e. V_{0}=4\cdot K^{-1}\sum_{k=1}^{K}V_{k} . The treatment effects \boldsymbol{\tau} are sampled to ensure the desired sparsity and signal-to-noise-ratio. First, we consider two configurations for the parsimony of the“signal” \boldsymbol{\tau} . In the dense setting, an unscaled \tilde{\boldsymbol{\tau}} is sampled from a \text{Unif}([1,2]) distribution, resulting in all causal effects having comparable magnitude. In the sparse setting, \tilde{\boldsymbol{\tau}}=(1,\dots,0) has only a single nonzero entry, which corresponds to the first arm (and thus, due to the sorting, also corresponding to the smallest potential outcome variance among the active treatment arms). Once the unscaled effects are sampled, they are scaled to give \boldsymbol{\tau} that meets the desired signal-to-noise-ratio \kappa=\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma_{\textbf{NA}}}^{-1}\boldsymbol{\tau} . We recall that \boldsymbol{\Sigma_{\textbf{NA}}} is the covariance matrix at the Neyman allocation. Hence, \kappa is an approximation to the signal-to-noise ratio at the true minimizer, as the covariance matrix itself changes as we reallocate units across treatment arms. Tables 1 and 2 report the results of all the simulations, across the grid of regimes: K\in\{6,12\},\qquad V_{0}\in\{\texttt{low},\texttt{high}\},\qquad\boldsymbol{\tau}\in\{\texttt{dense},\texttt{sparse}\},\qquad\kappa\in\{0,3,9\}. Note that when \kappa=0 , we must have \boldsymbol{\tau}=\boldsymbol{0} , so \boldsymbol{\tau} is neither dense nor sparse. This setting is reflected in the tables with a “ - ” symbol in the “ \boldsymbol{\tau} shape” column. 4.3.3 Simulation Results In the simulation results, we compare how the different risk-minimization allocations differ in the relative sizes of different treatment arms, compared to the Neyman allocation. These simulations do not evaluate the performance of any of the risk-minimization allocations, because the oracle setting is not a realistic setting for evaluating performance. Section 5 contains simulations that evaluate performance in an adaptive setting. Large reallocations to the control arm, attenuated by signal strength. Table 1 shows the share of units allocated to the control arm across all settings and designs. The allocations reflect the most stable pattern in our simulations: all shrinkage-risk-minimizing designs allocate more units to control than the Neyman Allocation, with the magnitude of this reallocation mediated by signal strength, dimension, and the sparsity of the treatment effects. Reallocations toward control are largest with no signal, \kappa=0 ; attenuate modestly with moderate signal, \kappa=3 ; and are typically small with large signal, \kappa=9 . Moreover, reallocations toward control are typically larger when there are more arms, K=12 compared to K=6 . These patterns are consistent across both control-variance regimes. Table 1 also reveals that the distinction between sparse and dense treatment effects plays an important role in determining the magnitude of control reallocations, particularly for Bock’s estimator \boldsymbol{\hat{\delta}_{B}} . When \kappa>0 , reallocations toward control under \boldsymbol{\hat{\delta}_{B}} are substantially larger when \boldsymbol{\tau} is sparse than when it is dense, often by a wide margin. In several settings, sparse signals lead to control reallocations for Bock that are comparable to, or even exceed, those observed at \kappa=0 , whereas dense signals produce markedly more moderate shifts. This pattern mirrors our heuristic investigation, which showed that the risk-minimizing allocations for all estimators favor more control units relative to the Neyman allocation \boldsymbol{n^{\star}} . However, the behavior is not uniform across estimators. Generally, the minimizing assignment for Bock’s estimator \boldsymbol{\hat{\delta}_{B}} exhibits the largest reallocation toward control, followed by the SURE-min estimator \boldsymbol{\hat{\delta}_{S}} and then Dimmery’s estimator \boldsymbol{\hat{\delta}_{\textbf{D}}} . For the SURE-min and Dimmery estimators, the sparse vs. dense distinction is considerably less pronounced: reallocations toward control are modestly larger under sparse signals, but the key driver of control reallocation for these estimators is simply the overall signal-to-noise ratio. An exception to the ordering of control reallocation across the shrinkage estimators is visible only in the high- V_{0} regime, with nonzero \kappa and dense \boldsymbol{\tau} . In these simulations, reallocations toward control are typically larger for the SURE-min estimator than for Bock’s estimator. Otherwise, Bock’s estimator exhibits the strongest and most persistent preference for allocating additional units to the control arm. Reallocations across active treatment arms. Beyond reallocations toward the control arm, the risk-minimizing designs also differ in how they redistribute samples across the active treatment arms. Table 2 reports reallocations toward treatment arm 1 and toward treatment arm K , measured relative to the Neyman allocation. Recall that treatment arm 1 has the smallest potential outcome variance among the active treatments, and the sole nonzero signal when \boldsymbol{\tau} is sparse. Treatment arm K has the largest potential outcome variance among the active treatments. In the case of Bock’s estimator, the allocation to active treatment arms does not vary substantially across regimes. The minimizing allocations for Bock’s estimator never increase the share of units assigned to the first active treatment arm, and frequently reduce this share. The same behavior is evident for the K^{th} treatment arm. The behavior is essentially insensitive to the dimension, control arm variance, sparsity of \boldsymbol{\tau} , and signal to noise ratio \kappa . This pattern reflects the central tendency of the minimization for Bock’s estimator, which focuses almost exclusively on reallocating units to the control arm in order to reduce the shrinker risk. The minimizing allocations for the SURE-min estimator are more variable. The risk minimizer allocates units away from treatment arm 1 when the signal-to-noise ratio is small, but tends to allocate units toward the arm when \kappa grows, especially when the signal is sparse. Meanwhile, units are never allocated toward the K^{th} treatment arm, and are typically allocated away from it. Dimmery’s estimator exhibits the most variable behavior across simulation conditions. When the signal-to-noise ratio is zero or when the signal is dense, the minimizer either allocates fewer units to the first treatment arm, or just a few more units. However, in the case of a sparse signal, Dimmery’s estimator allocates many more units to the first treatment arm, exhibiting a strong preference for “overweighting” the arm with a strong signal, even though that arm exhibits low potential outcome variances. These allocations also uniformly allocate units away from the K^{th} treatment arm, doing so most dramatically in the sparse- \boldsymbol{\tau} regime. Table 1 : Risk-minimizing allocations for N=1{,}000 : control share. K V_{0} regime \boldsymbol{\tau} shape \kappa Neyman n_{0}^{\star}/N Bock \Delta n_{0}/N SURE-min \Delta n_{0}/N Dimmery \Delta n_{0}/N 6 high - 0 0.40 +0.22 +0.14 +0.11 6 high dense 3 0.39 +0.09 +0.10 +0.07 6 high sparse 3 0.40 +0.16 +0.09 +0.08 6 high dense 9 0.40 +0.03 +0.07 +0.05 6 high sparse 9 0.39 +0.08 +0.04 +0.07 6 low - 0 0.22 +0.23 +0.07 +0.05 6 low dense 3 0.23 +0.09 +0.07 +0.05 6 low sparse 3 0.18 +0.16 +0.03 +0.03 6 low dense 9 0.22 +0.03 +0.05 +0.04 6 low sparse 9 0.19 +0.10 +0.02 +0.04 12 high - 0 0.31 +0.34 +0.15 +0.13 12 high dense 3 0.32 +0.11 +0.12 +0.10 12 high sparse 3 0.30 +0.32 +0.14 +0.12 12 high dense 9 0.30 +0.05 +0.08 +0.07 12 high sparse 9 0.33 +0.18 +0.12 +0.14 12 low - 0 0.16 +0.35 +0.08 +0.07 12 low dense 3 0.15 +0.17 +0.07 +0.05 12 low sparse 3 0.17 +0.33 +0.06 +0.06 12 low dense 9 0.15 +0.06 +0.06 +0.05 12 low sparse 9 0.15 +0.26 +0.04 +0.07 \Delta n_{0} represents the change in the proportion of units allocated to the control arm relative to the Neyman allocation n_{0}^{\star} . Table 2 : Risk-minimizing allocations for N=1{,}000 : reallocations toward treatment arm 1 and treatment arm K . K V_{0} regime \boldsymbol{\tau} shape \kappa \Delta n_{1}/N \Delta n_{K}/N Bock SURE-min Dimmery Bock SURE-min Dimmery 6 high - 0 -0.03 -0.03 -0.03 -0.04 -0.02 -0.01 6 high dense 3 -0.01 -0.01 +0.02 -0.02 -0.02 -0.02 6 high sparse 3 -0.03 +0.02 +0.07 -0.03 -0.02 -0.03 6 high dense 9 +0.00 +0.00 +0.01 -0.01 -0.02 -0.03 6 high sparse 9 -0.02 +0.04 +0.10 -0.01 -0.02 -0.06 6 low - 0 -0.04 -0.02 -0.03 -0.03 -0.01 -0.01 6 low dense 3 -0.02 -0.01 +0.02 +0.00 +0.00 -0.01 6 low sparse 3 -0.05 +0.03 +0.12 -0.02 -0.01 -0.08 6 low dense 9 -0.01 -0.01 +0.00 -0.01 -0.01 -0.01 6 low sparse 9 -0.04 +0.05 +0.13 -0.01 -0.01 -0.10 12 high - 0 -0.02 -0.02 -0.02 -0.02 -0.01 -0.01 12 high dense 3 -0.01 -0.01 +0.00 +0.00 -0.01 -0.01 12 high sparse 3 -0.03 +0.00 +0.06 +0.00 -0.01 -0.05 12 high dense 9 +0.00 +0.00 +0.01 -0.01 -0.01 -0.01 12 high sparse 9 -0.02 +0.01 +0.07 +0.00 -0.01 -0.06 12 low - 0 -0.02 -0.01 -0.02 -0.01 +0.00 +0.00 12 low dense 3 -0.01 -0.01 -0.02 -0.01 +0.00 +0.00 12 low sparse 3 -0.03 +0.00 +0.08 +0.01 +0.00 -0.06 12 low dense 9 -0.01 -0.01 -0.01 -0.01 -0.01 -0.01 12 low sparse 9 -0.02 +0.02 +0.09 +0.00 -0.01 -0.07 \Delta n_{1} and \Delta n_{K} denote the change in the proportion of units allocated to treatment arms 1 and K , respectively, relative to the Neyman allocation values n_{1}^{\star} and n_{K}^{\star} . Positive values indicate reallocations toward the corresponding arm. Figures 1 , 2 , and 3 provide three representative visual summaries of risk-minimizing allocations when K=12 . Figure 1 demonstrates the tendency of all shrinker-risk-minimizers – especially Bock’s estimator \boldsymbol{\hat{\delta}_{B}} – to reallocate sample toward the control arm. Figure 2 shows how this pattern attenuates at larger values of the signal-to-noise ratio, especially for \boldsymbol{\hat{\delta}_{S}} and \boldsymbol{\hat{\delta}_{\textbf{D}}} . Figure 3 reflects how, other things equal, the \boldsymbol{\hat{\delta}_{\textbf{D}}} -minimizing allocation tends to assign units to the arm with strong signal when \boldsymbol{\tau} is sparse. Figure 1 : Oracle allocations for K=12 and N=1,000 with low control variance, and \kappa=0 . All shrinker-risk-minimizing designs shift mass toward the control arm relative to the Neyman allocation, with the largest control shift under Bock’s estimator \boldsymbol{\hat{\delta}_{B}} . SURE-min \boldsymbol{\hat{\delta}_{S}} and Dimmery \boldsymbol{\hat{\delta}_{\textbf{D}}} exhibit the same trend but with smaller magnitude. Figure 2 : Oracle allocations for K=12 and N=1,000 with low control variance, \kappa=9 , and dense \boldsymbol{\tau} . Compared to the \kappa=0 case (Figure 1 ), the shrinkage-driven preference for allocating additional units to control is substantially reduced for all estimators, especially the Bock estimator (though it still favors the control arm most among the three shrinkers). Figure 3 : Oracle allocations for K=12 and N=1,000 with low control-variance regime, \kappa=9 , and sparse \boldsymbol{\tau} . Here, we see two key trends. First, the control reallocation for Bock’s estimator is much larger than in the otherwise-identical case in which \boldsymbol{\tau} is dense (Figure 2 ). This reflects the dependency of the minimizing allocation for Bock’s estimator on the signal density. Second, we see that the minimizing allocation for Dimmery’s estimator – but not the Bock or SURE-min estimator – tends to allocate more units to the treatment arm with strong signal when \boldsymbol{\tau} is sparse. 5 Adaptive Risk Minimization The approach in Section 4 allows us to characterize the risk-minimizing designs, but it does not provide a pathway to sequential adaptivity because the parameters are assumed known in the design phase. In this section, we introduce a simple algorithm for an adaptive experiment that seeks to minimize the risk of \boldsymbol{\hat{\delta}_{B}},\boldsymbol{\hat{\delta}_{S}} , or \boldsymbol{\hat{\delta}_{\textbf{D}}} . 5.1 Efficient Risk Computation For each of our candidate estimators, we can use Equation 1 to obtain the risk. In each case, the resultant expression is a linear combination of ratios of Gaussian quadratic forms. We use \boldsymbol{\hat{\delta}_{B}} as our motivating example. As discussed in Section 4 \displaystyle\mathcal{R}\left(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{\tau}\right) \displaystyle=\text{tr}(\boldsymbol{\Sigma})+\mathbb{E}\left(\frac{(\tilde{p}-2)^{2}||\boldsymbol{\hat{\tau}}||_{2}^{2}}{(\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\hat{\tau}})^{2}}-\frac{2(\tilde{p}-2)}{\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\hat{\tau}}}\text{tr}(\boldsymbol{\Sigma})+\frac{4(\tilde{p}-2)||\boldsymbol{\hat{\tau}}||_{2}^{2}}{(\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\hat{\tau}})^{2}}\right) (16) \displaystyle=\text{tr}(\boldsymbol{\Sigma})+(\tilde{p}^{2}-4)\mathbb{E}\left(\frac{||\boldsymbol{\hat{\tau}}||_{2}^{2}}{(\boldsymbol{\hat{\tau}}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\hat{\tau}})^{2}}\right)-2(\tilde{p}-2)\text{tr}(\boldsymbol{\Sigma})\mathbb{E}\left(\frac{1}{\boldsymbol{\hat{\tau}}^{\top}\boldsymbol{\Sigma}^{-1}\boldsymbol{\hat{\tau}}}\right). Recall that \boldsymbol{\hat{\tau}} is approximately normally distributed. Hence, the two quantities whose expectations we need are ratios of Gaussian quadratic forms. Results from 5 provide a simple procedure to turn these expectations into numerical integrals, which can be computed efficiently. Observe that we can rewrite the risk as \mathcal{R}\left(\boldsymbol{\hat{\delta}_{B}},\boldsymbol{\tau}\right)=\text{tr}(\boldsymbol{\Sigma})+(\tilde{p}^{2}-4)\mathbb{E}\left(\frac{\boldsymbol{\theta}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\theta}}{\left(\boldsymbol{\theta}^{\mathsf{T}}\boldsymbol{\theta}\right)^{2}}\right)-2(\tilde{p}-2)\text{tr}(\boldsymbol{\Sigma})\mathbb{E}\left(\frac{1}{\left(\boldsymbol{\theta}^{\mathsf{T}}\boldsymbol{\theta}\right)}\right) where \boldsymbol{\theta}=\boldsymbol{\Sigma}^{-1/2}\boldsymbol{\hat{\tau}}\sim\mathcal{N}\left(\boldsymbol{\Sigma}^{-1/2}\boldsymbol{\tau},\boldsymbol{I_{K}}\right) . All we’ve done is re-express the expectations in terms of a standard multivariate random variable, which is helpful for applying the 5 results. A direct application of the results in 5 yields the following integral expressions: \displaystyle\mathbb{E}\left(\frac{\boldsymbol{\theta}^{\mathsf{T}}\boldsymbol{\Sigma}\boldsymbol{\theta}}{(\boldsymbol{\theta}^{\mathsf{T}}\boldsymbol{\theta})^{2}}\right) \displaystyle=\int_{0}^{\infty}(1+2t)^{-K/2}\cdot\exp\bigg(-(\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\tau})\cdot\frac{t}{1+2t}\bigg)\cdot\bigg(\frac{\text{tr}(\boldsymbol{\Sigma})}{1+2t}+\frac{\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\tau}}{(1+2t)^{2}}\bigg)\hskip 2.84526ptt\hskip 2.84526ptdt\,,\mbox{ and} (17) \displaystyle\mathbb{E}\left(\frac{1}{\boldsymbol{\theta}^{\mathsf{T}}\boldsymbol{\theta}}\right) \displaystyle=\int_{0}^{\infty}(1+2t)^{-K/2}\cdot\exp\bigg(-(\boldsymbol{\tau}^{\mathsf{T}}\boldsymbol{\Sigma}^{-1}\boldsymbol{\tau})\cdot\frac{t}{1+2t}\bigg)dt. Crucially, the integrals in ( 17 ) are univariate, and hence can be efficiently computed to high precision. Leveraging a C++ integration into R via RCPP (( 15 ) yields further speed improvements. In Table 3 , we provide speed benchmarks in milliseconds over 1,000 repetitions for the computation of the risk of each estimator. The implementations are via RCPP, computed for different values of the problem dimension K . No effort was made to optimize the code, and further improvements at high dimension are likely possible. All benchmarks were run on a 14-inch MacBook Pro with an Apple M4 Pro processor and 24 GB of memory, running MacOS. Table 3 : Avg. computation time (milliseconds) over 1,000 iterations. Dimension K Bock ( \boldsymbol{\hat{\delta}_{B}} ) SURE-min ( \boldsymbol{\hat{\delta}_{S}} ) Dimmery ( \boldsymbol{\hat{\delta}_{\textbf{D}}} ) 4 0.0049 0.0349 0.0826 6 0.0062 0.1888 0.4608 8 0.0074 0.4956 1.1753 12 0.0117 1.0190 2.4784 16 0.0168 2.4161 5.9049 5.2 Greedy Algorithm In the adaptive design literature, there are many proposals for the cadence at which treatment assignment rules are updated. Many approaches consider a “pilot” or “warm-up” phase in which treatment assignments are non-adaptive and equal across arms, with the information collected in this phase used to determine a single assignment rule for the latter experimental phase (( 7 , 10 , 39 , 18 ) . Alternatively, treatment assignment rules may be updated in batches (( 24 , 46 ) or recomputed sequentially with each new arrival (( 23 , 12 ) . We propose a simple, greedy algorithm that combines several of these approaches. Suppose the adaptive experiment is pre-specified to involve N total units. For the first N_{\text{burn-in}}\ll N arrivals, we assign the treatment according to complete randomization, with equal probability of receiving the control or any of the K active treatments. Denote as \boldsymbol{\hat{\tau}}^{(i)} the causal estimates after arrival i (computed using the difference-in-mean estimator), and \boldsymbol{\hat{V}^{(i)}} the estimated potential outcome variances after arrival i (computed using the standard sample variance formula). Moreover, let \boldsymbol{n^{(i)}}=\left(n_{0}^{(i)},\dots n_{K}^{(i)}\right)^{\mathsf{T}}\in\mathbb{R}^{K+1} represent the total number of units assigned to each arm after arrival i , and let \boldsymbol{e}_{k}\in\mathbb{R}^{K+1} be the vector whose (k+1)^{\text{th}} entry is 1 and whose other entries are 0 . For i such that N_{\text{burn-in}}b_{1} , then: * Estimate the running mean of each arm, \hat{\mu}_{k,i} for k=0,\dots,K (e.g. running mean includes observations up to i-1 ). * Estimate the running variance of each arm, \hat{V}_{k,i} for k=0,\dots,K . * Estimate the running treatment effects using the difference-in-means estimator, \boldsymbol{\hat{\tau}}_{i} . * Estimate the running covariance matrix of the treatment effects, \hat{\boldsymbol{\Sigma}}_{i} . * Using the chosen risk function for the experiment, calculate what the estimated risk would be if the next unit were to be assigned to each arm. Define \hat{\mathcal{R}}_{k,i} as the risk if the next unit i is assigned to arm k . Recall that the risk \hat{\mathcal{R}}_{k,i} is the average expected loss over all arms. Calculate \hat{\mathcal{R}}_{k,i} for k=0,\dots,K (using \boldsymbol{\hat{\tau}}_{i} and \hat{\boldsymbol{\Sigma}}_{i} ). * Choose the arm with the smallest risk \hat{\mathcal{R}}_{k,i} and assign W_{i}=\underset{k\in 0,\dots,K}{\operatorname{argmin}}\ \hat{\mathcal{R}}_{k,i} . * Record the outcome Y_{i}^{obs}=Y_{i}(W_{i}) . • At the end of the iteration, we now have: – An N-vector of observed outcomes \boldsymbol{Y}^{obs} . – An N-vector of allocated treatments \boldsymbol{W} . – An list of N values of \boldsymbol{\hat{\tau}}_{i} and \hat{\boldsymbol{\Sigma}}_{i} . To evaluate the experiment: • First evaluate each iteration: – For each step i , compute the vector of K MSE values of each estimator. For example, the MSE for \boldsymbol{\hat{\delta}_{B}}_{i} is (\hat{\delta}_{B,k,i}-\tau_{k})^{2} for k=1,\dots K . – For each step i , calculate the “compound” MSE, which is the sum of the K MSE values. – Track trajectories of compound MSE as units arrive. • Across iterations: – Calculate the “mean trajectory” by averaging the compound MSE values across iterations, for each unit. – We now have the average compound MSE for each estimator for each unit. – Then we plot the trajectories for each estimator. Finally, we plot multiple experiments, with the same parameter DGP but different risk functions, on the same panel of plots, to evaluate which risk function and estimators produced the lowest MSE. Appendix H Additional simulation results Figure 9 : Low-variance control regime, \kappa=0 . Figure 10 : Low-variance control regime, \boldsymbol{\tau} sparse, \kappa=3 . Figure 11 : Low-variance control regime, \boldsymbol{\tau} sparse, \kappa=9 . Figure 12 : Low-variance control regime, \boldsymbol{\tau} dense, \kappa=3 . Figure 13 : Low-variance control regime, \boldsymbol{\tau} dense, \kappa=9 .