Routing, Cascades, and User Choice for LLMs Rafid Mahmood Abstract To mitigate the trade-offs between performance and costs, LLM providers route user tasks to different models based on task difficulty and latency. We study the effect of LLM routing with respect to user behavior. We propose a game between an LLM provider with two models (standard and reasoning) and a user who can re-prompt or abandon tasks if the routed model cannot solve them. The user’s goal is to maximize their utility minus the delay from using the model, while the provider minimizes the cost of servicing the user. We solve this Stackelberg game by fully characterizing the user best response and simplifying the provider problem. We observe that in nearly all cases, the optimal routing policy involves a static policy with no cascading that depends on the expected utility of the models to the user. Furthermore, we reveal a misalignment gap between the provider-optimal and user-preferred routes when the user’s and provider’s rankings of the models with respect to utility and cost differ. Finally, we demonstrate conditions for extreme misalignment where providers are incentivized to throttle the latency of the models to minimize their costs, consequently depressing user utility. The results yield simple threshold rules for single-provider, single-user interactions and clarify when routing, cascading, and throttling help or harm. 1 Introduction Large language models (LLMs) have exploded into general-purpose technologies developed by a small set of model providers that permit users to perform diverse applications via a natural language interface ( 15 ) . Often users can subscribe to a provider, who affords users access to a family of models differentiated by quality and latency 1 1 1 For a list of LLM subscriptions, see: https://research.aimultiple.com/llm-pricing/#comparing-llm-subscription-plans . . Providers face inference costs for each use that vary depending on the model and hardware ( 12 ) . This presents a tiered ecosystem with a quality-latency-cost trade-off. Providers navigate these trade-offs via LLM routing and cascading ( 4 ; 10 ) . Routing involves selecting an appropriate model per-use by reserving difficult tasks for larger, more expensive models and easier tasks for smaller, cheaper models. Cascading routes tasks over multiple rounds to smaller models first and escalating to larger ones if necessary. Routing has become industry practice, e.g., GPT-5 routes tasks between ‘a smart, efficient model that answers most questions, [and] a deeper reasoning model for harder problems’ ( 18 ) . While routing literature includes algorithms to estimate LLM performance and optimize the quality-latency-cost trade-off ( 6 ; 17 ; 5 ) , they often treat user response as exogenous. However, the prompt-based interface of LLMs implies a recurring cost for model failures if users repeatedly interact with the system ( 16 ; 9 ) . Depending on the task, if a model fails to complete it, users may be patient and prompt the model again, or give up on the task ( 3 ; 22 ; 11 ; 8 ) . In the worst case, user dissatisfaction may lead to un-subscription from the provider service. Consequently, optimizing for single-pass costs may be penny-wise but welfare-foolish. In this paper, we study the welfare gap between a single LLM provider with two models (standard and reasoning) and a user under a multi-round LLM routing game ( 20 ) . Given a task, the provider determines an initial model and a cascade rule on whether to escalate the task if the standard model fails. For each pass, the provider pays a compute cost and the user pays a latency cost (i.e., delay from model response). If the model fails to complete the task, the user may either re-prompt or churn the system, which imposes potential expected lost future revenue to the provider. We prove the Stackelberg equilibrium, by first characterizing the user best response of when to churn versus re-prompt. We then show that the provider’s problem reduces to a single-variable optimization problem that in many regimes yields simple threshold-based routing policies. Importantly, we show that cascades are rarely optimal outside specific regimes where the two models are sufficiently differentiated in value minus latency. Finally, we study the operational implications of simple routing heuristics, provider-user misalignment, and the effect of throttling latency. Figure 1 summarizes the key insights of expected user behavior and consequent routing policies. We observe: • User patience and sensitivity depend on the model net values. When both models deliver positive (respectively, negative) value, users stay (respectively, churn) regardless of routing. When the models differ, users churn or stay depending on the cascade likelihood. • Optimal routing often collapses to simple threshold rules. When models deliver similar value, the optimal policy is to route with no cascade to one of the models. In the mixed cases, some regimes reveal routing to the standard model and then cascading is optimal. • Users receive sub-optimal utility when the model quality and provider costs rank differently. Misalignment arises when the models deliver different net value, when churn penalties are low, or when cost-per-success rankings conflict with user utility rankings. • Low churn penalties can incentivize providers to throttle latency. If the likelihood of users in unsubscribing is low, then providers can lower their costs by discouraging repeated use and increasing latency, thereby deteriorating user utility. Figure 1: Key guidelines for optimal routing in the face of reactive users. User behavior depends on the state of the two models in terms of providing utility versus the delay incurred from inference compute. Provider policies must follow different thresholding rules in each region. 2 Related Literature Model routing and cascading. LLM routing and cascades aim to allocate compute across heterogeneous models to optimize accuracy, latency, and cost for each query ( 4 ; 6 ; 23 ; 10 ; 5 ) . 6 reduce calls to expensive models by predicting the difficulty of tasks and allocating easier tasks to cheaper models. Cascades extend the routing approach to escalate tasks to stronger models only when cheaper models disagree ( 4 ; 23 ) . 5 propose a unified optimization algorithm for routing and cascading to show optimal routing strategies when the overall quality of a model output with respect to a task can be estimated. This problem has grown recently to include benchmarks for tracking the performance of routers under cost and task completion ( 10 ) . Our paper builds on the behavioral aspect of routing to study when cost-optimal routing acts in a user’s best interest. Furthermore, we model the problem by treating the AI interaction via a multi-round prompting game ( 3 ; 14 ) , which naturally incorporates the single-round mechanism as a special case. Operations and costs of LLM systems. The deployment of LLM systems must factor for user engagement with respect to performance, costs, and latencies ( 2 ; 24 ) . For example, prompt-based interfaces permit users to interact with models via multiple rounds until a task is completed ( 1 ) . Consequently, the cost of a model, is evaluated via a cost-of-pass , which tracks the inference cost of a single pass of a model over the probability of the model completing the task in that pass ( 14 ; 7 ) . The number of passes in which a user interacts is also highly dependent on model quality with respect to different metrics ( 3 ) . Relatedly, 19 study interactive alignment as a Stackelberg game and show how explicit user-side costly signals can reduce the user burden of being understood. Finally, our work ties into the broader literature on game theory for LLM use 21 . 3 Main problem In this section, we formulate a Markov model of the Stackelberg game between an LLM provider routing tasks and a user deciding whether to continue using the LLM. We derive closed-form expressions for expected latencies, utilities, and costs. We motivate with the following example. Motivating scenario. Consider a user of an LLM subscription who is using the LLM to help prove a theorem. The user submits an initial prompt describing the theorem statement and the proof approach they have in mind, and the provider routes the request to either a standard model or a slower reasoning model. After seeing the output, the user either accepts it and stops, or continues the session with a follow-up prompt (e.g., “justify the inequality in line 3”) if the proof is incomplete or incorrect. The provider routes the follow-up prompt again, potentially escalating to the reasoning model. If this repeats for multiple prompts, the user may decide to stop outsourcing this task to the LLM; if this experience repeats for multiple theorems, they may eventually cancel the subscription. 3.1 Markov model of LLM routing with user response Consider a provider with two LLMs (e.g., standard and reasoning models) denoted M_{i} for i\in\{1,2\} . A single use of an LLM incurs a monetary cost c_{i}\in[0,1] (i.e., inference compute) to the provider and a latency cost t_{i}\in[0,1] (i.e., opportunity cost of delay) to the user; we assume the costs are normalized to a standard monetary unit. Given a task from the user, each LLM has a success probability p_{i}\in(0,1) of successful completion. We define success as a Bernoulli trial ( 14 ; 7 ) . Finally, we assume t_{1}0 . Alternatively, if the user abandons the task, the provider incurs a penalty P>0 (e.g., if a user abandons the task, they may unsubscribe from the LLM service entirely with some probability, incurring an expected loss in future revenue for every abandoned task). Finally, we define the user net value per pass \xi_{i}:=Vp_{i}-t_{i} for each LLM as the expected value received from a single pass of the LLM. We describe M_{i} as value-dominated if \xi_{i}>0 and latency-dominated otherwise. Figure 2 summarizes the Markov model. At time \tau , let X_{\tau}\in\{M_{1},M_{2},\text{Success},\text{Abandon}\} denote the state. Furthermore, let \tau^{*} be the time of entering one of the two absorption states. Upon receiving a task at \tau=0 , the LLM provider commits to a routing and cascading policy (i,s) , where i\in\{1,2\} indicates the initial model to which the task is routed, and s\in[0,1] is the probability of cascading the task from M_{1} to M_{2} if M_{1} fails to complete the task. Given the provider’s policy, the user determines an abandonment policy q\in[0,1] , which is the probability that the user leaves the game without completing the task. We repeat the following sequence: 1. The provider routes to state M_{i} , incurring user delay t_{i} and provider cost c_{i} . The model successfully completes the task with probability p_{i} , which transitions to the Success state and yields the user value V . 2. If the model fails, the user abandons the task with probability q , which transitions to the Abandon state and incurs provider penalty P . If the user remains and the provider initially tried M_{1} , they can cascade to M_{2} with probability s or stay at M_{1} with probability 1-s . Our key assumption is that the user observes the routing and cascading strategy before deciding a stationary abandonment policy. In practice, users may abandon adaptively with less information. Furthermore, we assume that the success probabilities p_{i} are i.i.d. for any given task, whereas in practice, the model output and user feedback may allow p_{i} to change over time. Our assumption follows standard iterative user interaction ( 13 ; 7 ) . Finally, we note that the provider does not need to observe ground-truth correctness of an output to cascade. Model failure is interpreted through user-side signals (e.g., the user continues the session with follow-up prompts or provides explicit negative feedback), which the provider can act upon ( 19 ) . Figure 2: Markov model of LLM provider-user interaction. 3.2 User Problem Let \alpha(q):=\Pr\{X_{\tau+1}\in\{M_{1},M_{2}\}\;|\;X_{\tau}=M_{1}\}=(1-p_{1})(1-q) be the probability that M_{1} fails a task and the user stays. Let \beta(q):=\mathbb{E}[\sum_{\tau<\tau^{*}}\mathds{1}\{X_{\tau}=M_{2}\}\;|\;X_{0}=M_{2}]=1/(p_{2}+(1-p_{2})q) be the expected number of times that M_{2} is called before absorption, when initially routed to M_{2} . Furthermore, we define S_{i}(s,q):=\Pr\{X_{\tau^{*}}=\text{Success}\;|\;i\} and L_{i}(s,q):=\mathbb{E}[\sum_{\tau<\tau^{*}}t_{\tau}\;|\;i] as the success probability and total delay, respectively, for the user given a routing policy (i,s) and abandon policy q . That is, S_{i}(s,q) is the likelihood that the total session eventually absorbs into Success , and L_{i}(s,q) is the expected cumulative latency paid along the sequence of retries and possible escalation. We omit dependency on s and q from these terms when it is obvious. Finally, depending on the initial model, the user success probability and total delay yield closed-form expressions: \displaystyle S_{1}(s,q)=\frac{p_{1}+\alpha(q)\beta(q)p_{2}s}{1-\alpha(q)(1-s)}, \displaystyle\;S_{2}(q)=\beta(q)p_{2}, \displaystyle L_{1}(s,q)=\frac{t_{1}+\alpha(q)\beta(q)t_{2}s}{1-\alpha(q)(1-s)}, \displaystyle\;L_{2}(q)=\beta(q)t_{2} Given provider and user policies, the user’s expected utility is the expected value minus total delay \displaystyle U_{i}(s,q):=\mathbb{E}\left[V\mathds{1}\{X_{\tau}=\text{Success}\}-\sum_{\tau<\tau^{*}}t_{\tau}\;\Bigg|\;i\right]=VS_{i}(s,q)-L_{i}(s,q) Implicitly, V quantifies the trade-off in utility from successful completion of the task versus the delay from the use of the model. In practice for LLM subscriptions, users pay a fixed fee for use and there is no explicit monetary cost to users per query. As a result, latency is the only marginal cost to the user at interaction time. The user’s problem is, given a provider policy (i,s) , to determine an abandonment policy that maximizes their utility q^{*}(i,s)=\argmax_{q}U_{i}(s,q) . 3.3 Provider Problem Let C_{i}(s,q):=\mathbb{E}[\sum_{\tau<\tau^{*}}c_{\tau}\;|\;i] be the service cost incurred to the provider from trying to complete the task, which yields the closed-form expression \displaystyle C_{1}(s,q)=\frac{c_{1}+\alpha(q)\beta(q)c_{2}s}{1-\alpha(q)(1-s)} \displaystyle\qquad C_{2}(q)=\beta(q)c_{2} The provider incurs cost equal to the expected service cost plus the penalty from user abandonment \displaystyle J_{i}(s,q):=\mathbb{E}\left[\sum_{\tau<\tau^{*}}c_{\tau}+P\mathds{1}\{X_{\tau}=\text{Abandon}\}\;\Bigg|\;i\right]=C_{i}(s,q)+P(1-S_{i}(s,q)) The provider’s problem is to route to minimize their cost, assuming the user is maximizing utility, i.e., (i^{*},s^{*})=\argmin_{(i,s)}\{J_{i}(s,q^{*}(i,s))\;|\;q^{*}(i,s)=\argmax_{q}U_{i}(s,q)\} . 4 Characterizing Provider and User Policies We characterize the Stackelberg equilibrium by deriving the user best response and the optimal routing policy. When both models are either value- or latency-dominated, user behavior is static and the provider prefers a single, no-escalation route. If the models differ in state, user behavior exhibits threshold structures and the provider’s policy almost always reduces to routing without cascading. 4.1 User Best Response We characterize the user best response given a provider policy (i,s) . First, when routing to M_{2} , the provider cannot cascade further, and user response depends on if M_{2} yields positive net value. This can be also interpreted as the user dynamics when faced with a single model in isolation. Theorem 1 . If the provider sets i=2 , then the user best response is q^{*}(2,s)=\mathds{1}\left\{\xi_{2}<0\right\} . Theorem 1 shows that if the provider immediately routes a task to the better (i.e., reasoning) model, user behavior collapses to determining whether the model is value-dominated (i.e., \xi_{2}>0 ) or latency-dominated (i.e., \xi_{2}<0) ). If the user observes that the delay incurred from using the model is greater than the expected value that the user receives from the model’s output to the task, then the user will abandon the task. For example in a coding or mathematics task, the user may find that they can manually solve the problem rather than query a model in the same time. This behavior is characterized by V , which is an internal variable qualitatively defined by the user. We next characterize the user response policy if the provider routes to M_{1} and provides a cascading policy s . Here, the user response depends on the interplay between \xi_{1} and \xi_{2} . Theorem 2 . If the provider sets i=1 , then the user best response depends on \xi_{1} and \xi_{2} : 1. If \xi_{1},\xi_{2}\geq 0 , then the user best response is q^{*}(1,s)=0 for all s . 2. If \xi_{1},\xi_{2}\leq 0 , then the user best response is q^{*}(1,s)=1 for all s . 3. If \xi_{1}<0<\xi_{2} , then let s_{0}:=-\xi_{1}/(\xi_{2}/p_{2}-\xi_{1}) . The user best response is q^{*}(1,s)=\mathds{1}\left\{s0>\xi_{2} , then let \displaystyle F(s,q) \displaystyle:=\xi_{1}(1-s)\left(p_{2}+(1-p_{2})q\right)^{2}+\xi_{2}s\left(1-(1-p_{1})(1-p_{2})(1-s)(1-q)^{2}\right). Let s_{L} be the unique root in [0,1] satisfying F(s_{L},0)=0 and let s_{H}:=\xi_{1}/(\xi_{1}-\xi_{2}) . Then the user best response from routing to model 1 is \displaystyle q^{*}(1,s)=\begin{cases}0&\quad\text{ if~}s\leq s_{L}\\ q^{\dagger}(s)&\quad\text{ if~}s_{L}s_{0} . Otherwise, users can abandon the task since the expected delay is too large, replicating the single-model logic of Theorem 1 . Finally, if \xi_{1}>0>\xi_{2} , M_{1} is value-dominated and M_{2} is latency-dominated. Here, routing directly to M_{2} should encourage users to abandon the task. If the provider first routes to M_{1} and assigns a low ss_{H} pushes users to abandon the task since it may get cascaded to a latency-dominated M_{2} . Most interestingly, the interior regime (s_{L},s_{H}) has a non-static q^{*}(1,s)=q^{\dagger}(s) , where the user is incentivized to abandon the task with probability. This is the only scenario where user behavior is stochastic and changes with slight perturbation of s . Although the provider-optimal policy may find s\in(s_{L},s_{H}) , it may be also strategic to avoid this regime for a provider to ensure user behavior is predictable. Theorem 2 assumes that users know (i,s,p_{1},p_{2}) . In practice, the LLM interface may reveal the route i , but not s , p_{1} , or p_{2} . Here, beliefs drive the same threshold logic with respect to belief summaries; for example, users can act using \mathbb{E}_{\pi}[s] where \pi(s) is a posterior estimate of s observed from past routing. Over repeated tasks, this leads to an exploration versus exploitation problem. Figure 3: Heatmap of the user response when i=1 and s=0.25 . When both models are value-dominated (top right) or latency-dominated (bottom left), the user best response is static. When the models differ in their regime (top left and bottom right), the user response depends on \xi_{1},\xi_{2} . Note that q^{*}\in(0,1) is in the interior only in certain regimes for \xi_{1}>0>\xi_{2} . 4.2 Provider-optimal Policy Given the user best response, the provider optimization problem becomes taking the maximum of a single-variable optimization problem and a scalar: \displaystyle\min\left\{\min_{s}J_{1}\left(s,q^{*}(1,s)\right),\;J_{2}\left(\mathds{1}\{\xi_{2}<0\}\right)\right\} The structure of J_{1}(s,q^{*}(1,s)) depends on which models are value- or latency-dominated. We first prove the two cases where the models share the same sign with respect to \xi_{i} , before considering the settings where the models are differentiated. Theorem 3 . When both models share the same sign, the provider-optimal policy involves routing to one model without cascading: 1. If \xi_{1},\xi_{2}>0 , then \displaystyle(i^{*},s^{*})=\begin{cases}(1,0)&\displaystyle\quad\text{ if~}\frac{c_{1}}{p_{1}}\leq\frac{c_{2}}{p_{2}}\\ (2,0)&\quad\text{ otherwise}\end{cases} 2. If \xi_{1},\xi_{2}<0 , then, setting s\in[0,1] as a free variable, \displaystyle(i^{*},s^{*})=\begin{cases}(1,s)&\displaystyle\quad\text{ if~}P\leq\frac{c_{2}-c_{1}}{p_{2}-p_{1}}\\ (2,0)&\quad\text{ otherwise}\end{cases} If the two models are undifferentiated, i.e., both value- or latency-dominated, then cascading from one model to the other adds costs and variance without any benefits, making single routing optimal. When both models are value-dominated, the optimal policy is to route to the best model determined by the cost-of-pass ( 14 ; 7 ) . Because users should not abandon tasks, the penalty for user abandonment is irrelevant and cascading cannot improve costs beyond routing to the appropriate model immediately. When both models are latency-dominated, users are likely to abandon tasks if the model cannot complete them. Here, the routing policy depends on P versus the incremental advantage in the cost-of-pass (c_{2}-c_{1})/(p_{2}-p_{1}) . If the penalty of user abandonment is low, the optimal provider policy is to route to the cheaper standard model. Moreover, the choice of s is irrelevant since users will abandon regardless. On the other hand, if P is large, then the provider must route to the reasoning model to reduce the risk of incurring the penalty. Theorem 4 . Let P_{1}:=(c_{2}/p_{2}-c_{1})/(1-p_{1}) and let P_{2}:=(c_{1}(1-s_{0})+c_{2}s_{0}/p_{2})/(p_{1}+(1-p_{1})s_{0}) . If \xi_{1}<0<\xi_{2} , then the provider-optimal policy breaks into four cases: \displaystyle(i^{*},s^{*})=\begin{cases}(1,0)&\displaystyle\quad\text{ if~}\frac{c_{1}}{p_{1}}>\frac{c_{2}}{p_{2}}\text{~and~}P\frac{c_{2}}{p_{2}}\text{~and~}P>P_{1}\\ (1,0)&\displaystyle\quad\text{ if~}\frac{c_{1}}{p_{1}}<\frac{c_{2}}{p_{2}}\text{~and~}PP_{2}\end{cases} When \xi_{1}<0<\xi_{2} , users should remain if routed to M_{2} , but leave if routed to M_{1} with limited chance of escalating to M_{2} . However, if c_{1}/p_{1}0>\xi_{2} . For both plots, we hold c_{1}=1 constant and sweep the difference in cost-of-pass c_{1}/p_{1}-c_{2}/p_{2} as well as P . For most regimes, the optimal policy is either to route immediately to M_{1} or to M_{2} without any cascading. There exist only some regimes for \xi_{1}>0>\xi_{2} where the optimal policy involves probabilistic s\in(0,1) . Finally, we consider the case when \xi_{1}>0>\xi_{2} . Here, the user best response has three regions defined by thresholds s_{L} and s_{H} . Given the monotonicity of the provider function, determining the optimal routing and cascade policy is equivalent to optimizing over the following five settings: \displaystyle\min\left\{J_{1}(0,0),\,J_{1}(s_{L},0),\,\min_{s\in(s_{L},s_{H})}J_{1}(s,q^{\dagger}(s)),\,J_{1}(1,1),\,J_{2}(0)\right\} Because the provider policy is not necessarily static in this regime, we focus on sufficient conditions under which the provider can employ static policies. Theorem 5 . If \xi_{1}>0>\xi_{2} , the following statements are true: 1. If c_{1}/p_{1}<\min\{P,c_{2}/p_{2}\} , the provider-optimal policy is to route to model 1 only (i^{*},s^{*})=(1,0) . 2. If P<\min\{c_{1}/p_{1},(c_{2}-c_{1})/(p_{2}-p_{1})\} , the provider-optimal policy is to route to model 1 and cascade on failure (i^{*},s^{*})=(1,s) where s\in[s_{H},1] is a free variable. 3. If (c_{2}-c_{1})/(p_{2}-p_{1})0>\xi_{2} , respectively. For most settings, a static policy, i.e., (i^{*},s^{*})\in\{(1,0),(1,1),(2,0)\} , is optimal. Moreover in both cases, the optimal policy is almost always to route to M_{1} first. This underscores the value of routing to a weaker model initially, when the models are differentiated. Furthermore, the role of cascading differs depending on which of the two models is value-dominated. If M_{1} is the only value-dominated model, then cascading is effective specifically when the penalty is sufficiently low with respect to c_{1}/p_{1} ; otherwise, the provider is incentivized to remain at the standard model. If M_{2} is value-dominated, then aggressive cascading via s=1 is useful only when P is sufficiently small. Finally, we note that although we fix V , p_{1} , and p_{2} , the results naturally extend to a heterogenous setting with task-dependent parameters. Given a prompt x , a routing algorithm may first estimate the success probability p_{i}(x) and user value V(x) to better estimate the per-task user value \xi_{i}(x)=V(x)p_{i}(x)-t_{i} and determine a personalized optimal route. 5 When are provider and user misaligned? In this section, we discuss the implications of the equilibrium between user and provider to understand when the provider routing decisions act in the best interest of the user. We first define a misalignment gap that characterizes when the provider’s cost-minimizing routing strategy is sub-optimal for the user utility function. We then study the conditions when misalignment exists. Consider the cost-optimal policy for a provider (i^{*},s^{*}) . The misalignment gap is the difference between a user utility-optimal routing policy versus the provider’s true policy \displaystyle\Delta_{U}:=\max_{i,s}U_{i}(s,q^{*}(i,s))-U_{i^{*}}(s^{*},q^{*}(i^{*},s^{*})) If \Delta_{U}=0 , then the provider-optimal policy is also optimal for the user, meaning that the provider’s actions are in the user’s best interests. However, if \Delta_{U}>0 , then there is a utility gap for the user incurred by the provider minimizing service costs. Depending on the costs and penalties, a misalignment gap can exist for every possible configuration of \xi_{1},\xi_{2} . Proposition 1 . The following statements are true: 1. If \xi_{1},\xi_{2}>0 , then \Delta_{U}=0 if and only if \mathop{\rm sign}\nolimits(c_{1}/p_{1}-c_{2}/p_{2})=\mathop{\rm sign}\nolimits(\xi_{2}/p_{2}-\xi_{1}/p_{1}) . 2. If \xi_{1},\xi_{2}<0 , then \Delta_{U}=0 if and only if \mathop{\rm sign}\nolimits(\xi_{2}-\xi_{1})=\mathop{\rm sign}\nolimits(P-(c_{2}-c_{1})/(p_{2}-p_{1})) . 3. If \mathop{\rm sign}\nolimits(\xi_{1})\neq\mathop{\rm sign}\nolimits(\xi_{2}) , then \Delta_{U}=0 if and only if \xi_{i^{*}}>0 and s^{*}=0 . When \xi_{1},\xi_{2}>0 , provider routing collapses to a static cost-of-pass rule. Here, alignment requires the provider and user rankings to match; otherwise the provider selects the cheaper model while the user prefers the more successful one. When \xi_{1},\xi_{2}<0 , the user always abandons, meaning that alignment requires the provider to select the same “less-bad” model from the user’s perspective. This only occurs if the provider’s switch regime agrees with the user’s ranking. Finally if the models are differentiated, any likelihood of cascading exposes the user to latency. Figure 5 (Left, Middle) highlight this regime for the same parameters as in Figure 4 , showing the misalignment gap. Figure 5: Left: Heatmap of the user misalignment gap for \xi_{1}<0<\xi_{2} . Middle: Heatmap of the user misalignment gap for \xi_{1}>0>\xi_{2} . Right: Heatmap of the effect of throttling on provider costs; the dashed line is the line P=\min\{c_{1}/p_{1},c_{2}/p_{2}\} . For all plots, we hold c_{1}=1 constant and sweep the difference in cost-of-pass c_{1}/p_{1}-c_{2}/p_{2} as well as P . 6 The risk of throttling latency Finally, we study an extreme case of misalignment where the provider may seek to inflate the latency of their models to encourage users to abandon tasks more often, thereby reducing service costs from repeated prompts. Specifically, consider a provider forced to a fixed subscription price due to factors such as market competition, meaning they cannot directly re-price in response to higher service costs. Instead, throttling latency functions as a hidden price increase that implicitly reduces usage, and consequently, provider costs. Here, user abandonment causes a penalty P , but if it is sufficiently small, this loss may offset the higher service costs. Suppose the models have latencies t_{i}t_{i} for i\in\{1,2\} , let J_{post}^{*}:=\min_{(i,s)}\{J_{i}(s,q^{*}(i,s;\hat{t}_{1},\hat{t}_{2})\} as the provider-optimal cost after throttling. Note that \hat{t}_{i} are now variables that the provider can tune. If J_{post}^{*}\leq J_{pre}^{*} , then the provider benefits from throttling, even though it reduces the user’s utility. Proposition 2 . If P\leq\min\{c_{1}/p_{1},c_{2}/p_{2}\} , then setting \hat{t}_{i}>Vp_{i} incurs J_{post}^{*}\leq J_{pre}^{*} . Figure 5 (Right) visualizes the gain from throttling. For static policies, the gain is \min_{i}\{c_{i}/p_{i}\}-\min_{i}\{c_{i}+P(1-p_{i})\} , which is linear in P . Moreover, throttling maximizes misalignment \Delta_{U} , since providers prefer users to abandon tasks while users would prefer to successfully complete tasks. Most importantly, providers will reduce costs from throttling either (or both) models. When P exceeds \min\{c_{1}/p_{1},c_{2}/p_{2}\} , the gain from throttling becomes negative and this misaligned policy loses its dominance. Therefore, to prevent throttling, the price of user abandonment must exceed the cost-per-pass. In practice, this can be realized either by users proactively unsubscribing from LLM providers, by providers voluntarily ensuring a guarantee to users, or by permitting users to opt-out of routing and cascading by self-selecting models. 7 Conclusion We study the problem of LLM routing as an interaction between a provider offering a menu of models and a user subscribing to the LLM service seeking the best model to complete their task. The user impact of routing depends on the patience of users facing the trade-offs between quality, latency, and cost. We formalize a Stackelberg game between a single provider with two models, standard and reasoning, and a single user. The user maximizes their utility from LLM use by abandoning tasks with large inference delay, while the provider minimizes the cost of serving the user and the risk of users leaving the LLM subscription service when they abandon. We find that user patience for the LLM provider is governed by the sign of net value the user receives from each model. If both models offer similar value, then the user’s action is unaffected by the routing policy. On the other hand, if the two models differ in value, then users are incentivized to abandon their tasks with some probability if the likelihood of being routed or cascaded to the worse model is high. On the other hand, the optimal provider routing policy is almost always static, showing that there is limited value in cascading except in a narrow regime where the models are differentiated in user net value. This leads to a provider-user misalignment when the value rankings from a user and the cost-of-pass rankings from a provider disagree. Most importantly, misalignment can grow extreme when users are unlikely to unsubscribe. This motivates providers to artificially throttle latency, which saves their costs but yields poorer user value. The extant routing literature often optimizes over the trade-off between solution quality and latency by estimated per-task success rates ( 10 ) . Our analysis suggests that user behavior can play a core role in determining optimal routing policies. For instance, the development of this paper involved sustained use of an LLM service, where for example, deriving key theoretic results (i.e., high-value tasks) necessitated user patience from repeated prompts (see Appendix A for details). Consequently, we advocate for LLM routing algorithms to simultaneously estimate both model success rates and user value per task in order to better serve users. We note several limitations and next steps. First, our analysis is of two models, but the framework can be extended to more models. Second, our subscription framing abstracts away per-query monetary prices; pay-per-call API pricing can be incorporated by adding a per-query charge to the user utility. Third, we assume that a user can observe the provider cascade strategy and acts with a stationary abandonment policy. In practice, routing strategies are hidden and users may need to adapt. Finally, we treat the per-pass success as i.i.d. and assume fixed user value and provider penalty that are known to both players. In practice, these terms may not always be immediately quantifiable and may require online learning. Appendix A Protocol of LLM Usage We used LLMs as assistive tools throughout this project. The assistance covered: (i) deriving proof steps or searching for counterexamples; (ii) preparing first drafts for sections and editing with feedback; and (iii) coding plots. All mathematical statements, derivations, and proofs in the final paper were human-verified end-to-end. All figures and text underwent human editing. We interacted with the LLM in multi-round sessions. Each session targeted a single goal (e.g., proof sketch, draft writing and editing, or code). For many theoretical results, although we were routed to the complex reasoning model, we found our user behavior to be patient in repeated interactions, suggesting the high user value placed on the work. For certain tasks and over time, we found our behavior to be less patient, suggesting a time-varying nature on user value, which could be studied in future work. Table 1 summarizes typical tasks, the intended role of the LLM, and acceptance criteria. Task type LLM role Acceptance criterion Typical outcome Proof sketching Suggest directions, arguments, and counterexamples Human derivation reproduces all steps Often useful after 2–10 reprompts Algebraic checking Expand derivatives, monotonicity, or bounding steps Symbols match manual calculations Often useful after 2–4 reprompts Draft writing Prepare bullet form for text, condense paragraphs and enforce writing style Preserves technical meaning and improves clarity Useful with one pass Figure prototyping Generate plotting scaffolds Matches definitions and theorem regimes Useful with minor edits Table 1: Summary of how LLM assistance was used and validated. Appendix B Helper Lemmas In this section, we outline several lemmas required for the main proofs of the paper. Lemma 1 . For any fixed q , the objective function for the provider is monotone in s . Proof of Lemma 1 . It suffices to prove that C_{1}(s) and S_{1}(s) are monotone in s . Note that both C_{1}(s) and S_{1}(s) can be written as fractions of two affine functions in s . As a result, the first derivative of these functions is a ratio of a constant value over a non-negative quadratic function (1-\alpha(1-s))^{2} . ∎ Lemma 2 . For any fixed s , let U^{+}_{1}(\alpha):=(\xi_{1}+\xi_{2}\alpha s/p_{2})/(1-\alpha(1-s)) and let U^{-}_{1}(\alpha):=(\xi_{1}+\xi_{2}\alpha s)/(1-\alpha(1-s)) . Then for all q\in[0,1] , \displaystyle U^{-}_{1}(\alpha)\leq U_{1}(s,q)\leq U^{+}_{1}(\alpha) \displaystyle\qquad\text{if~}\xi_{2}\geq 0 \displaystyle U^{+}_{1}(\alpha)\leq U_{1}(s,q)\leq U^{-}_{1}(\alpha) otherwise Proof of Lemma 2 . Note that \beta(q) is a decreasing function of q and is bounded [1,1/p_{2}] . Therefore, for any fixed s,q , if \xi_{2}\geq 0 , then \xi_{1}+\xi_{2}\alpha s\leq\xi_{1}+\xi_{2}\alpha\beta s\leq\xi_{1}+\xi_{2}\alpha s/p_{2} . Moreover, the inequalities are reversed when \xi_{2}<0 . ∎ Lemma 3 . Let K^{+}(s):=\xi_{1}(1-s)+\xi_{2}s/p_{2} and let K^{-}(s):=\xi_{1}(1-s)+\xi_{2}s . 1. U_{1}^{+}(\alpha) is monotone increasing (respectively, decreasing) in \alpha and therefore, decreasing (respectively, increasing) in q , if K^{+}(s)>0 (respectively, if K^{+}(s)<0 ). 2. U_{1}^{-}(\alpha) is monotone increasing (respectively, decreasing) in \alpha and therefore, decreasing (respectively, increasing) in q , if K^{-}(s)>0 (respectively, if K^{-}(s)<0 ). Proof of Lemma 3 . 1. We take the first derivative of U^{+}_{1} as follows \displaystyle\frac{dU_{1}^{+}}{d\alpha}=\frac{\xi_{2}(1-\alpha(1-s))/p_{2}+(1-s)(\xi_{1}+\xi_{2}\alpha s/p_{2})}{(1-\alpha(1-s))^{2}}=\frac{K^{+}(s)}{(1-\alpha(1-s))^{2}} Since the denominator is positive for all s\in[0,1] , the first derivative is strictly positive if K^{+}(s)>0 and strictly negative otherwise. Consequently, U_{1}^{+}(s) is increasing or decreasing, respectively, in \alpha . Finally, note that \alpha(q) is a decreasing function in q , meaning that U_{1}^{+}(\alpha(q)) is decreasing or increasing, respectively in q . 2. We take the first derivative dU_{1}^{-}/d\alpha=K^{-}(s)/(1-\alpha(1-s))^{2} and use the same steps to show U_{1}^{-}(\alpha) is increasing in \alpha and therefore, decreasing in q if K^{-}(s)>0 and the reverse otherwise. ∎ Lemma 4 . Let P_{1}:=(c_{2}/p_{2}-c_{1})/(1-p_{1}) . If c_{1}/p_{1}>c_{2}/p_{2} , then P_{1}>(c_{2}-c_{1})/(p_{2}-p_{1}) . Otherwise, P_{1}\leq(c_{2}-c_{1})/(p_{2}-p_{1}) . Proof. Proof of Lemma 4 We subtract \displaystyle P_{1}-\frac{c_{2}-c_{1}}{p_{2}-p_{1}}=\frac{\left(\frac{c_{2}}{p_{2}}-c_{1}\right)(p_{2}-p_{1})-(c_{2}-c_{1})(1-p_{1})}{(1-p_{1})(p_{2}-p_{1})}=\frac{(1-p_{2})\left(c_{1}-\frac{c_{2}p_{1}}{p_{2}}\right)}{(1-p_{1})(p_{2}-p_{1})}. From the numerator, this fraction is positive when c_{1}/p_{1}>c_{2}/p_{2} , and is non-positive otherwise. ∎ Lemma 5 . Let P_{2}:=(c_{1}(1-s_{0})+c_{2}s_{0}/p_{2})/(p_{1}+(1-p_{1})s_{0}) . If c_{1}/p_{1}c_{1}/p_{1} and is monotonic non-increasing otherwise. Furthermore, note that R(0)=c_{1}/p_{1} and R(1)=c_{2}/p_{2} . Therefore, R(s) is a convex combination of c_{1}/p_{1} and c_{2}/p_{2} . ∎ Appendix C Proofs of Main Results C.1 Proofs for Section 4.1 Proof of Theorem 1 . We take the first derivative of U_{2}(q) to show \displaystyle\frac{dU_{2}}{dq}=-\frac{\xi_{2}(1-p_{2})}{(p_{2}+(1-p_{2})q)^{2}} that the derivative is positive for all q\in[0,1] if \xi_{2}<0 and is non-positive otherwise. If the derivative is positive, then U_{2}(q) is monotone increasing and the optimal response is q^{*}=1 . If the derivative is non-positive, then the utility is non-increasing and an optimal response is q^{*}=0 . ∎ Proof of Theorem 2 . 1. If \xi_{1},\xi_{2}\geq 0 : From Lemma 2 , U_{1}(s,q)\leq U^{+}_{1}(\alpha) . Furthermore because \xi_{1}\geq 0 , from Lemma 3 , K^{+}(s)\geq 0 for all s\in[0,1] and U^{+}_{1}(\alpha) is monotone non-decreasing in q . Consequently, \displaystyle U_{1}(s,q)\leq U^{+}_{1}(\alpha)\leq U^{+}_{1}(\alpha(0))=\frac{\xi_{1}+\xi_{2}s\frac{1-p_{1}}{p_{2}}}{1-(1-p_{1})(1-s)}=U_{1}(s,0) showing that the envelope function is tight at the maximizing point q^{*}=0 . 2. If \xi_{1},\xi_{2}<0 : From Lemma 2 , U_{1}(s,q)\leq U^{-}_{1}(\alpha) . Furthermore, because \xi_{1}\leq 0 , from Lemma 3 , K^{-}(s)<0 for all s\in[0,1] and U^{-}_{1}(\alpha) is monotone non-increasing in q . Consequently, \displaystyle U_{1}(s,q)\leq U^{-}_{1}(\alpha)\leq U^{-}_{1}(\alpha(1))=\xi_{1}=U_{1}(s,1) showing that the envelope function is tight at the maximizing point q^{*}=1 . 3. If \xi_{1}<0<\xi_{2} : From Lemma 2 , U_{1}(s,q)\leq U^{+}_{1}(\alpha) . Furthermore from Lemma 3 , the envelope function is monotone decreasing in q if K^{+}(s)>0 and monotone non-decreasing otherwise. Since K^{+}(s) is a convex combination of a positive and negative value, we have K^{+}(s)>0 for all s>s_{0} and K^{+}(s)\leq 0 otherwise. We first consider the case of s>s_{0} . Here, we leverage the monotone decreasing property of the envelope \displaystyle U_{1}(s,q)\leq U^{+}_{1}(\alpha)\leq U^{+}_{1}(\alpha(0))=\frac{\xi_{1}+\xi_{2}s\frac{1-p_{1}}{p_{2}}}{1-(1-p_{1})(1-s)}=U_{1}(s,1) Similarly, when s0>\xi_{2} : We break the proof into three regimes for s\geq s_{H} , s\leq s_{L} , and s\in(s_{L},s_{H}) . For s\geq s_{H} : We first characterize the user best response using the envelope arguments. From Lemma 2 and Lemma 3 , we have U_{1}(s,q)\leq U_{1}^{-}(\alpha) , which is monotone non-increasing if and only if K^{-}_{(}s)\leq 0 . This occurs only in the regime for s\geq s_{H} . Here, \displaystyle U_{1}(s,q)\leq U^{-}_{1}(\alpha)\leq U^{-}_{1}(\alpha(1))=\xi_{1}=U_{1}(s,1) showing the envelope function is tight at the maximizing point. For s\leq s_{L} : For the remaining two regimes, the envelope will not be a tight upper bound, meaning this argument will not be viable and we require an alternate approach. For notational simplicity, let U_{1}(s,q)=N(s,q)/D(s,q) where N(s,q):=\xi_{1}+\xi_{2}\alpha(q)\beta(q)s and D(s,q)=1-\alpha(q)(1-s) . We seek to identify a constant s_{L} such that for any s0 and T(1,0)=\xi_{2}/p_{2}^{2}<0 . Furthermore, the derivative \displaystyle\frac{dT}{ds}=-\xi_{1}+\frac{\xi_{2}}{p_{2}}\left(\frac{p_{1}}{p_{2}}+1-p_{1}\right)+\frac{2\xi_{2}(1-p_{1})(1-p_{2})}{p_{2}^{2}}<0 meaning that for the interval [0,1] , T(s,0) begins positive, decreases monotonically, and ends negative. Therefore, it must have a unique root within the interval [0,1] . Let s_{L} be this root. Thus, for all s0 , where at the limits, the user response moves towards the optimal boundary solutions. For the lower limit \displaystyle\lim_{s\to s_{L}^{+},q\to 0}F(s,q) \displaystyle\propto-\lim_{s\to s_{L}^{+},q\to 0}\frac{\partial U_{1}}{\partial q} \displaystyle=-\lim_{s\to s_{L}^{+},q\to 0}\frac{U_{1}(s,q)-U_{1}(s,0)}{q} \displaystyle=-\lim_{s\to s_{L}^{+},q\to 0}\frac{-(1-p_{1})T(s,q)q}{D(s,0)D(s,q)q} \displaystyle=\lim_{s\to s_{L}^{+},q\to 0}\frac{(1-p_{1})T(s,q)}{D(s,q)^{2}} \displaystyle<0\text{~ for~}s>s_{L}. where the inequality arises from the observation that T(s)>0 in this regime. For the upper limit \displaystyle\lim_{s\to s_{H}^{-}q\to 1}F(s,q) \displaystyle\propto-\lim_{s\to s_{H}^{-},q\to 1}\frac{\partial U_{1}}{\partial q} \displaystyle=-\lim_{s\to s_{H}^{-},q\to 1}\frac{N^{\prime}(s,q)D(s,q)-N(s,q)D^{\prime}(s,q)}{D(s,q)^{2}} \displaystyle=\lim_{s\to s_{H}^{-}}(1-p_{1})\left(\xi_{1}(1-s)+\xi_{2}s\right) \displaystyle=>0\text{~ for~}s0 , then by Theorem 2 , the user best response is always q^{*}(i,s)=0 for all i\in\{1,2\} and s\in[0,1] . We then compare the two separate cases of routing to model 1 and routing to model 2. If the provider routes to model 2, their objective function value is J_{2}(s,0)=c_{2}\beta(0)=c_{2}/p_{2} . On the other hand, if the provider routes to model 1, their objective function value is \displaystyle J_{1}(s,0)=\frac{c_{1}+\frac{1-p_{1}}{p_{2}}c_{2}s}{1-(1-p_{1})(1-s)}. From Lemma 1 , this function is monotone in s . To determine the direction, we take the first derivative \displaystyle\frac{\partial J_{1}(s,0)}{\partial s} \displaystyle=\frac{\frac{1-p_{1}}{p_{2}}c_{2}(1-(1-p_{1})(1-s))-(1-p_{1})\left(c_{1}+\frac{1-p_{1}}{p_{2}}c_{2}s\right)}{(1-(1-p_{1})(1-s))^{2}} \displaystyle=\frac{1-p_{1}}{(1-(1-p_{1})(1-s))^{2}}\left(\frac{p_{1}}{p_{2}}c_{2}-c_{1}\right) First consider the case of c_{1}/p_{1}0 , meaning that J_{1}(s,0) is monotone increasing and the optimal s^{*}=0 . Furthermore, J_{1}(0,0)=c_{1}/p_{1}c_{2}/p_{2} , we have \partial J_{1}(s,0)/\partial s<0 meaning that J_{1}(1,0)\leq J_{1}(s,0) for all s . Furthermore, J_{1}(1,0)=c_{1}+(1-p_{1})c_{2}/p_{2}=c_{1}+c_{2}/p_{2}-p_{1}c_{2}/p_{2}>c_{2}/p_{2}=J_{2}(s,0) where the inequality falls from the condition on the cost-of-pass. Therefore, in this regime, the optimal policy is to route to model 2. 2. If \xi_{1},\xi_{2}<0 , then by Theorem 2 , the user best response is always q^{*}(i,s)=1 for all i\in\{1,2\} and s\in[0,1] . We can compare the two separate cases of routing to model 1 versus routing to model 2. If the provider routes to model 2, their objective function value is J_{2}(s,1)=c_{2}+P(1-p_{2}) . On the other hand, if the provider routes to model 1, their objective function value is J_{1}(s,1)=c_{1}+P(1-p_{1}) , which is independent from s . Comparing these two objective function values yields \displaystyle J_{1}(s,1)\leq J_{2}(s,1)\;\Longleftrightarrow\;P\leq\frac{c_{2}-c_{1}}{p_{2}-p_{1}}. This completes the proof. ∎ Proof of Theorem 4 . From Theorem 1 , because \xi_{2}>0 , the provider’s return from routing to model 2 is J_{2}(s,q^{*})=c_{2}/p_{2} . From Theorem 2 , the provider’s return from routing to model 1 is dependent on the escalation policy \displaystyle J_{1}(s,q^{*})=\begin{cases}c_{1}+P(1-p_{1})&\quad\text{ if~}sc_{2}/p_{2} . Here J_{1}(1,0)\frac{c_{2}}{p_{2}}=J_{2}(s,0) meaning that routing to model 1 and escalating is strictly dominated by routing directly to model 2. Therefore, the optimal policy is to route to model 1 and set s=0 if c_{1}+P(1-p_{1})0 where the inequality arises from c_{1}/p_{1}c_{1}/p_{1} and is monotone decreasing when c_{2}/p_{2}P~\Longrightarrow~\frac{c_{1}}{p_{1}}>c_{1}+P(1-p_{1})=J_{1}(1,1). On the other hand if J_{1}(s,0) is increasing, then \displaystyle J_{1}(s,0)-J_{1}(1,1) \displaystyle\geq J_{1}(1,0)-J_{1}(1,1) (20) \displaystyle=c_{1}+\frac{1-p_{1}}{p_{2}}c_{2}-c_{1}-P(1-p_{1}) (21) \displaystyle=(1-p_{1})\left(\frac{c_{2}}{p_{2}}-P\right) (22) \displaystyle\geq(1-p_{1})\left(\frac{c_{2}}{p_{2}}-\frac{c_{2}-c_{1}}{p_{2}-p_{1}}\right) (23) \displaystyle=\frac{1-p_{1}}{p_{2}(p_{2}-p_{1})}\left(c_{1}p_{2}-c_{2}p_{1}\right) (24) \displaystyle\geq 0 (25) where ( 23 ) follows from P<(c_{2}-c_{1})/(p_{2}-p_{1}) , ( 24 ) re-arranges the terms, and ( 25 ) follows from the assumption that c_{1}/p_{1}>c_{2}/p_{2} . 3. Note that J_{2}(1)=c_{2}+P(1-p_{2}) . We first show that routing to model 2 immediately is more cost-effective than routing to model 1 and escalating on failure: \displaystyle P<\frac{c_{2}-c_{1}}{p_{2}-p_{1}}~\Longrightarrow~c_{2}+P(1-p_{2})0 : then q^{*}(i,s)=0 for all (i,s) by Theorem 2 . Moreover, (i^{*},s^{*})=(\argmin_{i}\{c_{1}/p_{1},c_{2}/p_{2}\},0) from Theorem 3 . To determine the user optimal routing strategy, we can compare \displaystyle U_{1}(s,0)-U_{2}(0) \displaystyle=\frac{\xi_{1}+\frac{1-p_{1}}{p_{2}}\xi_{2}s}{p_{1}+(1-p_{1})s}-\frac{\xi_{2}}{p_{2}}=\frac{\frac{\xi_{2}p_{1}}{p_{2}}-\xi_{1}}{p_{1}+(1-p_{1})s}. If this difference is positive, then (1,0) is user-optimal, or otherwise (2,0) . Thus, \argmax_{i,s}U_{i}(s,q^{*}(i,s))=(2,0) when \xi_{2}/p_{2}>\xi_{1}/p_{1} , and is equal to (1,0) otherwise. Thus, \Delta_{U} is equal to 0 if and only if \xi_{2}/p_{2}>\xi_{1}/p_{1} and c_{1}/p_{1}>c_{2}/p_{2} or if the signs of both inequalities are reversed. 2. If \xi_{1},\xi_{2}<0 : then q^{*}(i,s)=1 for all (i,s) by Theorem 2 . Moreover, (i^{*},s^{*})=(1,s) if P\leq(c_{2}-c_{1})/(p_{2}-p_{1}) and is equal to (2,0) otherwise. To determine the user optimal routing strategy, we compare \displaystyle U_{2}(1)-U_{1}(s,1) \displaystyle=\xi_{2}-\xi_{1}, meaning that \argmax_{i,s}U_{i}(s,q^{*}(i,s)=(2,0) when \xi_{2}>\xi_{1} and is equal to (1,s) otherwise. Thus, \Delta_{U} is equal to 0 if and only if \xi_{2}>\xi_{1} and P<(c_{2}-c_{1})/(p_{2}-p_{1}) or if the signs of both inequalities are reversed. 3. If \mathop{\rm sign}\nolimits(\xi_{1})\neq\mathop{\rm sign}\nolimits(\xi_{2}) : We break this into two cases. (a) If \xi_{1}<0<\xi_{2} : From Theorem 2 , q^{*}(2,s)=0 and q^{*}(1,s)=\mathds{1}\{s0. Next for any s\geq s_{0} : \displaystyle U_{2}(0)-U_{1}(s,0) \displaystyle=\frac{\frac{\xi_{2}p_{1}}{p_{2}}-\xi_{1}}{p_{1}+(1-p_{1})s}>0. Thus, \Delta_{U} is equal to 0 if and only if (i^{*},s^{*})=(2,0) . (b) If \xi_{1}>0>\xi_{2} : From Theorem 2 , q^{*}(2,s)=1 and q^{*}(1,s) is determined by three regimes. Starting from Lemma 3 , \displaystyle U_{1}(s,q)\leq U_{1}^{-}(\alpha)=\frac{\xi_{1}+\xi_{2}\alpha s}{1-\alpha(1-s)}\leq\frac{\xi_{1}}{p_{1}}=U_{1}(0,0) where the second inequality arises from substituting q=0,s=0 into U_{1}^{-}(\alpha) . Therefore, the user prefers routing to model 1 without cascading among all choices that involve routing to model 1. Finally, we compare against model 2 to show U_{1}(0,0)-U_{2}(1)=\xi_{1}/p_{1}-\xi_{2}>0 , meaning that the user utility is maximized overall by routing to model 1 and not escalating. Therefore, \Delta_{U}=0 if and only if (i^{*},s^{*})=(1,0) . ∎ C.4 Proofs for Section 6 Proof of Proposition 2 . Before proving, we note that when P\leq\min\{c_{1}/p_{1},c_{2}/p_{2}\} , we have the following two identities. First, \displaystyle J_{1}(s,q)-J_{1}(0,1) \displaystyle=C_{1}(s,q)-c_{1}-P(S_{1}(s,q)-p_{1}) \displaystyle=\left(\frac{C_{1}(s,q)-c_{1}}{S_{1}(s,q)-p_{1}}-P\right)(S_{1}(s,q)-p_{1}) \displaystyle\geq 0 where the inequality rises from Lemma 6 , showing (C_{1}(s,q)-c_{1})/(S_{1}(s,q)-p_{1})\geq\min\{c_{1}/p_{1},c_{2}/p_{2}\}\geq P . Second, \displaystyle J_{2}(q)-J_{2}(1) \displaystyle=C_{2}(q)-c_{2}-P(S_{2}(q)-p_{2}) \displaystyle=\left(\frac{C_{2}(q)-c_{2}}{S_{2}(q)-p_{2}}-P\right)(S_{2}(q)-p_{2}) \displaystyle=\left(\frac{c_{2}}{p_{2}}-P\right)(\beta(q)-1)p_{2} \displaystyle\geq 0 where the inequality again rises from Lemma 6 . We now break the proof into two cases, each with two sub-cases. 1. The effect of throttling model 1: (a) When \xi_{2}>0 : We must compare the effect on the provider-optimal cost between the settings \xi_{1},\xi_{2}>0 , where we let J_{pre}^{*} be the optimal cost; and \xi_{2}>0>\xi_{1} where we let J_{post}^{*} be the optimal cost. Then, \displaystyle J_{post}^{*} \displaystyle\leq\min\{J_{1}(0,1),J_{1}(s_{0},0),J_{2}(0)\} (31) \displaystyle=\min\{J_{1}(0,1),J_{2}(0)\} (32) \displaystyle=\min\left\{c_{1}+P(1-p_{1}),\frac{c_{2}}{p_{2}}\right\} (33) \displaystyle\leq\min\left\{\frac{c_{1}}{p_{1}},\frac{c_{2}}{p_{2}}\right\} (34) \displaystyle=J_{pre}^{*} (35) where ( 31 ) follows from Theorem 4 , ( 32 ) follows from the identity stated at the start of the proof, ( 33 ) follows from substituting the the terms, and ( 34 ) follows from P0>\xi_{2} and 0>\xi_{1},\xi_{2} . Let J_{pre}^{*} and J_{post}^{*} be the provider-optimal cost in the first and second setting, respectively. Then, \displaystyle J_{pre}^{*} \displaystyle=\min\{J_{2}(1),J_{1}(0,0),J_{1}(s_{L},0),J_{1}(s,q^{\dagger}(s)),J_{1}(1,1)\} (36) \displaystyle\geq\min\{J_{2}(1),J_{1}(0,1)\} (37) \displaystyle=\min\left\{c_{2}+P(1-p_{2}),c_{1}+P(1-p_{1})\right\} (38) \displaystyle=J_{post}^{*} (39) where ( 36 ) follows from applying Theorem 2 , ( 37 ) follows from the identity at the start of the proof, and ( 39 ) follows from Theorem 3 . 2. The effect of throttling model 2: (a) When \xi_{1}>0 : We must compare the effect of the provider-optimal cost between the settings \xi_{1},\xi_{2}>0 where we let J_{pre}^{*} be the optimal cost; and \xi_{1}>0>\xi_{2} where we let J_{post}^{*} be the optimal cost. Then, \displaystyle J_{post}^{*} \displaystyle\leq\min\left\{J_{1}(0,0),J_{2}(1)\right\}\leq\min\{J_{1}(0,0),J_{2}(0)\}=J_{pre}^{*} where the first inequality follows from applying Theorem 2 and the second inequality follows from Theorem 3 . (b) When \xi_{1}<0 : We must compare the effect of the provider-optimal cost between the settings \xi_{1}<0<\xi_{2} where we let J_{pre}^{*} be the optimal cost; and \xi_{1},\xi_{2}<0 where we let J_{post}^{*} be the optimal cost. Then, \displaystyle J_{pre}^{*} \displaystyle=\min\{J_{1}(0,1),J_{1}(s_{0},0),J_{2}(0)\}\geq\min\{J_{1}(0,1),J_{2}(0)\} \displaystyle\geq\min\{J_{1}(0,1),J_{2}(1)\}=J_{post}^{*} where both inequalities draw on the identities presented at the start of the proof. ∎