EpiCoDe: Boosting Model Performance Beyond Training with Extrapolation and Contrastive Decoding Mingxu Tao, Jie Hu, Mingchuan Yang, Yunhuai Liu, Dongyan Zhao, Yansong Feng Abstract The remarkable performance of Large language models (LLMs) relies heavily on the availability of abundant high-quality training data. However, the high cost of acquiring annotated data often prevents models from obtaining capabilities to tackle downstream tasks. In this paper, we introduce a novel method, EpiCoDe that boosts model performance in data-scarcity scenarios without extra training. We first employ model extrapolation to enhance a finetuned model with its inferior version, and then adopt contrastive decoding to further reduce predicted errors, by comparing the logit scores given by the extrapolated and the vanilla finetuned model. Experiments across three tasks over four different LLMs show that EpiCoDe consistently outperforms existing methods with significant and robust improvement. We also propose a new theoretical framework to reveal the mechanism behind contrastive decoding in data-scarcity scenarios, which further helps us better understand the effectiveness of EpiCoDe. 1 Introduction Large language models (LLMs) have demonstrated superior performance across a wide range of downstream tasks, making them an indispensable application in natural language processing Yang et al. 2024 ; Team 2024 ; DeepSeek-AI et al. 2025 . Their impressive capabilities, however, are primarily dependent on the availability of large-scale, high-quality training data. The scarcity of such data, especially in specific domains, has become a major barrier to further advancing LLMs. This challenge is particularly pronounced in fields such as law and health Huang et al. 2023 ; Chen et al. 2024 , where access to domain-specific data is often limited due to privacy concerns, copyright restrictions, and the high cost of data collection. Furthermore, the expense of high-quality annotations may also remain a bottleneck, restricting the consistent development of model abilities. Therefore, there has been a growing need to develop methods that can make the most use of limited data without extra training to enhance model performance in such data-scarcity scenarios. Existing efforts include two types of methods, model extrapolation Zheng et al. 2024 and contrastive decoding Li et al. 2023 , which are developed from the perspectives of parameters and inference, respectively. Model extrapolation collects two checkpoints from different training stages. It obtains a stronger model by comparing the parameters of two checkpoints without extra training. Beyond directly editing model parameters, there is another thread of research focusing on improving the probability to output correct next tokens during inference. Li et al. 2023 ( Li et al. 2023 ) hypothesize the LLMs trained on the same datasets can have similar patterns to make mistakes. Thus, comparing the logit scores predicted by a small LLM and a large LLM in the same family and calculating their difference, contrastive decoding can reduce the shared errors of the two LLMs. Previous work Karras et al. 2024 also proposes to improve the quality of generated images by comparing the prediction of a model and its bad version trained with noisy data. These two techniques are both good practice to enhance LLMs without extra training. However, they sometimes fail to bring improvement O’Brien and Lewis 2023 ; Zheng et al. 2024 . Furthermore, existing works have not explored whether they are effective in the context of data scarcity. In this paper, we introduce EpiCoDe, a novel method that leverages model e xtra p olat i onand co ntrastive de coding to improve the performance of a finetuned model without further training in data-scarcity scenarios. We first obtain an extrapolated model of a finetuned LLM by employing its weakened version at early training stage as the anchor. The resulting models as well as the vanilla finetuned model learn from the same dataset, exhibiting similar capabilities and error patterns. We then compare their logit scores and employ contrastive decoding to further optimize the prediction of next tokens. This frustratingly easy method can take the strengths of both methods to further improve model performance. Previous efforts mainly provide empirical evidence to explain the success of contrastive decoding, without a proper analyzing tool to help us understand how contrastive decoding contributes to the improvement.In this work, we further introduce a theoretical framework to explain the mechanisms behind contrastive decoding and investigate strategies for model selection in EpiCoDe. Our key insight is that model extrapolation helps maintain model locality across finetuned models and extrapolated models, which can ensure further improvement during the contrastive decoding stage. Specifically, we argue that EpiCoDe brings more stable improvement when selecting the weak models that are closer to the extrapolated model in the parameter space. We evaluate our method across three distinct tasks (law, math, and logical reasoning) using four LLMs from different families and with various scales. Experimental results show that EpiCoDe consistently outperforms baseline models, which employ either model extrapolation or contrastive decoding, with significant performance gains across all tasks. Furthermore, our experiments also demonstrate the validity of our theoretical framework, highlighting the importance of model locality in the context of EpiCoDe. Our main contributions are threefold: • We propose a frustratingly simple yet effective method, EpiCoDe, that benefits from both model extrapolation and contrastive decoding, enhancing model capabilities without additional training, particularly in data-scarcity scenarios. • We present a theoretical framework to explain the mechanism behind EpiCoDe and the model selection strategies in contrastive decoding, which have been only discussed empirically. • Experiments on three diverse tasks across four different base models show that our method can bring consistent improvement, significantly outperforming baseline methods. 2 Related Works The scarcity of high-quality annotated training data often prevents us from effectively finetuning LLMs, necessitating the development of approaches that go beyond conventional training paradigms. Among others, model extrapolation and contrastive decoding are two representative threads of research falling to this type. Model Extrapolation An intuitive idea to improve model performance is to extrapolate a model to a better position in the parameter space. However, we are unable to precisely locate the optimal point without training. A simple approximate solution is to regard model extrapolation as the reverse process of linear merging Zheng et al. 2024 . They first enhance a finetuned LLM with Reinforcement Learning with Human Feedback (RLHF, Ouyang et al. 2022 ). To obtain a better RLHF model, they hypothesize the RLHF model is constructed by merging the finetuned model and an unknown ultra-powerful model. As shown in the left part of Figure 1 , they argue that extrapolation can alleviate the limitation of insufficient training data, resulting a stronger RLHF model. Here, we believe model extrapolation might be a possible choice to make the most of limited training data by exploring across different checkpoints. In this paper, we extract an intermediate checkpoint during finetuning as the weak model. We then regard the model trained with more epochs as the strong model, and extrapolate it to obtain a stronger one. Contrastive Decoding Different from model extrapolation which edits the parameters to get a new model, contrastive decoding Li et al. 2023 combines two distinct LLMs’ predictions during inference. The fundamental hypothesis is that, on one hand, models trained on the same data may have similar patterns to make mistakes; while on the other hand, the capabilities of models differ due to model size. Li et al. 2023 ( Li et al. 2023 ) proposes to collect the two probability distributions of next token predicted by a strong and a weak model in the same family, respectively. Their difference may represent the capability gap between two models without shared errors. As shown in the right part of Figure 1 , contrastive decoding improves the quality of model outputs by modifying the predicted logit scores with the computed differences. In our work, we are interested in whether contrastive decoding can further enhance the extrapolated models. Different from previous works Li et al. 2023 ; O’Brien and Lewis 2023 that use LLMs in the same family but with different sizes, we here adopt the finetuned model and the extrapolated model for exploration. The effectiveness of contrastive decoding in data-scarcity scenarios, e.g., enhancing a finetuned model with its early version, is still an unexplored research question. 3 Methodology In this paper, we propose EpiCoDe, which leverages model extrapolation and contrastive decoding in data-scarcity scenarios, to boost model performance without additional training. 3.1 Preliminary In data scarcity scenarios, the training data available for finetuning is insufficient. We can only obtain under-trained LLMs with limited capabilities. And, model checkpoints collected from the earlier stage of such training conditions can perform unsurprisingly worse. Model Extrapolation. Following previous work Zheng et al. 2024 , we regard a strong model \theta^{strong} as the linearly merged model Wortsman et al. 2022 ; Choshen et al. 2022 of its weakened version \theta^{weak} and an ultra-strong model. Thus, we can obtain the unknown model by linear extrapolation: \theta^{ep}=\theta^{strong}+\mu(\theta^{strong}-\theta^{weak}), where \mu>0 is a hyper-parameter. Contrastive Decoding For the input sequence x_{ , our aim is to predict the next token x_{i} within the vocabulary \mathcal{V} . Given the distribution p_{s}(x_{i}|x_{0 is a hyper-parameter controlling the strength of contrastive decoding. 3.2 Our Method: EpiCoDe Figure 1: The process of EpiCoDe, which first employs model extrapolation to obtain a stronger LLM \theta^{ep} , and then uses contrastive decoding to get better logit scores. Formally, we denote the initial LLM as \theta^{init} and finetune it on the training dataset. We can collect the model from two training stages: (1) the model \theta^{early} at an early stage, which may be finetuned with part of the training data or trained with fewer epochs; (2) the model \theta^{ft} finetuned on all data with more epochs. However, in data scarcity cases, the model \theta^{ft} may be still undertrained, due to limited training data available. To address this challenge, we develop a novel method EpiCoDe, which integrates model extrapolation and contrastive decoding, without the need of any additional training. Figure 1 illustrates the process of EpiCoDe. We first employ model extrapolation, where \theta^{early} serves as the weak model and \theta^{ft} as the strong model, to obtain the extrapolated model \theta^{ep}=\theta^{ft}+\mu(\theta^{ft}-\theta^{early}) . By selecting an appropriate \mu , we can derive an extrapolated model \theta^{ep} with better capabilities compared to \theta^{ft} . During inference, we use contrastive decoding for better performance. As shown in the left part of Figure 1 , we have several models in hand, whose performance should have following ranking: \theta^{init}<\theta^{early}<\theta^{ft}<\theta^{ep} . We intuitively choose \theta^{ep} as the strong model in contrastive decoding, while one of the other three models can serve as the weak model. An important research question is which model should be employed to achieve the best performance. We argue that the similar error patterns between the weak and the strong model play an important role in the effectiveness of contrastive decoding. Thus, we employ \theta^{ft} , which locates the nearest to \theta^{ep} in the parameter space, as the weak model. The contrastive difference can be refined as c(x_{1 . We can then re-formulate logit score of contrastive decoding in Section 3.1 as: L_{CD}(x_{ ME DS-7B 0.0899 0.0198 0.0821 QW-1.5B 0.0026 0.0938 0.0711 QW-7B 0.0000 0.0067 0.0783 LM-3B 0.0000 0.0000 0.0001 EpiCoDe > CD DS-7B 0.0190 0.0341 0.0267 QW-1.5B 0.0342 0.0001 0.0116 QW-7B 0.0279 0.3344 0.0130 LM-3B 0.0113 0.0007 0.0006 Table 3: Significance level of mistakenly rejecting the null hypothesis \mathcal{H}_{0} in one-tailed tests. The dark red scores mean that the confidence to believe \mathcal{H}_{0} being true is lower than 95% . DS-7B, QW-1.5B, QW-7B, and LM-3B represent to employ Deepseek-7B-Chat, Qwen2-1.5B-Instruct, Qwen2-7B- Instruct, and Llama-3.2-3B-Instruct as the initial LLM, respectively. Significance of EpiCoDe’s Improvement We further study whether EpiCoDe can bring significantly more improvement than the baseline methods. For each task and each random seed, we evaluate the performance of three settings: (1)using only model extrapolation, (2) using only contrastive decoding, and (3) our proposed EpiCoDe method. Then, we compare the performance of the EpiCoDe method with the two baseline methods under the same random seed, conducting a paired t-test. The null hypothesis is that EpiCoDe performs better than each of the two baseline methods . Table 3 illustrates the magnitudes of the significance level \alpha , which means the probability of mistakenly rejecting the null hypothesis. Except for Qwen2-7B-Instruct on Math, we can conclude with more than 90% confidence level to believe that EpiCoDe outperforms the two baseline methods, using only model extrapolation or only contrastive decoding. Furthermore, across the 4 LLMs on 3 tasks, we have over 95% confidence to believe that EpiCoDe surpasses model extrapolation in 7 (/12) experiments and outperforms contrastive decoding in 11 (/12) experiments. Thus, we believe EpiCoDe is significantly better than the two baselines , which achieves optimal performance. Method Num. of Successful Runs Total (*/30) Law Math Logic Deepseek-7B-Chat ME 8 6 10 24 CD 8 4 8 20 EpiCoDe 10 8 10 28 Qwen2-1.5B-Instruct ME 8 9 7 24 CD 9 4 7 20 EpiCoDe 10 10 9 29 Qwen2-7B-Instruct ME 8 8 8 24 CD 10 8 7 25 EpiCoDe 10 10 10 30 Llama-3.2-3B-Instruct ME 10 10 10 30 CD 10 10 10 30 EpiCoDe 10 10 10 30 Table 4: The number of times that each method brings improvement to the finetuned models across 10 runs. Robustness of EpiCoDe Table 2 also shows that EpiCoDe can consistently enhance all the four LLMs across three tasks. But in the mathematical task, using only contrastive decoding or only model extrapolation sometimes fails to bring improvement (e.g., for Deepseek-7B-Chat and Qwen2-1.5B-Instruct). Thus, we further examine the number of times that each method successfully enhances the finetuned model across 10 repeated experiments. As shown in Table 4 , our EpiCoDe can provide very robust improvement for the finetuned LLMs , with merely three failures in a total of 120 experiments. As a comparison, model extrapolation yields improvement in 80% of the experiments on Deepseek-7B-Chat and the Qwen2 family. Even worse, contrastive decoding exhibits a higher frequency to fail in Deepseek-7B-Chat and Qwen2-1.5B-Instruct, especially on the mathematical task, where it has positive effects to each model merely 4 times. But for Qwen2-7B-Instruct, the two baselines have comparable rates to achieve better accuracy than finetuned models (24 vs. 25 out of 30 runs). Note that as a very strong LLM, Qwen2-7B-Instruct may have learned from various datasets, including those similar to our tasks. We guess that its parameters change less during the training process, which ensures locality between \theta^{early} and \theta^{ft} , an essential premise for contrastive learning to work. See more discussion about locality in Section 7.2 . For 10 runs across all three tasks, EpiCoDe and the two baselines can consistently improve Llama-3.2-3B-Instruct, which suffers extremely from the lack of Chinese training data. Since model extrapolation and contrastive decoding are both effective, we believe that the combination of two techniques plays a vital role to boost model performance in scenarios with restricted training resources. 7 Discussions 7.1 Where does the improvement come from? Table 2 shows that the effectiveness of each method varies across tasks. For instance, in logical reasoning, all three methods can improve the performance of each finetuned LLM, while in legal QA, the improvement becomes relatively less. However, in the mathematical task, only EpiCoDE yields improvement for all LLMs, while using only model extrapolation or only contrastive decoding even degrades performance for models such as Qwen2-1.5B-Instruct and Llama-3.2-3B-Instruct. We guess that the difficulty of a task may influence the effectiveness of these methods . Specifically, GSM8K_zh is a simple task, primarily consisting of grade school math problems. In contrast, legal QA and logical reasoning, as more difficult tasks, require LLMs to possess enough domain-specific knowledge and commonsense, to distinguish similar concepts, and to apply multi-step reasoning. The average length of training examples in Table 1 can represent the difficulties of each task (longer outputs for the more complex task). To dive deeper into where EpiCoDe brings the improvement, we take legal QA as an example. For each run, we collect the token sequences outputted by the finetuned model ( \theta^{ft} ), and count their lengths. We partition the test set of legal QA into three equal parts according to the length order. We then evaluate the improvement of the three methods on each subset. \theta^{init} \theta^{early} \theta^{ft} -1 - 0 1 2 Law Math Logic (a) Deepseek-7B-Chat \theta^{init} \theta^{early} \theta^{ft} - 0 1 Law Math Logic (b) Qwen2-1.5B-Instruct \theta^{init} \theta^{early} \theta^{ft} -1 - 0 1 Law Math Logic (c) Qwen2-7B-Instruct \theta^{init} \theta^{early} \theta^{ft} - 0 2 4 6 Law Math Logic (d) Llama-3.2-3B-Instruct Figure 2: The improvement of using \theta^{init} , \theta^{early} , or \theta^{ft} as the weak model, compared to the performance of vanilla finetuned model \theta^{init} . Method Easy Medium Hard Acc. \Delta Acc. Acc. \Delta Acc. Acc. \Delta Acc. Deepseek-7B-Chat Finetune 68.81 – 65.08 – 60.65 – ME 68.86 +0.05 65.26 +0.18 62.31 +1.67 EpiCoDe 68.93 +0.13 65.28 +0.19 62.49 +1.84 CD only 68.62 -0.18 65.16 +0.08 62.25 +1.60 Qwen2-1.5B-Instruct Finetune 69.05 – 64.37 – 59.68 – ME 69.31 +0.26 64.89 +0.52 60.70 +1.02 EpiCoDe 69.38 +0.33 65.88 +1.52 60.96 +1.28 CD only 69.25 +0.20 65.40 +1.03 61.07 +1.39 Qwen2-7B-Instruct Finetune 75.77 – 69.19 – 62.36 – ME 75.68 -0.10 69.52 +0.33 63.40 +1.04 EpiCoDe 75.70 -0.07 70.48 +1.28 64.80 +2.44 CD only 75.65 -0.13 69.95 +0.76 64.34 +1.98 Llama-3.2-3B-Instruct Finetune 64.74 – 62.36 – 59.37 – ME 65.15 +0.41 63.07 +0.71 60.04 +0.67 EpiCoDe 65.27 +0.52 63.84 +1.48 62.33 +2.96 CD only 65.23 +0.48 63.58 +1.21 61.39 +2.03 Table 5: Each method’s accuracy on the three subsets of legal QA. For each experiment, we compare the improvement brought by corresponding method on the three subsets. T he highest improvement among three subsets is made bold , while the second highest is made italic . Table 5 shows the performance of vanilla finetuned LLMs and the models enhanced by each method. By comparing the results of finetuned models and extrapolated models, we find that model extrapolation can significantly benefits the hard subsets (needing the longest CoT), resulting in improvement of +1.02%~+1.67% on Qwen family and Deepseek-7B-Chat. But for the easy part, model extrapolation improves the performance much less, sometimes even degrading the accuracy. However, for Llama-3.2-3B-Instruct which has limited Chinese capabilities, model extrapolation brings comparable improvement to three subsets. We then examine the performance of EpiCoDe. EpiCoDe surpasses model extrapolation by +0.17%~+1.40% on the hard subset, while merely +0.01~+1.00% on the medium subset. Thus, our EpiCoDe, which is further enhanced by contrastive decoding, also gains improvement primarily from the hard part. We also study the effect of using only contrastive decoding, where \theta^{ft} and \theta^{early} serve as the strong and the weak model, respectively. It also results in the most improvement (+1.39%~+2.03%) on the hard subsets, but relatively less improvement (+0.08%~+1.21%) on the medium ones and even nearly no improvement on the easy ones. We believe that model extrapolation and contrastive decoding play similar roles in improving LLMs’ capabilities, especially when generating longer CoT to tackle challenging problems . We also argue that EpiCoDe can integrate the strengths of both techniques to achieve optimal performance. 7.2 Examination of Locality After model extrapolation, we can obtain four models, \theta^{init} , \theta^{early} , \theta^{ft} , and \theta^{ep} . We intuitively employ \theta^{ep} as the strong model in contrastive decoding, due to its strongest capabilities. We aim to study the effect of selecting each of the other models as the weak model. Figure 2 illustrates the improvement of employing each model as the weak model during contrastive decoding. We find that when using the initial model \theta^{init} as the weak model, the performance of EpiCoDe often lags behind the vanilla finetuned model \theta^{ft} , especially in mathematical tasks. This demonstrates that the weak model must learn from the same datasets to the extrapolated model; otherwise, contrastive decoding will have a negative effect , even neutralizing the improvements brought by model extrapolation. Previous works O’Brien and Lewis 2023 ; Chang et al. 2024 argue that a larger capability gap between the weak and the strong model can bring more improvement, which indicates \theta^{early} may be a better choice than \theta^{ft} . However, Figure 2 shows that, if we employ \theta^{early} as the weak model in contrastive decoding, EpiCoDe often achieves comparable accuracy to the extrapolated model \theta^{ep} , for instance, Deepseek-7B-Chat and Qwen2-1.5B on legal QA and logical reasoning. In the mathematical task, using \theta^{early} also makes the improvement of EpiCoDe down to around zero. As shown in Section 4 , we empirically demonstrate that in data-scarcity scenarios, several update steps may break the locality of models, resulting in inconsistent error patterns . Comparing the results in Figure 2 , we find that employing \theta^{ft} as the weak model can consistently achieve the optimal performance for each LLM across all tasks. We are confident that when selecting models from different training stages for contrastive decoding, similar error patterns between the strong and the weak model is more crucial than a large capability gap . Therefore, different from previous works O’Brien and Lewis 2023 ; Chang et al. 2024 , the best strategy here is to choose models from adjacent stages. 8 Conclusion In this paper, we propose an easy yet effective method, EpiCoDe, to enhance finetuned LLMs in data scarcity scenarios. Benefiting from both model extrapolation and contrastive decoding, EpiCoDe can operate without additional training. Extensive experiments across different tasks show that EpiCoDe can bring consistent improvement, significantly outperforming baseline models. We also propose a theoretical framework from the perspective of logit errors to analyze the mechanisms of how EpiCoDe can work better. We find that model extrapolation naturally ensures the locality between the finetuned LLM and the extrapolated LLM. During inference, their locality further fulfills the prerequisite that enables contrastive decoding to be effective. Limitations Investigated Tasks Due to the limitation of copyrights, there are still no publicly accessible legal QA or logical testing datasets in English. Thus, we employ the legal QA datasets adapted from the judicial examination of China and the logical reasoning dataset from National Public Service Examination in China. Such tasks are challenging enough, since they require LLMs to possess domain-specific knowledge and commonsense and to obtain final answers through complex multi-step reasoning. Existing LLMs still can not perform well on such tasks Yue et al. 2023 ; Liu et al. 2023 , which aligns the need of developing training-free methods to enhance model capabilities. Investigated Models Due to the restrictions of computational resources, we mainly study the LLMs with scales from 1.5B to 7B. The results of LLMs from difference families across all three tasks show that our proposed EpiCoDe can consistently outperform the baselines. We believe that EpiCoDe can be effective for larger LLMs, which suffer more from data scarcity. Appendix A Hyper-Parameter Selection For model extrapolation, we empirically choose the hyper-parameter \mu from 1e-4 to 0.8 by logarithmic interval, within \{1,\,2,\,4,\,6,\,8\}\times\{10^{-4},\,10^{-3},\,10^{-2},\,10^{-1}\} . And for contrastive decoding, we choose the hyper-parameter \lambda within \{0.1,\,0.2,\,0.4,\,0.6,\,0.8,\,1.0\} . For all experiments, we search the optimal hyper-parameters on development sets, and then employ the same hyper-parameters to evaluate models on hold-out test sets. Magnitude of \mu DS-7B QW-1.5B QW-7B LM-3B 0 (vanilla finetuned) 57.22 52.68 66.67 53.45 1e-4 \sim 8e-4 57.58 52.87 67.19 54.00 1e-3 \sim 8e-3 58.39 53.43 66.90 55.11 1e-2 \sim 8e-2 57.29 52.99 66.82 55.10 1e-1 \sim 8e-1 57.06 51.38 66.53 54.20 Table 6: Performance of extrapolated LLMs on Logic under different \mu . The highest results are made bold , with the second underlined . DS-7B, QW-1.5B, QW-7B, and LM-3B share the same mearnings with those in Table 3 . Magnitude of \lambda DS-7B QW-1.5B QW-7B LM-3B 0 (only using ME) 58.89 53.63 67.60 55.11 0.1 58.86 53.64 67.59 56.27 0.2 58.97 53.57 68.06 56.68 0.4 58.77 53.79 68.03 56.80 0.6 58.46 53.74 67.97 57.16 0.8 58.55 53.48 67.81 57.33 1.0 58.34 52.98 67.49 57.06 Table 7: Performance of contrastive decoding on Logic under different \lambda . The highest results are made bold , with the second underlined . DS-7B, QW-1.5B, QW-7B, and LM-3B share the same mearnings with those in Table 3 . Since EpiCoDe can be regarded as a two-stage method, we do NOT use grid search to concurrently optimize \mu and \lambda . Instead, we first select the optimal \mu in model extrapolation. We then search \lambda with \mu frozen, ensuring all experiments are fair between EpiCoDe and only using model extrapolation. We find that these hyper-parameters have similar effects across distinct LLMs and runs. As \mu or \lambda increases from small to large, the improvement brought by model extrapolation or contrastive decoding exhibits convexity. For example, Table 6 shows the effect of \mu with different magnitudes in model extrapolation on the Logic task (average over 10 runs). We also use Figure 7 to illustrate the effect of different \lambda in contrastive decoding on Logical Reasoning (average over 10 runs). Similar to previous works O’Brien and Lewis 2023 ; Zheng et al. 2024 , when \mu or \lambda is small, both model extrapolation and contrastive decoding can bring more improvement as the \mu or \lambda grows larger. But if we use very large \mu or \lambda , the two methods will fail to improve model performance. Appendix B LLMs with Different Sizes in CD Inspired by previous work Li et al. 2023 ; O’Brien and Lewis 2023 which employs a small and a large model in contrastive decoding, we also wonder during inference, whether EpiCoDe is still effective if using two models with different numbers of parameters. Thus, we employ the extrapolated Qwen2-7B-Instruct as the strong model and the finetuned Qwen2-1.5B-Instruct as the weak model. Table 8 shows that contrastive decoding can sometimes be effective when we employ a smaller LLM, which is finetuned on the same data, as the weak model. However, such setting brings less improvement than EpiCoDe where we employ the same-size finetuned LLM as weak model. Using LLMs of different sizes is also not robust enough to enhance model performance. For example, in two runs on Math, if we employ \theta^{ep} of Qwen2-1.5B as the weak model, the accuracy scores decrease from around 57% to around 16%, resulting in catastrophic deterioration. From these additional results, we find that the effectiveness of contrastive decoding may be highly dependent on the locality . Beyond existing methods which employ a large LLM as the strong model and a small LLM as the weak model, our proposed EpiCoDe can achieve the optimal performance. Weak Model Law Math Logic \theta^{ft} of Qwen2-1.5B 69.60 {}_{\text{(+0.57)}} 49.39 {}_{\text{(\,-\,7.73)}} 67.91 {}_{\text{(+1.24)}} \theta^{init} of Qwen2-7B 68.70 {}_{\text{(\,-\,0.33)}} 55.96 {}_{\text{(\,-\,1.16)}} 66.78 {}_{\text{(+0.11)}} \theta^{early} of Qwen2-7B 69.63 {}_{\text{(+0.60)}} 58.27 {}_{\text{(+1.15)}} 66.75 {}_{\text{(+0.08)}} \theta^{ft} of Qwen2-7B 70.25 {}_{\text{(+1.22)}} 58.71 {}_{\text{(+1.59)}} 68.07 {}_{\text{(+1.40)}} Table 8: The results of different weak models in EpiCoDe. For all experiments, we employ \theta^{ep} of Qwen2-7B-Instruct as the strong model.