Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training

Jie Xu, Zihan Wu · 2025

Read Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training by Jie Xu, Zihan Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10793.txt.

Introduction

Xu and Wu present a tracker for how training samples influence a model over time in twenty twenty-five. Older methods give one static score for each sample's influence. Influence in fact changes as training proceeds. Their Dynamic Influence Tracker measures it across any time window during training.

Samples show varied time patterns of influence in their experiments. Some matter early, while others become important only later. Influence in early and late stages correlates only weakly. The authors read this as distinct learning phases with shifting priorities. Focusing on the convergence period detects corrupted samples more efficiently. The method carries theory guarantees without assuming convexity or convergence. It reached near perfect correlation with ground truth in tests.

Catalog record

CREATORJie Xu, Zihan Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10793

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamic Influence Tracker: Measuring Time-Varying Sample Influence During Training Jie Xu, Zihan Wu Abstract Existing methods for measuring training sample influence on models only provide static, overall measurements, overlooking how sample influence changes during training. We propose Dynamic Influence Tracker (DIT), which captures the time-varying sample influence across arbitrary time windows during training. DIT offers three key insights: 1) Samples show different time-varying influence patterns, with some samples important in the early training stage while others become important later. 2) Sample influences show a weak correlation between early and late stages, demonstrating that the model undergoes distinct learning phases with shifting priorities. 3) Analyzing influence during the convergence period provides more efficient and accurate detection of corrupted samples than full-training analysis. Supported by theoretical guarantees without assuming loss convexity or model convergence, DIT significantly outperforms existing methods, achieving up to 0.99 correlation with ground truth and above 98% accuracy in detecting corrupted samples in complex architectures. I Introduction Understanding training sample influence on deep learning models remains a key challenge for model interpretability and robustness. While influence functions [ 1 ] and subsequent research [ 2 , 3 , 4 ] can measure sample influence on models, they only work after model convergence, failing to capture the sample influence during training. This limitation motivates two fundamental questions: 1) How does sample influence evolve during training? 2) How can we measure and utilize these time-varying dynamics to improve model training? Answering these questions is challenging. First, analyzing non-converged models requires new theoretical frameworks beyond existing influence methods that rely on model convergence [ 5 ] . Second, measuring time-varying influence requires intensive computation of model updates, demanding high computational resources. Third, it is required to analyze multiple aspects of model behavior, such as parameter changes, loss changes, and prediction changes, to capture the complex interplay between samples and model learning dynamics. To address these challenges, we propose Dynamic Influence Tracker (DIT), a query-based framework that measures the time-varying influence of training samples during training. DIT first estimates how removing individual samples affects model parameters in training windows. Then, DIT computes inner products between parameter changes and task-specific query vectors to efficiently measure sample influence on model behaviors. Using DIT, we uncover several key insights about learning dynamics. First, samples show different time-varying influence patterns (Early Influencers, Late Bloomers, Stable Influencers, and Highly Fluctuating), revealing the limitations of traditional static influence analysis methods. Second, sample influences show a weak correlation between early and late stages, revealing the multi-stage nature of deep learning, where learning priorities shift significantly over time. Third, it is more effective and efficient to identify corrupted samples by analyzing sample influence during the model convergence period than the entire training process. In summary, DIT has the following advantages: • Accurate and Dynamic Influence Analysis. DIT achieves state-of-the-art accuracy with a 0.99 correlation to ground truth. As the first approach enabling influence analysis within any training window, DIT enables efficient corruption detection ( > 98% accuracy) in single-epoch analysis. • Query-Based Multi-faceted Influence Measure. DIT uses queries to evaluate how samples impact multiple aspects of model behavior, providing a comprehensive evaluation during training. • Robustness to Non-Convergence and Non-Convexity. DIT theoretically guarantees influence estimation for arbitrary training windows without requiring model convergence or loss convexity, supporting real-world deep learning applications. II Preliminaries Let \mathcal{Z}=\mathcal{X}\times\mathcal{Y} denote the space of observations, where \mathcal{X}\subseteq\mathbb{R}^{d} is the input space and \mathcal{Y} is the output space. Given a training set D=\{z_{i}\}_{i=1}^{N} of i.i.d. observations z_{i}=(x_{i},y_{i})\in\mathcal{Z} , a model f:\mathcal{X}\times\Theta\rightarrow\mathcal{Y} parameterized by \theta\in\Theta\subseteq\mathbb{R}^{p} , and a loss function \ell:\mathcal{Z}\times\Theta\rightarrow\mathbb{R} , we formulate the learning problem as: \hat{\theta}=\arg\min_{\theta\in\Theta}\frac{1}{N}\sum_{i=1}^{N}\ell(z_{i};\theta). (1) Definition 1 (Stochastic Gradient Descent (SGD)) . Let g(z;\theta)=\nabla_{\theta}\ell(z;\theta) , and SGD starts from \theta^{[0]} . For mini-batch S_{t}\subseteq\{1,...,N\} and learning rate \eta_{t} at step t , SGD updates: \theta^{[t+1]}=\theta^{[t]}-\frac{\eta_{t}}{|S_{t}|}\sum_{i\in S_{t}}g(z_{i};\theta^{[t]}),\quad 0\leq t\leq T-1, (2) where T is the total number of SGD steps. Definition 2 (Influence Function [ 1 ] ) . The influence function measures the effect of removing sample z_{j} on optimal parameters \hat{\theta} , defined as \hat{\theta}_{-j}-\hat{\theta} where \hat{\theta}_{-j}=\arg\min_{\theta}\sum_{i=1,i\neq j}^{N}\ell(z_{i};\theta) . For strongly convex losses, it can be approximated as: \hat{\theta}_{-j}-\hat{\theta}\approx-\hat{H}^{-1}\nabla_{\theta}\ell(z_{j};\hat{\theta}), (3) where \hat{H}=\frac{1}{N}\sum_{z\in D}\nabla^{2}\ell(z;\hat{\theta}) is the Hessian of the loss at the optimal parameters. Definition 3 (Counterfactual SGD) . The counterfactual SGD excludes the j -th training sample to analyze its influence. Starting from \theta_{-j}^{[0]}=\theta^{[0]} , the parameters are updated at each step t using: \theta^{[t+1]}=\theta^{[t]}-\frac{\eta_{t}}{|S_{t}|}\sum_{i\in S_{t}\setminus\{j\}}g(z_{i};\theta_{-j}^{[t]}),\quad 0\leq t\leq T-1. (4) Definition 4 (SGD-Influence [ 6 ] ) . The SGD-influence of training sample z_{j}\in D within t steps is defined as \theta_{-j}^{[t]}-\theta^{[t]} . While the influence function analyzes impact at the optimum, SGD-Influence measures how excluding sample z_{j} affects the entire training process. The following sections will introduce our method for estimating sample influence during arbitrary training windows. III Parameter Change in Time Window III-A Problem Formulation Our goal is to estimate the impact of training samples during an arbitrary time window [t_{1},t_{2}] , where 0\leq t_{1}<t_{2}\leq T . We formalize this goal with a counterfactual question: how would the model’s parameters change during the interval [t_{1},t_{2}] if a specific sample z_{j} is not used? Definition 5 (Parameter Change in Time Window) . For a time window [t_{1},t_{2}] during SGD training, the parameter change estimates the contribution of a training sample z_{j} as: \Delta\theta_{-j}^{[t_{1},t_{2}]}=(\theta_{-j}^{[t_{2}]}-\theta_{-j}^{[t_{1}]})-(\theta^{[t_{2}]}-\theta^{[t_{1}]}), (5) where (\theta^{[t_{2}]}-\theta^{[t_{1}]}) represents the parameter changes under standard SGD within [t_{1},t_{2}] , and (\theta_{-j}^{[t_{2}]}-\theta_{-j}^{[t_{1}]}) represents the parameter changes over the same interval when excluding sample z_{j} . For the special case [0,t] , starting from the beginning of training, this simplifies to: \displaystyle\Delta\theta_{-j}^{[0,t]}=(\theta_{-j}^{[t]}-\theta_{-j}^{[0]})-(\theta^{[t]}-\theta^{[0]})=\theta_{-j}^{[t]}-\theta^{[t]}. (6) For brevity, we denote \Delta\theta_{-j}^{[t]}=\Delta\theta_{-j}^{[0,t]} . III-B Estimation of Parameter Change in Time Window We aim to estimate the parameter change due to the absence of sample z_{j} over the time window [t_{1},t_{2}] , where 0\leq t_{1}<t_{2}\leq T : \begin{split}\Delta\theta_{-j}^{[t_{1},t_{2}]}=(\theta_{-j}^{[t_{2}]}-\theta_{-j}^{[t_{1}]})-(\theta^{[t_{2}]}-\theta^{[t_{1}]})\\ =(\theta_{-j}^{[t_{2}]}-\theta^{[t_{2}]})-(\theta_{-j}^{[t_{1}]}-\theta^{[t_{1}]}).\end{split} (7) Consider the normal SGD update for step t : \theta^{[t+1]}=\theta^{[t]}-\frac{\eta_{t}}{|S_{t}|}\sum_{i\in S_{t}}g(z_{i};\theta^{[t]}). (8) Consider the SGD update excluding sample z_{j} : \theta_{-j}^{[t+1]}=\theta_{-j}^{[t]}-\frac{\eta_{t}}{|S_{t}|}\sum_{i\in S_{t}\setminus\{j\}}g(z_{i};\theta_{-j}^{[t]}). (9) Calculate the difference between the two updates: \begin{split}&\theta_{-j}^{[t+1]}-\theta^{[t+1]}=(\theta_{-j}^{[t]}-\theta^{[t]})\\ &-\frac{\eta_{t}}{|S_{t}|}(\sum_{i\in S_{t}\setminus\{j\}}g(z_{i};\theta_{-j}^{[t]})-\sum_{i\in S_{t}}g(z_{i};\theta^{[t]})).\end{split} (10) Approximate the gradient differences using a first-order Taylor expansion: g(z_{i};\theta_{-j}^{[t]})-g(z_{i};\theta^{[t]})\approx\nabla_{\theta}g(z_{i};\theta^{[t]})^{T}(\theta_{-j}^{[t]}-\theta^{[t]}), (11) where \nabla_{\theta}g(z_{i};\theta^{[t]}) is the gradient of g(z_{i};\theta) with respect to \theta , evaluated at \theta^{[t]} . Define the approximate Hessian matrix H^{[t]} as the average of the outer products of these gradients over the mini-batch: H^{[t]}=\frac{1}{|S_{t}|}\sum_{i\in S_{t}}\nabla_{\theta}g(z_{i};\theta^{[t]})^{T}. (12) Averaging Eq.( 11 ) over S_{t} and using Eq.( 12 ), we have: \frac{1}{|S_{t}|}\sum_{i\in S_{t}}(g(z_{i};\theta_{-j}^{[t]})-g(z_{i};\theta^{[t]}))\approx H^{[t]}(\theta_{-j}^{[t]}-\theta^{[t]}). (13) Using Eq.( 13 ) in Eq.( 10 ), we have: \begin{split}\theta_{-j}^{[t+1]}-\theta^{[t+1]}&\approx(I-\eta_{t}H^{[t]})(\theta_{-j}^{[t]}-\theta^{[t]})\\ &+\mathbf{1}_{j\in S_{t}}\frac{\eta_{t}}{|S_{t}|}g(z_{j};\theta^{[t]}),\end{split} (14) where \mathbf{1}_{j\in S_{t}} is an indicator function that equals 1 if j\in S_{t} , otherwise 0. The full derivation is provided in Appendix A . Let Z_{t}=I-\eta_{t}H^{[t]} , \mathbf{\tilde{1}}_{j}^{[t]}=\mathbf{1}_{j\in S_{t}}\frac{\eta_{t}}{|S_{t}|}g(z_{j};\theta^{[t]}) and recursively apply this relation over the interval [t_{1},t_{2}] : \begin{split}\theta_{-j}^{[t_{2}]}-\theta^{[t_{2}]}\approx Z_{t_{2}-1}Z_{t_{2}-2}\ldots Z_{t_{1}}(\theta_{-j}^{[t_{1}]}-\theta^{[t_{1}]})\\ +\sum_{t=t_{1}}^{t_{2}-1}Z_{t_{2}-1}Z_{t_{2}-2}\ldots Z_{t+1}\mathbf{\tilde{1}}_{j}^{[t]}.\end{split} (15) Combining Eq. ( 7 ) and Eq. ( 15 ), we can get: \begin{split}\Delta\theta_{-j}^{[t_{1},t_{2}]}\approx\left(\prod_{k=t_{1}}^{t_{2}-1}Z_{k}-I\right)(\theta_{-j}^{[t_{1}]}-\theta^{[t_{1}]})\\ +\sum_{t=t_{1}}^{t_{2}-1}\left(\prod_{k=t+1}^{t_{2}-1}Z_{k}\right)\mathbf{\tilde{1}}_{j}^{[t]}.\end{split} (16) We use Eq. ( 16 ) for the interval [0,t_{1}] with \theta_{-j}^{[0]}=\theta^{[0]} to get (\theta_{-j}^{[t_{1}]}-\theta^{[t_{1}]}) : \Delta\theta_{-j}^{[0,t_{1}]}=\theta_{-j}^{[t_{1}]}-\theta^{[t_{1}]}\approx\sum_{t=0}^{t_{1}-1}\left(\prod_{k=t+1}^{t_{1}-1}Z_{k}\right)\mathbf{\tilde{1}}_{j}^{[t]}. (17) Substituting Eq. ( 17 ) into Eq. ( 16 ), we obtain: \begin{split}\Delta\theta_{-j}^{[t_{1},t_{2}]}\approx&\left(\prod_{k=t_{1}}^{t_{2}-1}Z_{k}-I\right)\left(\sum_{t=0}^{t_{1}-1}\left(\prod_{k=t+1}^{t_{1}-1}Z_{k}\right)\mathbf{\tilde{1}}_{j}^{[t]}\right)\\ &+\sum_{t=t_{1}}^{t_{2}-1}\left(\prod_{k=t+1}^{t_{2}-1}Z_{k}\right)\mathbf{\tilde{1}}_{j}^{[t]}.\end{split} (18) We denote the right-hand side of Eq. ( 18 ) as \widehat{\Delta\theta}_{-j}^{[t_{1},t_{2}]} , which represents our estimator of the parameter change.

Read the complete text