TDGNet: Hallucination Detection in Diffusion Language Models via Temporal Dynamic Graphs Arshia Hemmat, Philip Torr, Yongqiang Chen, Junchi Yu Abstract Diffusion language models (D-LLMs) offer parallel denoising and bidirectional context, but hallucination detection for D-LLMs remains underexplored. Prior detectors developed for auto-regressive LLMs typically rely on single-pass cues and do not directly transfer to diffusion generation, where factuality evidence is distributed across the denoising trajectory and may appear, drift, or be self-corrected over time. We introduce TDGNet, a temporal dynamic graph framework that formulates hallucination detection as learning over evolving token-level attention graphs. At each denoising step, we sparsify the attention graph and update per-token memories via message passing, then apply temporal attention to aggregate trajectory-wide evidence for final prediction. Experiments on LLaDA-8B and Dream-7B across QA benchmarks show consistent AUROC improvements over output-based, latent-based, and static-graph baselines, with single-pass inference and modest overhead. These results highlight the importance of temporal reasoning on attention graphs for robust hallucination detection in diffusion language models. 1 Introduction Figure 1 : Why Temporal Modeling is Essential. We visualize four diffusion dynamics that confound static baselines: Self-Correction (early noise resolves into fact); Correctness Decay and Semantic Drift (where factual or plausible states degrade into hallucinations); and Persistent Error (where errors lock in early). TDGNet aggregates structural signals across the trajectory sequences to distinguish these evolving patterns, avoiding the pitfalls of single-snapshot detectors. The auto-regressive large language models (AR-LLMs) have become the de facto paradigm across a wide range of applications, from natural language understanding ( Brown et al. 2020 ; Ouyang et al. 2022 ; Achiam et al. 2023 ) to general-purpose task execution ( Vaswani et al. 2017 ; Brown et al. 2020 ; Touvron et al. 2023 ) . Recently, diffusion-based large language models (D-LLMs) ( Nie et al. 2025 ; Ye et al. 2025 ; Sahoo et al. 2024 ) have emerged as a compelling alternative to their auto-regressive counterparts. In contrast to AR-LLMs, which generate text sequentially via next-token prediction, D-LLMs leverage bi-directional attention and iteratively denoise the entire output sequence in generation. This formulation enables more flexible generation dynamics ( Li et al. 2022 ; Mireshghallah et al. 2022 ) and can significantly improve inference efficiency through parallel decoding mechanisms ( Zhang et al. 2025 ; Ghazvininejad et al. 2019 ) . Recent representative models, such as LLaDA-8B ( Nie et al. 2025 ) and Dream-7B ( Ye et al. 2025 ) , have demonstrated that D-LLMs can be successfully scaled to the billion-parameter scale with comparable performance to popular AR-LLMs of similar size across a wide range of diverse tasks ( Nie et al. 2025 ; Ye et al. 2025 ) . As the capabilities of D-LLMs increase significantly, it becomes increasingly critical to ensure the generated content from D-LLMs is factually correct. However, the hallucination detection problem remains substantially less explored than that in AR-LLMs. Existing methods designed for AR models are fundamentally ill-suited for the diffusion paradigm due to two architectural mismatches. First, the probabilistic intractability of diffusion generation prevents the computation of reliable single-pass confidence scores of the responses without expensive trajectory marginalization ( Kuhn et al. 2023 ; Sahoo et al. 2024 ) . Second, D-LLMs exhibit temporal oscillation , where predictions fluctuate between factual and hallucinated states during the iterative denoising process ( Wang et al. 2025 ) . Such a phenomenon demonstrates that hallucinations manifest as dynamic events in the generation process of D-LLMs, such as self-correction, late-stage drift, or persistence, rather than static errors in the model responses. Thus, effective hallucination detection in D-LLMs requires modeling the temporal evolution of the generation trajectory rather than inspecting isolated snapshots of the output ( Chang et al. 2025 ) . Building on the observation that hallucinations in D-LLMs unfold over the denoising trajectory (Section 4.3 ), we focus on how such dynamics should be represented for effective detection. While one may attempt to model the generation process as a sequence of intermediate token states, this abstraction fails to capture the underlying structure in the intermediate contexts. Unlike AR-LLMs, D-LLMs rely on bi-directional attention to iteratively refine global context, which introduces evolving correlations among tokens during the generation process. This evolving pattern of token correlations suggests a representation that explicitly models both relational structure and temporal evolution. In this work, we propose TDGNet, a temporal graph–based framework for hallucination detection in diffusion-based LLMs that explicitly models the evolving relational structure of the denoising process. The motivation is that hallucinations in D-LLMs arise from changes in token interactions over time, which cannot be reliably captured by sequence-based or snapshot-based representations. Specifically, TDGNet formulates hallucination detection as a temporal graph learning problem, where tokens are treated as nodes and their interactions evolve across denoising steps. TDGNet maintains a persistent memory state ( Rossi et al. 2020 ) for each token that is updated through temporal message passing. This design enables the TDGNet to aggregate subtle signs of hallucination from the token dependency across the denoising generation process of D-LLMs. Moreover, TDGNet naturally supports both sequence-level and token-level hallucination detection, enabling identification of hallucination at multiple granularities. Figure 2 : Overview of the TDGNet framework. The model extracts attention maps across diffusion denoising steps to construct a temporal dynamic graph, which is then processed by a Temporal Graph Network to predict hallucination probability. We evaluate our method on two open-source D-LLMs, LLaDA-8B and Dream-7B ( Nie et al. 2025 ; Ye et al. 2025 ) , across multiple-choice, open-ended, and contextual QA benchmarks, using AUROC as the primary metric for hallucination detection. Our temporal graph detector consistently outperforms strong output-based, latent-based, and attention/graph-based baselines, on all datasets and on both models, and remains robust under different denoising schedules and graph-construction choices (Tables 1 , 2 , and 5 ). Our main contributions are: • We analyze hallucination dynamics in D-LLMs and show that factuality signals are weak at any single denoising step and instead accumulate across the denoising trajectory (Section 4.3 ). • We propose TDGNet , a temporal graph learning framework that tracks token interactions with persistent memories, enabling both response-level detection and token-level localization in a unified model (Section 3 ). • Across LLaDA-8B and Dream-7B on QA benchmarks, TDGNet achieves consistent AUROC improvements over output-based and latent-based baselines, supported by ablations and cross-model evaluations that both attention-graph structure and temporal modeling are essential for strong performance. (Section 4.3 ). 2 Related Work Hallucination Detection is a central problem for safe and truthful deployment of LLM-based systems. Most existing methods are designed for AR-LLMs and are commonly grouped into: (i) Output-based approaches, which use output-derived signals such as semantic entropy and lexical similarity, as well as other uncertainty measures and self-consistency signals ( Chang et al. 2025 ; Kuhn et al. 2023 ; Lin et al. 2023 ; Kossen et al. 2024 ; Manakul et al. 2023 ) ; and (ii) Latent-based approaches, which probe internal states (hidden representations) to directly separate truthful vs hallucinated generations ( Chang et al. 2025 ; Azaria & Mitchell 2023 ; Chen et al. 2024 ; Burns et al. 2022 ; Park et al. 2025 ; Orgad et al. 2024 ; Du et al. 2024 ; Su et al. 2024b ) . In addition, retrieval-augmented or tool-based factuality checking methods can be effective, but they rely on external knowledge sources and extra pipelines, which is not always aligned with a pure internal-signal detection objective ( Min et al. 2023 ; Chern et al. 2023 ) . Diffusion-style language models generate text by iteratively denoising a corrupted sequence, enabling refinement-based decoding rather than strict left-to-right next-token prediction ( Zhang et al. 2025 ; Lou et al. 2023 ) . Recent discrete diffusion objectives and reparameterized decoding schemes have improved the practicality of diffusion for language modeling and infilling ( Lou et al. 2023 ; Zheng et al. 2023 ) . More broadly, diffusion decoding is increasingly framed as a key branch of parallel text generation with an explicit compute, quality trade-off ( Zhang et al. 2025 ) . Diffusion Large Language Model extends diffusion models to text generation ( Li et al. 2022 ; Sahoo et al. 2024 ) . However, hallucination detection for D-LLMs is still underexplored, and existing AR-LLM detectors face practical mismatches because D-LLMs are generated through a multi-step denoising process and may not expose the same token-logit signals as AR decoding ( Chang et al. 2025 ) . Graph neural networks (GNNs) provide a general framework for learning on relational structures by iteratively passing and aggregating messages along edges ( Gilmer et al. 2017 ; Battaglia et al. 2018 ) . Popular architectures include graph convolutions and attention-based layers ( Kipf 2016 ; Hamilton et al. 2017 ; Veličković et al. 2017 ; Xu et al. 2018 ) . When interactions evolve, temporal/dynamic GNNs incorporate time encodings and persistent node memories to model sequences of graph snapshots or continuous-time event streams ( Pareja et al. 2020 ; Sankar et al. 2020 ; Trivedi et al. 2019 ; Kumar et al. 2019 ; Xu et al. 2020 ; Rossi et al. 2020 ) . In transformer-based models, self-attention naturally induces a weighted directed token graph whose edge weights and node states change across layers and iterative decoding steps, making temporal graph learning a convenient abstraction for modeling and aggregating these evolving dependency structures ( Vaswani et al. 2017 ) . 3 Method Table 1: Hallucination Detection Performance (AUROC) on LLaDA and Dream-7B. We compare TDGNet against output-, latent-, and graph-based baselines across four QA benchmarks. TDGNet consistently achieves state-of-the-art performance, outperforming strong baselines (e.g., TSV) by up to 8.5%. These results confirm that modeling the denoising trajectory yields superior robustness compared to static output statistics or isolated snapshots. (SS: Single Sampling). Model Metric SS Math CSQA HotpotQA TriviaQA Ave LLaDA-8B-Instruct Output-Based Semantic Entropy ✗ 0.68 0.64 0.61 0.66 0.65 Lexical Similarity ✗ 0.51 0.53 0.54 0.54 0.53 LN-Entropy ✗ 0.70 0.59 0.55 0.55 0.60 Perplexity ✗ 0.67 0.60 0.51 0.54 0.58 Latent-Based EigenScore ✗ 0.56 0.54 0.56 0.59 0.56 TSV ✓ 0.72 0.61 0.55 0.50 0.60 CCS ✓ 0.59 0.56 0.60 0.54 0.57 TDGNet (Ours) ✓ 0.72 0.65 0.64 0.72 0.68 Dream-7B-Instruct Output-Based Semantic Entropy ✗ 0.59 0.50 0.68 0.69 0.62 Lexical Similarity ✗ 0.71 0.68 0.71 0.67 0.69 LN-Entropy ✗ 0.57 0.59 0.52 0.53 0.55 Perplexity ✗ 0.52 0.57 0.51 0.54 0.54 Latent-Based EigenScore ✗ 0.68 0.55 0.63 0.70 0.64 TSV ✓ 0.68 0.71 0.43 0.50 0.58 CCS ✓ 0.59 0.56 0.64 0.60 0.60 TDGNet (Ours) ✓ 0.72 0.72 0.74 0.74 0.73 3.1 Problem Formulation We consider a Diffusion Language Model (D-LLM) that generates a response sequence \mathbf{y}_{0}=(y^{1},\dots,y^{n}) conditioning on an input prompt \mathbf{x} . Unlike sequential auto-regressive generation, D-LLMs generate text via a global, iterative refinement process ( Li et al. 2022 ) . The generation commences from a fully masked sequence \mathbf{y}_{T} (where all positions are initialized to a special mask token) ( Sahoo et al. 2024 ) . Over T discrete timesteps, the model progressively denoises this sequence to produce a decoding trajectory of intermediate states \mathcal{T}=\{\mathbf{y}_{T},\mathbf{y}_{T-1},\dots,\mathbf{y}_{0}\} ( Nie et al. 2025 ) . Each transition is governed by a learned conditional distribution p_{\theta}(\mathbf{y}_{t-1}|\mathbf{y}_{t},\mathbf{x}) , where the model utilizes bidirectional attention to refine the semantic structure of the entire sequence simultaneously during the iterative decoding process ( Gong et al. 2024 ; Zhang et al. 2025 ) . In this context, we frame hallucination detection as evaluating the factual validity of the generated content. Let h\in\{0,1\} be the ground-truth label where h=1 indicates a hallucination. The goal is to learn a binary classifier f from a hypothesis space \mathcal{H} that minimizes the classification risk for the response \mathbf{y}_{0} , subject to the constraint that \mathbf{y}_{0} is the result of the model’s reverse diffusion process: \min_{f\in\mathcal{H}}\mathcal{L}(h,f(\mathbf{x},\mathbf{y}_{0})),\quad\text{s.t.}\quad\mathbf{y}_{0}\sim\prod_{t=T}^{1}p_{\theta}(\mathbf{y}_{t-1}\mid\mathbf{y}_{t},\mathbf{x}) (1) where \mathcal{L}(\cdot) is the cross-entropy loss. This formulation explicitly links the detection task to the generative dynamics, acknowledging that while the target \mathbf{y}_{0} is a static sequence, its validity is an artefact of the specific generative path p_{\theta} . However, applying conventional detection paradigms to this diffusion-based formulation is hindered by architectural mismatches. Regarding output-based approaches , the primary obstacle is likelihood intractability : unlike AR models, D-LLMs lack a direct single-pass likelihood p(\mathbf{y}|\mathbf{x}) , rendering perplexity-based metrics computationally expensive ( Sahoo et al. 2024 ) . Conversely, latent-based strategies struggle with temporal information loss . Because they typically analyze only the final state \mathbf{y}_{0} or a single snapshot, these methods discard rich validity signals, such as ”semantic drift” or ”persistent error”, that manifest exclusively as dynamic instabilities within the intermediate trajectory terms p_{\theta}(\mathbf{y}_{t-1}\mid\mathbf{y}_{t}) ( Chang et al. 2025 ; Wang et al. 2025 ) . 3.2 Capturing Bidirectional Dependencies and Evolution via Temporal Graph Modeling To effectively detect hallucinations in D-LLMs, a representation must capture two fundamental generative properties: the global context facilitated by bidirectional attention and the iterative refinement of semantic content over time. Standard static graph approaches fail to capture the latter, while sequence-only methods miss the former. Therefore, we propose to model the computational trace not as a fixed snapshot, but as a Temporal Dynamic Graph, explicitly encoding the generation as an evolving web of token dependencies. Dynamic Graph Construction. Formally, we define the diffusion trace as a discrete-time sequence of attributed graphs \mathcal{G}=\{G^{(0)},\dots,G^{(T)}\} . Each snapshot G^{(t)}=(V,\mathcal{E}^{(t)},\mathbf{X}_{V}^{(t)},\mathbf{X}_{E}^{(t)}) captures the structural state of the generation at denoising step t . First, the Vertex Set ( V ) consists of the N tokens in the sequence \mathbf{y} . Unlike AR generation, the node set remains fixed across the trajectory, serving as the spatial anchor for temporal evolution. Second, the Temporal Edge Set ( \mathcal{E}^{(t)} ) represents the dynamic connectivity. Leveraging the model’s bidirectional attention, we define a directed message edge (j,i) at step t if token i significantly attends to token j : \mathcal{E}^{(t)}=\left\{(j,i)\,\middle|\,\frac{1}{H}\sum_{h=1}^{H}\mathbf{A}_{ij}^{(t,L,h)}>\tau\right\} (2) where \tau is a sparsity threshold. This construction allows the graph topology to evolve naturally, capturing phenomena such as the emergence of semantic cliques or the dissolution of random noise connections. To unify heterogeneous signals, we enrich this structure with time-varying features. Node Attributes \mathbf{X}_{V}^{(t)} are derived from residual stream activations, projected to \mathbb{R}^{d_{v}} to capture instantaneous semantic confidence and context. Edge Attributes \mathbf{X}_{E}^{(t)} are derived from the averaged attention scores across heads, preserving interaction strength while maintaining computational efficiency. By formulating the diffusion trace as a dynamic graph sequence \mathcal{G} , our approach unifies the structural analysis of token interactions with the temporal analysis of their evolution. This representation allows the model to distinguish between healthy refinement (where dependencies stabilize) and hallucinatory collapse (where dependencies drift or lock onto irrelevant tokens or noisy patterns). This reformulation is necessitated by the path-dependent nature of D-LLM hallucinations. Unlike static errors, hallucinations often emerge through semantic drift during the denoising process ( t=T\to 0 ), a phenomenon invisible to single-step analysis ( Chang et al. 2025 ) . By defining the input as a dynamic sequence \mathcal{G} , we capture this structural evolution, allowing the model to distinguish between stable grounding and transient instabilities, thus motivating the temporal architecture detailed in the following section. Table 2: Comparison of graph-based variants for LLaDA. The highest score is bolded and the second highest is underlined . Variant SS Math CSQA HotpotQA TriviaQA Ave CHARM — Decoding step 0 ✓ 0.63 0.58 0.58 0.65 0.61 CHARM — Decoding step T/4 ✓ 0.65 0.60 0.61 0.68 0.63 CHARM — Decoding step T/2 ✓ 0.70 0.63 0.63 0.69 0.66 CHARM — Decoding step T ✓ 0.65 0.63 0.62 0.68 0.64 TDGNet (Ours) ✓ 0.72 0.65 0.64 0.72 0.68 3.3 Hallucination Detection via Dynamic Trace Modeling To classify the diffusion trajectory constructed in Section 3.2 , we introduce the Temporal Dynamic Graph Network (TDGNet). This architecture processes the sequence of attention graphs \{\mathcal{G}^{(t)}\}_{t=T}^{0} via a three-stage pipeline, which consists of spatial aggregation, temporal memory update, and trajectory readout, to distinguish between factual and hallucinated generation paths. First, to capture the local structural context at each diffusion step t , we employ a Message Passing Neural Network (MPNN) ( Gilmer et al. 2017 ) . This module aggregates information from the attention neighborhood \mathcal{N}_{i}^{(t)} . For each token i , we compute an aggregated message vector \bar{\mathbf{m}}_{i}^{(t)} that summarizes the information flow from its neighbors: \bar{\mathbf{m}}_{i}^{(t)}=\frac{1}{|\mathcal{N}^{(t)}(i)|}\sum_{j\in\mathcal{N}^{(t)}(i)}\psi\left(\mathbf{h}_{j}^{(t)},\mathbf{h}_{i}^{(t)},\mathbf{e}_{ji}^{(t)}\right) (3) where \mathbf{h}_{i}^{(t)} and \mathbf{h}_{j}^{(t)} are the node features, \mathbf{e}_{ji}^{(t)} are the edge features, and \psi(\cdot) is a learnable message function implemented as a multi-layer perceptron (MLP). This spatial aggregation ensures that the model captures the instantaneous relational structure of the generation before processing its temporal evolution through recurrence. Subsequently, to track how these structural roles evolve, we maintain a persistent memory state \mathbf{s}_{i}^{(t)} for each token. We employ a Gated Recurrent Unit (GRU) to transition the memory state from step t+1 to t : \mathbf{s}_{i}^{(t)}=\text{GRU}\left(\bar{\mathbf{m}}_{i}^{(t)},\mathbf{s}_{i}^{(t+1)}\right) (4) This recurrence allows the network to distinguish between consistent grounding and transient noise by integrating the sequence of spatial messages \bar{\mathbf{m}}_{i}^{(t)} into a continuous ”running belief” \mathbf{s}_{i}^{(t)} representation over time. Finally, to produce a robust prediction, we employ a Temporal Attention Mechanism that prioritizes informative denoising phases over noisy initialization. We compute a trajectory-aware embedding \mathbf{z}_{i} for each token by attending over its own memory history: \begin{split}\mathbf{z}_{i}&=\sum_{t=0}^{T}\alpha_{i}^{(t)}\cdot\text{Linear}(\mathbf{s}_{i}^{(t)}),\\ \text{where}\quad\alpha_{i}^{(t)}&=\frac{\exp(\mathbf{q}^{\top}\mathbf{s}_{i}^{(t)})}{\sum_{k=0}^{T}\exp(\mathbf{q}^{\top}\mathbf{s}_{i}^{(k)})}\end{split} (5) Here, \text{Linear}(\cdot) denotes a linear projection layer, and \mathbf{q} is a learnable query vector. This yields a final representation \mathbf{z}_{i} that summarizes the token’s structural validity across the entire trajectory of the generation process. Learning Objective. For the primary task of response-level hallucination detection, we apply global mean-pooling over the token embeddings to obtain a graph representation \mathbf{g}=\frac{1}{N}\sum_{i}\mathbf{z}_{i} . This is passed to a binary classifier f_{\phi} to predict the probability \hat{p} . The model is trained end-to-end by minimizing the binary cross-entropy loss against the ground truth labels h\in\{0,1\} indicating response validity: \mathcal{L}=-\frac{1}{|\mathcal{D}|}\sum_{(\mathbf{x},\mathbf{y})\in\mathcal{D}}\left[h\log\hat{p}+(1-h)\log(1-\hat{p})\right] (6) where \mathcal{D} represents the training dataset of prompt-response pairs and their corresponding ground-truth labels. 3.4 Implementation Details We instantiate the TDGNet framework as a two-stage pipeline comprising a Temporal Graph Encoder g_{\theta} and a Hallucination Predictor f_{\phi} . (a) Temporal Graph Encoder Configuration. • Graph Sparsity Threshold ( \tau ): To robustly define the edge set \mathcal{E}^{(t)} , we employ a threshold \tau rather than a Top-K constraint. This allows the graph topology to evolve naturally: distinct semantic cliques can emerge at later denoising stages without being artificially constrained, while the dense, uniform noise characteristic of early diffusion steps is effectively filtered out. • Efficient Trajectory Sampling: While TDGNet is formulated over the full denoising trace \{G^{(t)}\}_{t=0}^{T} (processed in denoising order t=T\rightarrow 0 ), processing every step incurs high redundancy and computational cost. To balance fidelity with efficiency, we sample a strategic set of keyframes \mathcal{T}_{\text{key}}=\{T,\lfloor T/2\rfloor,\lfloor T/4\rfloor,0\} . This sequence captures the critical phases of generation: initial structural formation ( t=T ), semantic construction ( t=\lfloor T/2\rfloor ), and late-stage refinement ( t=0 ). Crucially, this does not reduce the model to an ensemble of static snapshots; the recurrent memory states persist and update sequentially across these keyframes, allowing TDGNet to model the evolutionary dynamics of the hallucination even with sparse temporal sampling. • Feature Initialization: Node features \mathbf{h}_{i}^{(t)} are initialized from projected final-layer hidden states ( \mathbb{R}^{4096}\to\mathbb{R}^{128} ). The memory module uses a GRU with state dimension d_{m}=128 , and the temporal attention query \mathbf{q} is similarly set to d_{m}=128 . (b) Dual-Task Readout Heads. TDGNet supports both global and granular detection via specialized heads: 1. Response-Level (Graph Classification): For sequence-level detection, we apply global mean-pooling over the final temporal node embeddings \mathbf{z}_{i} to obtain \mathbf{g} , which is passed to a binary classifier f_{\text{seq}}(\mathbf{g}) . 2. Token-Level (Node Classification): For fine-grained localization, we bypass pooling and feed the learned individual node embeddings \mathbf{z}_{i} into a shared token classifier f_{\text{token}}(\mathbf{z}_{i}) . This allows the model to pinpoint specific structural anomalies (e.g., local attention drift) without losing any granular resolution. 4 Experiments Table 3 : Token-Level Hallucination Detection (AUROC). Comparison of our dynamic method (TDGNet) and static graph baseline (CHARM) against standard baselines on Natural Questions (NQ) and TriviaQA. Best results are bolded , second best are underlined . Method Natural Questions TriviaQA Graph Degree (Centrality) 0.43 0.46 Source Attribution 0.52 0.42 Token Probability 0.60 0.68 Predictive Entropy 0.69 0.71 CHARM (Static Graph) 0.84 0.83 TDGNet (Ours) 0.87 0.85 4.1 Setup Datasets. We evaluate hallucination detection on five QA-style benchmarks with varying reasoning demands: Math (numerical reasoning, constructed following ( Chuang et al. 2024 ) ), CommonsenseQA (CSQA) (commonsense multiple choice) ( Talmor et al. 2019 ) , HotpotQA (multi-hop reasoning with supporting context) ( Yang et al. 2018 ) , TriviaQA (open-domain factoid QA) ( Joshi et al. 2017 ) , and Natural Questions (NQ) (factoid QA) ( Kwiatkowski et al. 2019 ) . While all datasets are utilized for response-level detection, we specifically employ NQ and TriviaQA for the fine-grained token-level localization experiments (Section 4.2 ), as their factoid nature supports precise span-level verification. Dataset construction, labeling, and splits follow Section D ; all methods use identical train/test partitions. Baseline Methods. We compare TDGNet against a comprehensive suite of detectors across three paradigms, prioritizing methods that facilitate rigorous comparison on a unified benchmark (selection criteria in Appendix B ). For response-level detection , we evaluate output-based methods operating on prediction statistics, including Semantic Entropy ( Kuhn et al. 2023 ; Kossen et al. 2024 ) , Length-Normalized (LN) Entropy and Perplexity ( Lin et al. 2023 ) , and Lexical Similarity ( Manakul et al. 2023 ) ; latent-based methods probing internal representations, such as EigenScore ( Chen et al. 2024 ) , TSV ( Park et al. 2025 ) , and consistency probes like CCS ( Azaria & Mitchell 2023 ; Orgad et al. 2024 ) ; and graph-based methods represented by CHARM ( Frasca et al. 2025 ) , evaluated via an in-house implementation. For token-level localization , since standard response metrics suffer from a granularity mismatch (broadcasting a single scalar dilutes local error signals), we compare against native token-wise baselines that test distinct validity hypotheses: (1) Predictive Entropy ( Kuhn et al. 2023 ) (testing if hallucinations correlate with local uncertainty); (2) Graph Degree Centrality (testing the ”Hub Hypothesis” that grounded tokens act as attention hubs); and (3) Source Attribution ( Bahdanau et al. 2016 ; Vaswani et al. 2017 ) (testing the ”Context Hypothesis” that factual tokens maintain strong attention to the prompt). Figure 3 : Temporal Consistency Analysis. We compare the inherent validity signal in the data (Blue, ”Branching Fate”) against the accuracy of static snapshots (Orange, CHARM). Key Insight: While the data contains strong early signals ( >81\% consistency), static models fail to capture them (dropping to 49.1% accuracy). This gap mathematically motivates TDGNet: the signal exists in the trajectory, but requires temporal modeling to extract. Models. We adopt LLaDA-8B-Instruct and Dream-7B-Instruct as representative open-source diffusion LMs ( Nie et al. 2025 ; Ye et al. 2025 ) . Using both models enables a unified comparison across different architectures and noise schedules. For graph methods, we construct attention graphs from the final transformer layer using a standardized decoding configuration ( gen_length =32, steps =16); we refer readers to Appendix A for a detailed sensitivity analysis regarding these hyperparameters. Notably, given the limited landscape of open-source D-LLMs, we include Dream-7B despite its known tendency toward structural degradation (mode collapse) in zero-shot settings. To ensure this does not confound our evaluation, we employ a temperature-scaled curation strategy that separates generation coherence (fluency) from factuality (hallucination). This protocol, detailed in Appendix E.2 , ensures that our benchmark measures the detector’s ability to identify plausible falsehoods rather than syntactic failures. Graph-based variants. To disentangle the contribution of temporal modeling from graph-based structural analysis, we introduce a set of static graph variants . This comparison aims to verify whether detection performance stems merely from the graph representation itself or specifically from tracking its evolution over the denoising process. We evaluate static models, based on ( Frasca et al. 2025 ) , operating on single snapshots extracted at key intervals t\in\{0,T/4,T/2,T\} , contrasting them with our dynamic TDGNet, which consumes the trajectory sequence. Evaluation protocol. Following prior work ( Kuhn et al. 2023 ; Manakul et al. 2023 ; Park et al. 2025 ; Chang et al. 2025 ) , we report AUROC as the primary metric, selecting models on validation data. Table 1 summarizes performance across all benchmarks. TDGNet achieves the best average AUROC on LLaDA-8B and strong results on Dream-7B, confirming the benefit of temporal modeling over output-, latent-, and static baselines. Table 4 : Graph Utility Ablation. The drastic drop without edges ( \mathcal{N}(i)=\emptyset ) confirms structural aggregation is essential. Performance (AUROC) Dataset TDGNet No Graph \Delta Drop CSQA 0.65 0.40 -0.25 TriviaQA 0.72 0.43 -0.29 HotpotQA 0.64 0.48 -0.16 Math 0.72 0.49 -0.23 4.2 Main Results Response-Level Detection. Table 1 presents a comprehensive comparison of TDGNet against baseline hallucination detection methods across two D-LLMs and four QA benchmarks. TDGNet achieves the highest performance in all settings, outperforming the second-strongest baseline (TSV) by 8.5% AUROC on LLaDA-8B-Instruct and Lexical Similarity by 5.3% on Dream-7B-Instruct. These consistent gains exhibit the value of exploiting the multi-step evolution of the denoising trajectory rather than relying solely on static output statistics or isolated latent snapshots. Among the baselines, Output-based approaches suffer from poor consistency. Semantic Entropy achieves competitive performance on LLaDA but collapses to 50.3% on Dream-7B-Instruct (CSQA), underscoring poor robustness when hallucinations do not manifest as high entropic uncertainty. Furthermore, these methods require multiple generations, imposing computational overhead unsuitable for production. Latent-based methods capture hidden-state geometry and show more competitive results, but they remain sensitive to task distribution. CCS achieves 64.3% AUROC on HotpotQA yet fluctuates significantly, dropping to near-random performance on TriviaQA. This inconsistency highlights the limitation of seeking a universal ”truth direction” in static embeddings without accounting for temporal dynamics. To isolate the contribution of temporal modeling, Table 2 compares our method against static CHARM variants. While static graphs at mid-trajectory ( t=T/2 ) perform better than early or late snapshots, they consistently underperform TDGNet. This demonstrates that hallucination signals are distributed across the trajectory, and that effective detection requires the trajectory-level aggregation that our temporal framework provides. Token-Level Localization. Beyond sequence-level detection, Table 3 validates the granular capabilities of our architecture. Standard uncertainty metrics like Predictive Entropy suffer from a granularity mismatch, achieving only \sim 70% AUROC, as broadcasting a single sequence-level score dilutes local error signals. In contrast, TDGNet leverages native node embeddings to outperform the static CHARM baseline by 2.1% on the TriviaQA benchmark. This confirms that the temporal memory mechanism does not merely aggregate signals but refines the structural boundaries of hallucinations, allowing for the precise localization of errors that static topology alone fails to isolate. Table 5 : Cross-dataset zero-shot AUROC on LLaDA: Grouped by Method. Best results are bolded , second best are underlined . Target Dataset Method Source Math CSQA Hotpot Trivia CCS Math 0.59 0.52 0.53 0.50 CSQA 0.51 0.56 0.50 0.54 Hotpot 0.54 0.55 0.60 0.59 Trivia 0.52 0.51 0.51 0.54 TDGNet (Ours) Math 0.72 0.49 0.62 0.55 CSQA 0.55 0.65 0.59 0.58 Hotpot 0.61 0.59 0.64 0.62 Trivia 0.57 0.55 0.57 0.72 Table 6 : Efficiency Comparison. TDGNet incurs marginal overhead over single-pass baselines, whereas sampling-based methods (Semantic Entropy, Lexical Similarity, EigenScore) are significantly slower due to multiple generations. Method Generations / Query Overhead / Query Time (100 Queries) Perplexity 1 \sim 66 ms 426 s LN-Entropy 1 \sim 66 ms 426 s CCS 1 \sim 96 ms 430 s TSV 1 \sim 66 ms 426 s Semantic Entropy 5 \sim 10 ms 2101 s Lexical Similarity 5 \sim 1 ms 2100 s EigenScore 5 \sim 14 ms 2102 s TDGNet (Ours) 1 \sim 160 ms 442 s 4.3 Analysis Importance of Message-Passing Structure. Hallucination detection requires capturing the relational structure of attention, which latent-based methods often discard. By utilizing the spatial aggregation mechanism defined in Eq. ( 3 ), our architecture updates each token’s embedding based on its attention-induced neighborhood \mathcal{N}(i) . This allows the model to capture pathological patterns like inconsistent grounding and unstable recirculation. Ablating graph edges ( \mathcal{N}(i)=\emptyset ) invalidates this aggregation, reducing the model to a ”Bag of Token Confidences” where prediction relies solely on isolated hidden states. This causes performance to collapse to near-random chance in all datasets (Table 4 ), validating that isolated node features are insufficient; effective detection requires structural aggregation to unify isolated heuristics into a learned, end-to-end framework. Temporal Dynamics. While CHARM demonstrates the value of attention graphs, its restriction to single-step snapshots limits its ability to model the diffusion process. Static variants peak at mid-trajectory (0.6627 AUROC) yet consistently trail our dynamic approach (0.6814) (Table 2 ). Figure 3 illustrates the mechanism behind this gap: while the trajectory itself holds consistent validity signals ( >83\% consistency, Blue bars), static models fail to capture them, dropping to 49.1% accuracy at Step 0. This disparity between the inherent data signal and the extracted signal confirms that validity cues are not localized to any single snapshot, but are instead distributed throughout the denoising history. TDGNet bridges this gap by trajectory-level aggregation, allowing it to distinguish true structural stability from the transient artifacts that confound static methods. Generalization and Cross-dataset Analysis. Cross-dataset zero-shot experiments (Table 5 ) demonstrate that graph-based detection generalizes more robustly than latent-space methods. TDGNet maintains meaningful transfer (0.55–0.62 AUROC) across diverse reasoning types, while CCS shows near-random performance on distant pairs (0.50–0.54 AUROC). Within knowledge-retrieval tasks, transfer is strong (0.57–0.62), reflecting shared patterns for entity grounding and evidence verification. The strong performance of Hotpot as a source dataset (0.59–0.62 average transfer) suggests that multi-hop reasoning patterns generalise, indicating that core hallucination signatures, such as attention inconsistency and semantic drift, are partially invariant to task-specific reasoning modes (see Appendix A.2 ). Efficiency. Inference efficiency is critical for D-LLMs. While consistency-based methods (e.g., Semantic Entropy) inflate latency by requiring multiple generations ( S=5 ), TDGNet leverages a single denoising trajectory. Table 6 confirms a \sim 4.8 \times speedup (442s) over Semantic Entropy (2101s). The marginal overhead compared to Perplexity (442s vs 426s) is negligible relative to the cost of additional sampling, allowing TDGNet to combine single-pass speed with the robustness of ensemble approaches. 5 Conclusion TDGNet reframes hallucination detection for diffusion language models as learning over the evolving attention-graph trace, operationalizing the principle that factuality is a trajectory property rather than solely an end-state outcome. By utilizing token-level message passing and persistent memories to accumulate weak validity cues across denoising stages , our framework consistently improves AUROC over output-based, latent-based, and static graph baselines on both LLaDA-8B and Dream-7B, while simultaneously enabling fine-grained localization of hallucinated spans. Analyses confirm that these gains stem from explicitly modeling diffusion-specific dynamics, such as self-correction, semantic drift, and persistent errors, allowing the detector to capture early warning signs and late-stage repair effects that static snapshots miss. Ultimately, by operating in a single pass with modest overhead, TDGNet offers a practical path toward scalable hallucination monitoring and a foundation for future mitigation in D-LLMs. Impact Statement This paper presents work whose goal is to advance the field of machine learning by improving the reliability and trustworthiness of Diffusion Language Models. By introducing a mechanism to detect and localize hallucinations, our research aims to mitigate the risks associated with the generation of misinformation and supports the safer deployment of generative AI systems in real-world applications. We believe this work contributes positively to the responsible development of Large Language Models, and there are no specific negative societal consequences that we feel must be highlighted here. Appendix A Ablation Studies A.1 Ablation: Layer and Diffusion Step We systematically ablate the choice of transformer layer \ell\in\{1,L/4,L/2,L\} and diffusion timestep t\in\{0,T/4,T/2,T\} in the graph construction, where L is the total number of layers and T is the total number of diffusion steps. We evaluate two configurations: (i) steps =16, gen_length =64 (Table 7 ); and (ii) steps =32, gen_length =128 (Table 8 ). Each table reports AUROC on test sets. Findings. Performance improves consistently with deeper transformer layers ( \ell=L>L/2>L/4>1 ) across all probed denoising steps, indicating that later layers encode stronger hallucination cues. In contrast, the timestep effect is non-monotonic: mid-trajectory steps ( t=T/2 ) provide the strongest single-step signal in both schedules, while the final step ( t=0 ) can be slightly weaker, consistent with late-stage repair effects. Overall, the best single-snapshot configuration is (\ell=L,\,t=T/2) . Increasing the diffusion schedule to steps =32 with longer generation ( gen_length 64\rightarrow 128 ) preserves the same trends and yields comparable performance, suggesting robustness to schedule length. Table 7 : Layer/step ablation ( steps =16, gen_length =64). Rows index transformer layers \ell\in\{1,L/4,L/2,L\} and columns index diffusion timesteps t\in\{0,T/4,T/2,T\} . Metric: AUROC. Test t{=}0 t{=}T/4 t{=}T/2 t{=}T \ell{=}1 0.5043 0.5552 0.5785 0.5374 \ell{=}L/4 0.5549 0.6073 0.6246 0.5952 \ell{=}L/2 0.6005 0.6438 0.6652 0.6387 \ell{=}L 0.6344 0.6785 0.6941 0.6639 Table 8 : Layer/step ablation ( steps =32, gen_length =128). Rows index transformer layers \ell\in\{1,L/4,L/2,L\} and columns index diffusion timesteps t\in\{0,T/4,T/2,T\} . Metric: AUROC. Test t{=}0 t{=}T/4 t{=}T/2 t{=}T \ell{=}1 0.649 0.619 0.596 0.488 \ell{=}L/4 0.655 0.630 0.615 0.639 \ell{=}L/2 0.662 0.645 0.635 0.651 \ell{=}L 0.675 0.660 0.682 0.670 A.2 Ablation Study: Generalization Across Datasets A.2.1 Experimental Design and Rationale To evaluate the robustness of our approach, we conduct zero-shot cross-dataset transfer experiments. Models are trained on individual source datasets (Math, CSQA, HotpotQA, TriviaQA) and evaluated on all target datasets without fine-tuning. We compare TDGNet against CCS, a strong baseline that learns linear directions in latent space. Hypothesis : Graph-based hallucination detection should transfer more robustly across reasoning types than latent-space methods, as attention patterns encode universal structural anomalies that generalize beyond task-specific output distributions. A.2.2 Interpretation TDGNet substantially outperforms CCS across all transfer scenarios, with an average improvement of +0.08 AUROC. Notably, CCS exhibits near-random transfer in several settings (e.g., Math \rightarrow Trivia: 0.50, CSQA \rightarrow Trivia: 0.54), indicating that linear latent directions do not generalize across reasoning types. In contrast, TDGNet maintains measurable transfer performance even for distant dataset pairs (Math \rightarrow Trivia: 0.55, CSQA \rightarrow Trivia: 0.58), suggesting that attention graph patterns capture partially task-agnostic hallucination signatures. Hotpot consistently transfers well to all targets (0.59–0.62 AUROC), likely because multi-hop reasoning patterns generalize broadly to simpler single-hop tasks. Appendix B Baseline Details Baseline Selection Criteria. We evaluate against a comprehensive suite of reproducible state-of-the-art methods. We explicitly exclude methods requiring external knowledge retrieval (e.g., FactScore) to ensure a fair closed-book comparison. Furthermore, while we note concurrent works like TraceDet ( Chang et al. 2025 ) , we restrict our empirical benchmark to methods that can be faithfully reproduced without ambiguity (see Section B.3.2 ). B.1 Token-Level Hallucination Detection Methods Standard response-level metrics suffer from a granularity mismatch when applied to fine-grained tasks: broadcasting a single scalar score (e.g., sequence perplexity) across all tokens dilutes local error signals. To address this, we employ three baselines that generate native token-wise validity signals, each representing a distinct theoretical hypothesis about hallucination. B.1.1 Predictive Entropy (Uncertainty Hypothesis) Predictive Entropy measures the flatness of the model’s next-token probability distribution at each step t ( Kuhn et al. 2023 ) : H(y_{t}|\mathbf{y}_{