Process-of-Thought Reasoning for Videos Jusheng Zhang, Kaitong Cai, Jian Wang, Yongsen Zheng, Kwok-Yan Lam, Keze Wang Abstract State-of-the-art video-to-text models often fail to capture causal dynamics, yielding fragmented descriptions due to process blindness —the inability to comprehend the underlying narrative process ( 𝒫 \mathcal{P} ) connecting discrete temporal states ( S t i S_{t_{i}} ). While prior neuro-symbolic approaches treat temporal logic as static, post-hoc supervision, we propose LogicAgent , a framework that elevates temporal logic to a learnable process variable. LogicAgent integrates three core components: a Grounded Eventifier for perceptual abstraction, a Discrete CoT Generator for symbolic chain composition ( 𝒞 \mathcal{C} ), and a Hybrid Differentiable Logic Verifier . Our central innovation is a functional optimization paradigm that treats 𝒞 \mathcal{C} as a differentiable latent variable, enabling the joint optimization of predictive utility ( ℒ pred \mathcal{L}_{\text{pred}} ), temporal-logical consistency ( ℒ LTL \mathcal{L}_{\text{LTL}} ), counterfactual robustness ( ℒ CF \mathcal{L}_{\text{CF}} ), and sparsity ( ℒ spar \mathcal{L}_{\text{spar}} ). By unifying symbolic reasoning with gradient-based learning, LogicAgent achieves a fundamental shift from state perception to process-level reasoning, demonstrating superior performance on complex temporal understanding benchmarks. 1 Introduction Video-to-text generation has achieved remarkable progress, demonstrating impressive capabilities in recognizing objects and actions ( 35 ; 33 ; 15 ) . While promising for applications ranging from automated surveillance to assistive technologies, a critical gap persists between current model capabilities and human-level comprehension ( 6 ; 41 ) . Specifically, while existing methods effectively describe what appears in a video, they fundamentally struggle to articulate how or why events unfold over time. Our analysis suggests that this gap stems from process blindness : the inability to comprehend videos as continuous and logically structured sequences of events. Consider a video of a soccer player scoring a goal. A process-blind model often suffers from narrative fragmentation , generating disconnected observations (e.g., “A player stands. The net moves.” ) while missing the central causal link. More critically, it leads to logical incoherence ( 26 ; 2 ) , producing descriptions that violate basic causality, such as “The ball is in the net, and then the player kicks it.” To rigorously diagnose this limitation, we formalize the prevailing paradigms in video understanding. The Standard Paradigm: Implicit Mapping with Static Constraints. Most existing approaches formulate video-to-text generation as learning a direct mapping to maximize the likelihood of the text Y given video V . In neuro-symbolic variants, logical consistency is typically treated as a static regularization term or a post-hoc constraint ( 41 ; 26 ) . Mathematically, this optimization searches for parameters \theta^{*} that minimize a task loss subject to a fixed logical penalty \Omega : \theta^{*}=\operatorname*{argmin}_{\theta}\mathbb{E}_{(V,Y)\sim\mathcal{D}}\left[\mathcal{L}_{\text{task}}(Y,\mathcal{F}_{\theta}(V))+\lambda\cdot\underbrace{\Omega_{\text{logic}}(\operatorname{sg}[\hat{Y}])}_{\text{Static / Post-hoc}}\right] where \operatorname{sg}[\cdot] denotes the stop-gradient operation. Under this formulation, reasoning is detached : the logical penalty \Omega cannot backpropagate informative gradients to update the perceptual encoder due to the discrete nature of symbolic rules. Consequently, the model suffers from gradient isolation , failing to learn visual features that are causally significant. Figure 1 : The LogicAgent Pipeline. Unlike black-box models, we explicitly model the narrative process. (1) Eventifier: Lifts continuous features V into grounded events \mathcal{E} ; (2) CoT Generator: Synthesizes symbolic causal chains \mathcal{C} ; (3) Hybrid Verifier: Scores chains to guide learning. This verifiable structure prevents gradient isolation and ensures logical consistency. Our Paradigm: Functional Optimization with Latent Logic Chains. To overcome this gradient isolation, we propose LogicAgent , which redefines video understanding as a process of learning an explicit, differentiable reasoning policy. We introduce the reasoning chain \mathcal{C} not as a static constraint, but as a functional latent variable mediated by a policy \pi_{\theta}(\mathcal{C}|V) . Unlike Eq. 1 , our objective transforms into maximizing the expected joint utility of the reasoning process itself: \mathcal{J}(\theta)=\mathbb{E}_{\mathcal{C}\sim\pi_{\theta}(\cdot|\mathcal{E}(V))}\left[\underbrace{\mathcal{L}_{\text{pred}}(\mathcal{C})}_{\text{Predictive}}+\underbrace{\mathcal{L}_{\text{LTL}}(\mathcal{C},V)}_{\text{Logical}}+\underbrace{\mathcal{L}_{\text{CF}}(\mathcal{C})}_{\text{Robustness}}\right] Here, the logic chain \mathcal{C} serves as a differentiable computational bridge. By employing gradient estimators, the logical signals from \mathcal{L}_{\text{LTL}} and \mathcal{L}_{\text{CF}} are directly backpropagated to the perceptual “ Eventifier ” \mathcal{E}(V) . This paradigm shift—from static constraints to functional optimization —ensures that logical structure is not just verified, but actively learned from perceptual data. To implement this paradigm, LogicAgent (as illustrated in Fig. 1 ) integrates three core modules: (1) a Grounded Eventifier (Sec. 3.1 ) that lifts the video stream into perceptually grounded event units; (2) a Discrete CoT Generator (Sec. 3.1 ) that composes a symbolic reasoning chain \mathcal{C} from a learned codebook; and (3) a Hybrid Differentiable Logic Verifier (Sec. 3.2 ), which validates the chain’s temporal logic against visual content. Our contributions are summarized as follows. First, we diagnose ‘process blindness’ as a consequence of the gradient isolation in standard static paradigms, formally analyzing the reasoning dynamics (Sec. 2.1 ). We propose a shift towards functional optimization where logic is treated as a latent variable. Second, we propose LogicAgent (Sec. 3 ), a neuro-symbolic framework that explicitly models the narrative process by integrating grounded event extraction with symbolic reasoning. Third, we introduce a functional optimization objective that treats the symbolic chain \mathcal{C} as differentiable. By jointly optimizing for predictive utility ( \mathcal{L}_{\text{pred}} ), logical consistency ( \mathcal{L}_{\text{logic}} ), counterfactual robustness ( \mathcal{L}_{\text{CF}} ), and sparsity ( \mathcal{L}_{\text{spar}} ), we enforce explicit data-driven logic, promoting consistency in video understanding. 2 Problem Formulation: Verifiable Video Reasoning Dynamics Motivation & Task. Standard video captioning often suffers from process blindness —generating descriptions that violate temporal logic due to the lack of explicit reasoning constraints. To bridge this gap, we formulate video-to-text generation as a dual process of grounded event abstraction and verifiable reasoning . Let \mathcal{D}=\{(V_{i},Y_{i})\}_{i=1}^{N_{\mathcal{D}}} be the dataset. A visual encoder maps video V to features S_{1:T} . Our goal is to generate captions Y conditioned on a latent, logically valid chain \mathcal{C} . Figure 2 : Reasoning Dynamics. (a) Update: r_{t} boosts causal belief (C1) vs. errors (C2). (b) Kernel: K_{t} transfers semantics but blocks counterfactuals. (c) Convergence: Temporal ops learn faster than semantic. (d) Matrix: Shows logical disentanglement. Grounded Event Space. Logical operators cannot operate on raw pixels. We first define an Eventifier \mathcal{F}_{E} that lifts the continuous stream into discrete, checkable units: \mathcal{E}(V)=\mathcal{F}_{E}(S_{1:T})=\{E_{j}\}_{j=1}^{K},\quad E_{j}=(\ell_{j},v_{j},\tau_{j}). (1) Here, \ell_{j} is a symbolic label (instantiated as a structured triplet \ell_{j}=\langle P_{j},A_{j},O_{j}\rangle from a predefined vocabulary), v_{j} is the pooled visual feature of the corresponding spatio-temporal segment, and \tau_{j} denotes its temporal support. This binding (\ell_{j},v_{j},\tau_{j}) serves as the crucial bridge allowing symbolic operators to be verified directly against video evidence. Chain Space & Operator Codebook. We define a codebook Z=Z_{T}\cup Z_{S} containing temporal ( Z_{T} , e.g., before ) and semantic ( Z_{S} , e.g., cause ) operators. A reasoning chain \mathcal{C} is formalized as a list of logical transitions (edges): \mathcal{C}=\{(a_{\ell},z_{\ell},b_{\ell})\}_{\ell=1}^{L},\qquad a_{\ell},b_{\ell}\in[K],\;z_{\ell}\in Z, (2) where L denotes the number of edges. We introduce a Hybrid Verifier \mathcal{F}_{V} that assigns a belief score s_{\theta}(\mathcal{C},V)\in(0,1] to quantify how well the video evidence supports this hypothesis. Optimization Objective. The training balances captioning quality with logical validity. We select the optimal chain \mathcal{C}^{*}(V) by minimizing an auxiliary verification loss \mathcal{L}_{\mathrm{aux}} (using a negative sample V^{-} , detailed in Sec. 3.2 ). The joint objective is: \mathcal{L}(\theta;V,Y)=\mathcal{L}_{\mathrm{caption}}(\theta;V,Y)+\mathcal{L}_{\mathrm{aux}}\big(\mathcal{C}^{*}(V);V,V^{-}\big). (3) 2.1 Theoretical Analysis: Reasoning Dynamics The Core Question. Why does explicit verification lead to better generalization? We analyze the Reasoning Dynamics (visualized in Fig. 2 ): After one gradient update on a training video V_{u} , how does the belief in a chain \mathcal{C} for a test video V_{o} change? We analyze the learning dynamics w.r.t. \theta while treating the discrete generator \phi as fixed during a single step. Let \theta_{t} be parameters at step t . A gradient step on (V_{u},Y_{u}) yields \Delta\theta_{t}=-\eta\nabla_{\theta}\mathcal{L}_{t}(V_{u}) . The belief change is \Delta g_{t}(\mathcal{C};V_{o})\approx-\eta\langle\nabla_{\theta}g_{\theta_{t}}(\mathcal{C};V_{o}),\nabla_{\theta}\mathcal{L}_{t}(V_{u})\rangle . Influence Decomposition. By factorizing the verifier score over edges, we derive the Influence Decomposition (using the aligned form for stability): \begin{aligned} \Delta g_{t}(\mathcal{C};V_{o})\approx-\eta\,&\underbrace{A_{t}(\mathcal{C},V_{o})^{\top}}_{\text{\scriptsize Sens.}}\,\underbrace{K_{t}\big((\mathcal{C},V_{o}),(V_{u},Y_{u})\big)}_{\text{\scriptsize Kernel}}\,\underbrace{r_{t}(V_{u},Y_{u})}_{\text{\scriptsize Resid.}}\end{aligned} (4) This equation tells a compelling story about how LogicAgent avoids shortcut learning: Sensitivity A_{t} (Where to learn): Measures logical uncertainty ( 1-\sigma ). Updates naturally focus on edges where the verifier is currently unsatisfied. Reasoning Kernel K_{t} (How to transfer): This is the core mechanism. It ensures that knowledge transfers from V_{u} to V_{o} only if they share the same causal structure (grounded evidence), rather than just superficial visual similarity. Residual r_{t} (What to learn): Unlike standard captioning losses that may encourage hallucinations, our \mathcal{L}_{\mathrm{aux}} steers the residual r_{t} towards logical consistency. Toy Example: Kick \rightarrow Goal. Consider events E_{1}=(\ell_{1},v_{1},\tau_{1}) with \ell_{1}=\texttt{kick} and E_{2}=(\ell_{2},v_{2},\tau_{2}) with \ell_{2}=\texttt{goal} . A standard model might learn to associate ”goal” simply with ”green grass”. However, by training with a counterfactual V^{-} (e.g., kick misses ), LogicAgent forces the verifier to recognize that cause requires specific visual preconditions. This refines the Kernel K_{t} , enabling the model to correctly reason about new, unseen scenarios. 3 Methodology Figure 3 : Functional Verification. We transform the discrete chain into a differentiable variable via four objectives: (1) Predictive Utility, (2) Logical Consistency, (3) Counterfactual Robustness, and (4) Sparsity, ensuring causal structure learning. Motivation: Representation Mismatch. Current video models often fail in logic because they attempt to capture narrative processes using continuous ”black-box” vectors, whereas real-world reasoning is discrete and causal. To bridge this gap, we propose LogicAgent . As illustrated in Figure 1 , our framework consists of three core modules optimized via the reasoning dynamics formalized in Sec. 2 . 3.1 Eventifier & Generator: Grounding and Reasoning The Eventifier. The Eventifier serves as the grounding interface. As formally defined in Eq. ( 1 ) (Sec. 2 ), it maps continuous features S_{1:T} to discrete events \mathcal{E}(V) . In practice, we implement this via a proposal-then-classify architecture: it first identifies salient temporal segments, then applies lightweight classification heads ( H_{P},H_{A},H_{O} ) to predict structured symbolic labels \ell_{j}=\langle\text{Premise},\text{Action},\text{Object}\rangle . Crucially, strictly retaining the pooled visual evidence v_{j} and temporal support \tau_{j} is vital for our design. Unlike methods that verify against text only, passing v_{j} allows the semantic verifier checks logic against pixel-level evidence , avoiding information loss from noisy captions. The Discrete CoT Generator. The Generator ( \mathcal{F}_{G} , parameterized by \phi ) navigates this grounded event space. It models the narrative process as a conditional distribution P_{\phi}(\mathcal{C}\mid\mathcal{E}(V)) . To synthesize a chain, the model operates autoregressively, alternating between selecting event indices a_{i},b_{i}\in[K] and choosing logical operators z_{i} from the codebook Z . During training, we sample N diverse candidate chains \{\mathcal{C}^{(n)}\}_{n=1}^{N} . This sampling strategy is essential: instead of committing to a single path, it allows the model to explore multiple narrative hypotheses , from which the Verifier (Sec. 3.2 ) selects the most evidence-consistent explanation. 3.2 Functional Optimization: Verifying the Chain To shape the Reasoning Dynamics (Eq. ( 4 )), we design the auxiliary loss \mathcal{L}_{\mathrm{aux}} (as illustrated in Fig. 3 ) with four specific roles: \displaystyle\mathcal{L}_{\mathrm{aux}}(\mathcal{C};V,V^{-})= \displaystyle\lambda_{\mathrm{pred}}\mathcal{L}_{\mathrm{pred}}+\lambda_{\mathrm{logic}}\mathcal{L}_{\mathrm{logic}} (5) \displaystyle+\lambda_{\mathrm{CF}}\mathcal{L}_{\mathrm{CF}}+\lambda_{\mathrm{spar}}\mathcal{L}_{\mathrm{spar}}. Predictive Utility ( \mathcal{L}_{\mathrm{pred}} ). A valid causal chain should imply the future. We force the chain prefix \mathcal{C}_{\leq t} to predict the future state S_{t+1} via masked predictive coding. This aligns the update residual r_{t} with the true temporal evolution of the video. \mathcal{L}_{\mathrm{pred}}(\mathcal{C};V)=\frac{1}{T-1}\sum_{t=1}^{T-1}\left(1-\frac{\hat{S}_{t+1}\cdot S_{t+1}}{\|\hat{S}_{t+1}\|\|S_{t+1}\|}\right). (6) Logical Consistency ( \mathcal{L}_{\mathrm{logic}} ). The Hybrid Verifier \mathcal{F}_{V} evaluates the chain’s validity. We employ a hybrid design to handle different types of logic: s_{\theta}(z;E_{u},E_{v})=\begin{cases}\sigma\big(k(\tau_{v}^{s}-\tau_{u}^{e})\big),&z\in Z_{T},\\ \sigma\big(\Phi_{\theta}([v_{u},v_{v},e_{z}])\big),&z\in Z_{S},\end{cases} (7) where \Phi_{\theta} is an MLP and e_{z}=\mathrm{embed}(z) . This design ensures that temporal checks ( Z_{T} ) are robust and rule-based , while semantic checks ( Z_{S} ) are learnable from visual evidence. Counterfactual Robustness ( \mathcal{L}_{\mathrm{CF}} ). To explicitly refine the Reasoning Kernel K_{t} , we enforce a margin against negative videos V^{-} : \mathcal{L}_{\mathrm{CF}}=\mathbb{E}\left[\max\big(0,\ m+\mathcal{L}_{\mathrm{logic}}(\mathcal{C};V)-\mathcal{L}_{\mathrm{logic}}(\mathcal{C};V^{-})\big)\right]. (8) This forces the model to distinguish true causation from spurious correlation. Sparsity ( \mathcal{L}_{\mathrm{spar}} ). We apply an Occam’s razor penalty \mathcal{L}_{\mathrm{spar}}=\alpha|\mathcal{C}| to encourage concise reasoning chains. Training and Inference. Since the chain \mathcal{C} involves discrete sampling, we train the generator \mathcal{F}_{G} using Policy Gradient (REINFORCE), treating -\mathcal{L}_{\mathrm{aux}} as the reward. The verifier and visual encoder are trained via differentiability through the auxiliary objectives. At test time, we sample N chains, select the one minimizing \mathcal{L}_{\mathrm{aux}}(V) to condition the caption generation. 4 Experiments Experimental Setup Datasets. To comprehensively assess the generalization capacity of LogicAgent in addressing process blindness , narrative fragmentation, and logical incoherence, we conduct experiments on six vision–language datasets spanning complementary tasks. The suite includes: (1) VIST ( 42 ) : A benchmark for sequential narrative generation, requiring models to infer causal links between image sequences; (2) Ego4D ( 14 ) : A challenging egocentric video dataset demanding fine-grained temporal understanding and long-horizon planning inference; (3) MMIU ( 29 ) : Designed for multi-modal multi-intent understanding, testing the model’s ability to grasp subtle user intents; (4) PororoSV ( 21 ) : A story visualization and description dataset that requires maintaining character consistency and plot coherence; (5) WebQA ( 7 ) : An open-domain visual question answering dataset requiring external knowledge retrieval and multi-hop reasoning; (6) MSR-VTT ( 51 ) : A standard video captioning benchmark used to evaluate general descriptive quality. Together, these datasets cover the full spectrum from low-level perception to high-level cognitive reasoning, enabling a multi-angle evaluation of LogicAgent’s robustness. Metrics. We adopt a rigorous multi-dimensional evaluation protocol. For narrative tasks (VIST, Ego4D, MMIU, PororoSV, WebQA), we primarily use BLEURT , a learned metric that correlates better with human judgment on semantic coherence than n-gram metrics. For MSR-VTT , we employ a comprehensive suite to diagnose specific failure modes: Accuracy (Acc) and Perplexity (PPL) : Measure informational correctness and linguistic fluency. Image Consistency (IC) : Evaluates the fidelity of text to visual evidence, serving as a proxy for hallucination detection. Detail Orientation (DO) : Quantifies the richness of fine-grained visual grounding. Causal Understanding (CU) : Crucially measures whether the generated text respects the temporal and causal order of events. Coherence (CO) : Assesses the overall narrative flow and logical smoothness. Baselines. We compare LogicAgent against three distinct categories of state-of-the-art methods to position our contributions: Open-source MLLMs : VideoLLaVA ( 24 ) , ShareGPT4Video ( 8 ) , Qwen2.5-VL-7B ( 4 ) , and the state-of-the-art Qwen3-VL-8B ( 3 ) . These represent the current peak of end-to-end trainable video-language models. Proprietary Foundation Models : GPT-4o ( 34 ) and Gemini 1.5 Pro ( 10 ) . Comparisons with these closed-source giants highlight the efficiency of our reasoning priors vs. pure scale. Video Reasoning & Neuro-Symbolic Methods : We include traditional captioning models (SEM-POS ( 30 ) , Vid2Seq ( 52 ) , GIT ( 45 ) , CEN ( 31 ) ) and, crucially, specialized neuro-symbolic baselines NS-DR ( 54 ) and NSVS-TL ( 9 ) . The latter two are particularly relevant as they also employ symbolic logic, allowing for a direct assessment of our functional optimization paradigm. LogicAgent Specifications. Unlike the compute-intensive baselines (e.g., Qwen3-VL-8B), LogicAgent is designed for efficiency with a total parameter count of only 1.69B . This compact footprint comprises a 1.43B visual backbone and a lightweight symbolic reasoning interface ( \approx 260M), ensuring that our performance gains stem from explicit reasoning structures rather than sheer model scaling. All trainable baselines are finetuned on the same splits to ensure fair comparison. Implementation details are provided in Appendix A . Model VIST Ego4D MMIU Pororo WebQA MSR-VTT Acc PPL \downarrow IC DO CU CO Open-Source LVLMs VideoLLaVA 0.380 0.437 0.258 0.433 0.563 2.52 3.88 3.24 2.65 3.02 3.50 ShareGPT4Video 0.412 0.462 0.285 0.423 0.585 3.31 4.09 3.33 3.18 3.52 3.31 Qwen2.5-VL-7B 0.433 0.470 0.264 0.437 0.594 2.94 4.00 3.24 2.65 3.66 3.17 Qwen3-VL-8B 0.448 0.476 0.280 0.440 0.605 3.10 3.85 3.35 2.80 3.45 3.35 Proprietary LVLMs GPT-4o 0.446 0.468 0.248 0.439 0.603 3.53 4.20 3.42 3.29 3.58 3.42 Gemini 1.5 Pro 0.444 0.454 0.125 0.439 0.599 3.41 4.24 3.27 3.13 3.76 3.14 Video Reasoning & Neuro-Symbolic Methods SEM-POS 0.385 0.449 0.215 0.411 0.580 3.25 3.97 3.12 2.97 3.62 3.26 Vid2Seq 0.409 0.466 0.239 0.400 0.587 3.33 4.12 3.58 3.13 3.67 3.50 AKGNN 0.428 0.457 0.278 0.427 0.580 3.47 4.09 3.48 3.29 3.63 3.40 GIT 0.426 0.469 0.255 0.437 0.605 3.57 4.11 3.51 3.28 3.89 2.77 CEN 0.433 0.472 0.264 0.442 0.613 3.59 4.16 3.65 3.37 3.98 2.74 NS-DR 0.439 0.465 0.288 0.435 0.608 3.61 4.15 3.54 3.35 3.70 3.45 NSVS-TL 0.442 0.471 0.287 0.439 0.612 3.58 4.25 3.56 3.38 3.72 3.53 LogicAgent (1.7B) 0.456 0.480 0.306 0.450 0.623 3.67 4.33 3.58 3.42 3.75 3.67 Table 1: Cross-benchmark evaluation. LogicAgent (highlighted in blue) achieves consistent improvements across narrative reasoning despite having significantly fewer parameters (1.69B) compared to large-scale baselines (e.g., 8B). Bold denotes the best performance, and underline denotes the second best. 4.1 Main Experimental Results & Analysis Table 1 presents the quantitative results. LogicAgent consistently achieves state-of-the-art performance, surpassing both large-scale foundation models and specialized reasoning architectures. We breakdown the analysis into three key comparisons: Superiority over Open-Source LVLMs (including Qwen3-VL). Compared to the previous SOTA Qwen2.5-VL-7B , LogicAgent improves VIST performance by +0.023 . Even against the stronger Qwen3-VL-8B , LogicAgent maintains a clear advantage, particularly on Ego4D (+0.004) and MMIU (+0.026). While Qwen3-VL achieves an impressive PPL (3.85) due to its advanced language modeling, its lower scores in Causal Understanding (CU) (3.45 vs. LogicAgent’s 3.75) reveal a critical insight: scaling model parameters improves fluency but does not automatically resolve process blindness . LogicAgent’s explicit Discrete CoT Generator bridges this gap by enforcing a structured narrative plan, ensuring that the generated text is not just fluent, but logically sound. Competitive with Proprietary Giants. Remarkably, LogicAgent outperforms GPT-4o on MMIU (0.306 vs. 0.248) and achieves parity or better on MSR-VTT consistency metrics. MMIU evaluates multi-intent understanding, which requires disentangling complex user goals from visual signals. The substantial margin here validates our Hybrid Verifier ’s ability to enforce semantic alignment through functional optimization. While GPT-4o benefits from massive pre-training data, it often suffers from ”hallucination of plausibility”—generating fluent but factually incorrect details. In contrast, LogicAgent’s Image Consistency (IC) score of 3.58 (vs. GPT-4o’s 3.42) indicates that our verifiable constraints effectively anchor generation to visual evidence, reducing hallucinations. Advantage over Neuro-Symbolic Baselines. A critical comparison is against NS-DR and NSVS-TL . Both methods also utilize symbolic representations but typically rely on rigid, pre-defined templates or separate, non-differentiable modules. LogicAgent surpasses NSVS-TL by +0.014 on VIST and +0.011 on WebQA.MSR-VTT CU gains +0.03 vs. NSVS-TL, showing functional optimization models richer causality than strict boolean logic. 4.2 Few-shot Dense Event Captioning We evaluate the data efficiency of LogicAgent on YouCook2 , ViTT , and ActivityNet (Table 2 ). Models are trained under four supervision scales: 1%, 10%, 50%, and 100%. This setup rigorously tests the model’s ability to extract and generalize robust temporal representations from sparse supervision. Method YouCook2 ViTT ActivityNet S C M S C M S C M 1% Labeled Data Vid2Seq 2.4 10.1 3.3 2.0 7.4 1.9 2.2 6.2 3.2 GIT 2.9 12.8 3.7 2.6 9.9 2.4 2.8 8.1 3.6 CEN 3.3 14.7 4.1 3.0 11.5 2.8 3.2 9.4 4.0 NS-DR 3.5 15.1 4.3 3.2 12.0 3.0 3.4 9.8 4.2 NSVS-TL 3.8 15.8 4.5 3.3 12.6 3.2 3.6 10.5 4.4 LogicAgent 4.1 17.3 4.9 3.6 13.8 3.5 3.9 11.7 4.8 10% Labeled Data Vid2Seq 3.8 18.4 5.2 10.7 28.6 6.0 4.3 20.0 6.1 GIT 4.4 22.5 5.8 12.1 31.4 6.5 5.1 22.6 6.8 CEN 4.9 25.6 6.4 13.3 34.8 7.0 5.6 24.9 7.3 NS-DR 5.2 26.8 6.6 13.8 35.5 7.3 5.9 25.8 7.5 NSVS-TL 5.5 27.9 6.8 14.2 36.8 7.6 6.2 26.5 7.8 LogicAgent 6.1 30.7 7.1 15.0 38.9 8.1 6.8 28.6 8.2 50% Labeled Data Vid2Seq 6.2 32.1 7.6 12.5 38.8 7.8 5.4 27.5 7.8 GIT 7.1 36.9 8.2 14.0 42.3 8.4 6.2 30.0 8.5 CEN 7.8 40.2 8.7 15.6 45.2 8.9 6.9 32.8 9.1 NS-DR 8.1 41.5 8.9 16.0 46.0 9.1 7.1 33.5 9.3 NSVS-TL 8.5 42.8 9.2 16.5 47.1 9.4 7.4 34.2 9.5 LogicAgent 9.2 45.7 9.8 17.1 49.3 9.7 7.7 35.9 9.9 100% Labeled Data Vid2Seq 7.9 47.1 9.3 13.5 43.5 8.5 5.8 30.1 8.5 GIT 8.6 50.4 9.8 15.1 47.9 9.0 6.6 33.4 9.1 CEN 9.4 54.7 10.3 16.6 51.6 9.6 7.2 36.1 9.8 NS-DR 9.7 55.2 10.5 16.9 52.4 9.8 7.5 36.8 10.0 NSVS-TL 10.1 56.5 10.8 17.5 53.8 10.0 7.9 37.9 10.4 LogicAgent 11.1 60.3 11.4 18.7 56.4 10.5 8.5 40.2 11.1 Table 2 : Data efficiency analysis. LogicAgent shows significant gains even with minimal labeling, consistently outperforming both statistical (CEN) and neuro-symbolic (NSVS-TL) baselines. Strong Inductive Bias for Low-Data Regimes. LogicAgent demonstrates remarkable robustness when data is scarce. Under the extremely challenging 1% data regime on YouCook2, LogicAgent improves CIDEr by a massive margin of +7.2 over Vid2Seq and +1.5 over the strong neuro-symbolic baseline NSVS-TL . This result is theoretically significant: it suggests that while standard neuro-symbolic methods (like NSVS-TL) benefit from rules in low-data settings, LogicAgent’s differentiable operator codebook provides a more flexible and powerful inductive bias . While end-to-end models like Vid2Seq must learn causal relationships from scratch through massive data, LogicAgent leverages its pre-defined symbolic structure to infer valid event sequences even with minimal training examples. This effectively bypasses the process blindness that plagues statistical models in low-resource settings. Co-evolution of Logic and Statistics. A common critique of neuro-symbolic methods is that explicit reasoning might bottleneck performance when data is abundant. However, as the supervision scale increases to 100%, LogicAgent continues to expand its lead, achieving a CIDEr of 60.3 on YouCook2, outperforming NSVS-TL (56.5) and CEN (54.7) by a substantial margin. This suggests a co-evolutionary effect: the symbolic reasoning component does not just act as a fallback; it complements the statistical patterns learned from large-scale data. By constraining the search space of the autoregressive generator to logically consistent paths, LogicAgent ensures that increased data leads to deeper causal understanding rather than just memorizing spurious correlations. Consistency of Scaling Laws. LogicAgent shows the steepest, most consistent scaling across all datasets; on ViTT, CIDEr increases from 13.8 (1%) to 56.4 (100%) while keeping the largest lead at every milestone. 4.3 Hallucination Evaluation A key hypothesis of this work is that rigorous logical verification can suppress hallucinations. To validate this, we test on POPE ( 20 ) (object existence) and MME ( 12 ) (comprehensive perception), focusing on the model’s resistance to false positives. Figure 4 : POPE results. LogicAgent achieves consistent gains across Random, Popular, and Adversarial settings. The significant improvement in the Adversarial split highlights the robustness of our verifier against misleading visual cues. Figure 5 : Hallucination evaluation on MME. Large improvements in Commonsense Reasoning and Count metrics verify that LogicAgent’s structured reasoning effectively grounds generation in reality. In the POPE benchmark (Figure 4 ), LogicAgent outperforms baselines across all settings. The most telling result is in the Adversarial setting, which specifically probes the model with non-existent but likely objects (e.g., asking about a ”keyboard” in an office scene where there isn’t one). LogicAgent achieves an F1 score of 80.3 , surpassing CEN by +2.7 . This confirms that our Counterfactual Robustness ( \mathcal{L}_{CF} ) objective effectively forces the model to verify visual evidence before generation, rather than relying on language priors. On MME (Figure 5 ), we observe perfect or near-perfect scores in Commonsense Reasoning (100.7). This metric evaluates whether the model understands physical laws and causal relationships (e.g., ”Can the cup fly?”). The substantial gain over baselines (which score 87) demonstrates that LogicAgent’s reasoning chain prevents it from generating physically impossible or logically contradictory descriptions. 4.4 Ablation Studies We conduct extensive component-level and loss-level ablation studies to disentangle the contribution of each module in LogicAgent. The results are summarized in Table 3 . Method VIST Ego4D MMIU PororoSV WebQA Full Model 0.4564 0.4797 0.3063 0.4497 0.6228 Component-Level Ablation w/o Eventifier (E) 0.4296 0.4584 0.2764 0.4392 0.6076 w/o Generator (G) 0.4316 0.4623 0.2689 0.4351 0.6108 w/o Verifier (V) 0.4268 0.4521 0.2776 0.4292 0.5931 Loss-Level Ablation w/o L_{\text{pred}} 0.4316 0.4597 0.2791 0.4378 0.6095 w/o L_{\text{logic}} 0.4362 0.4635 0.2834 0.4401 0.6139 w/o L_{\text{cf}} 0.4432 0.4708 0.2927 0.4445 0.6163 w/o L_{\text{spar}} 0.4416 0.4722 0.2908 0.4463 0.6179 Table 3 : Ablation results. Removing any core component or loss term leads to performance degradation, validating the holistic design of LogicAgent. Impact of Structural Components. Removing the Eventifier (w/o E) leads to a sharp performance drop (e.g., -0.026 on VIST). Without explicit event grounding, the model reverts to processing raw continuous features, re-introducing the ”process blindness” issue. Similarly, disabling the Generator (w/o G) and relying on implicit reasoning degrades performance, confirming that discrete symbolic chains are necessary for complex planning. The removal of the Verifier (w/o V) causes the most significant drop in Ego4D (-0.027), as the model loses the feedback mechanism to correct logical inconsistencies during training. Analysis of Functional Objectives. At the loss level, ablating the prediction-consistency term ( w/o L_{\text{pred}} ) or the temporal-logic constraint ( w/o L_{\text{logic}} ) significantly undermines temporal stability, with the effect most pronounced on Ego4D where fine-grained event ordering is essential. The Counterfactual Robustness ( L_{\text{cf}} ) objective plays a targeted role in causal reasoning: while its removal causes only mild degradation on VIST in aggregate scores, it leads to substantially larger drops in causal-consistency metrics, indicating reduced sensitivity to intervention-based reasoning. Meanwhile, Sparsity ( L_{\text{spar}} ) encourages compact and focused reasoning chains; without it, the model tends to over-generate redundant steps, which slightly harms performance on precision-oriented tasks such as WebQA. Taken together, these ablations show that each objective addresses a complementary failure mode, and their joint optimization is crucial for achieving stable, concise, and causally coherent neuro-symbolic reasoning in LogicAgent. 5 Related Work Temporal Modeling in Video Understanding. Temporal reasoning has long been a central topic in video understanding ( 2 ; 1 ; 37 ; 40 ; 60 ; 33 ; 58 ; 48 ) . Early methods based on recurrent or 3D convolutional architectures capture short-term motion dynamics but struggle with long-range dependencies across events ( 11 ; 28 ; 38 ; 39 ; 25 ; 13 ) . Transformer-based models such as TimeSformer ( 5 ) have enhanced sequence modeling, yet they still treat videos as a collection of discrete states. This state-centric paradigm enables models to recognize what occurs in each semantic state S_{t_{i}} but not how one state evolves into another, governed by the underlying narrative process \mathcal{P} . While these methods excel at state perception ( S_{t_{i}} ), they lack an explicit representation of the narrative process ( \mathcal{P} ) that governs state transitions. Causal and Narrative Reasoning in Video–Language Tasks. Efforts in video captioning and question answering have sought to incorporate causal and temporal cues to improve narrative coherence ( 2 ; 1 ; 37 ; 40 ; 35 ; 36 ; 46 ; 50 ; 56 ) . Works on dense captioning and causal-temporal narrative modeling (e.g., NarrativeBridge, VLOG) ( 32 ; 49 ; 53 ) attempt to link adjacent events, but their reasoning remains primarily output-level (enhancing textual consistency without forming an internal, verifiable representation of the underlying process). As a result, these models lack the ability to represent why one event leads to another. In contrast, LogicAgent is designed to internalize this latent process \mathcal{P} . We achieve this by first decomposing the video into grounded events with an Eventifier , then constructing an explicit symbolic reasoning chain ( \mathcal{C} ) with a Discrete CoT Generator , and finally verifying this chain’s validity against the video’s perceptual evidence using a novel Hybrid Differentiable Logic Verifier . Multimodal Large Models and Remaining Gaps. The advent of large-scale video-language foundation models (e.g., Video-LLaMA, GPT-4V, InternVideo2) ( 34 ; 10 ; 4 ; 43 ; 47 ) has broadened video understanding toward open-domain reasoning. Despite their impressive generalization, recent analyses reveal persistent limitations in temporal ordering and causal reasoning ( 6 ; 41 ; 16 ; 57 ; 15 ) , where even advanced models often misinterpret commonsense chronology. This continuing process blindness highlights the need for architectures that reason over event transitions ( \mathcal{P} ) rather than aligning isolated state representations ( S_{t_{i}} ). Our framework addresses this gap directly, proposing that a functional, verifiable, neuro-symbolic reasoning process is essential for mitigating this process blindness and achieving robust video understanding. 6 Conclusion We highlight a key limitation of current video-to-text models: opaque, correlation-driven representations fundamentally hinder causal, temporal, and coherent understanding. LogicAgent tackles this by lifting videos into grounded event units, composing explicit and verifiable reasoning chains, and validating these chains directly against perceptual and temporal evidence. Through a functional optimization paradigm that jointly enforces predictive utility, temporal logic, counterfactual robustness, and concise rationale formation, the framework transforms reasoning from a passive byproduct into an active computational variable. Experiments across diverse benchmarks demonstrate that explicit, verifiable reasoning provides a promising path toward interpretable, process-level, and causally grounded video understanding. Impact Statement This paper presents LogicAgent , a framework that enhances the interpretability and reliability of video understanding through explicit, structured reasoning chains. Such transparency is especially important in safety-critical applications, including autonomous driving and robotics, where model decisions must be explainable and verifiable by humans. It can also support debugging and accountability by exposing where temporal or causal assumptions fail. Nevertheless, more powerful video understanding systems may be misused for intrusive surveillance or unintended monitoring. Moreover, since logical grounding is learned from data, biases or gaps in training distributions can propagate into flawed or uneven inferences, especially under distribution shift. We therefore advocate responsible deployment with clear usage boundaries, careful dataset curation, and continuous monitoring (e.g., bias and failure-mode audits) to promote ethical and trustworthy use in practice. Appendix A Reference Overview In this section, we provide a structured reference for the supplementary material and briefly summarize what each subsequent subsection is responsible for. • § B Theoretical Analysis of Logic Codebook Identifiability. Provides a formal analysis of the optimization dynamics governing the Logical Operator Codebook Z and proves that the proposed functional optimization paradigm prevents symbol grounding collapse under a \delta -discriminative data assumption. • § C Extended Analysis: Robustness of Symbolic Identifiability. Extends the theory to identifiability up to permutation/isometry, prevents gradient bypass, proves multi-class semantic separation, and establishes reasoning-chain identifiability. • § D Discussion: Methodological Paradigm and Complexity Analysis. Positions LogicAgent among existing paradigms (LVLMs, dense captioning), contrasts black-box vs. explicit reasoning, and analyzes complexity reduction from \mathcal{O}(T^{2}) dense tokens to \mathcal{O}(K^{2}) sparse events. • Additional Technical Details. Details the differentiable logic verifier, discrete chain sampling, counterfactual construction, complexity theorem, and qualitative failure cases, serving as an implementation-oriented reference. • § F Selection and Efficiency Analysis. Breaks down FLOPs, parameters, and latency of each symbolic component (Eventifier, CoT generator, verifier) and shows that symbolic reasoning contributes less than 3% of total compute. • § G Hyperparameter Sensitivity Analysis. Sweeps event count K , chain length T , and codebook size M across datasets, demonstrating that LogicAgent is robust and does not rely on fragile hyperparameter tuning. • § H Datasets. Summarizes all benchmarks used in LogicAgent, highlighting their narrative style, temporal structure, and what kind of reasoning (causal, procedural, multi-image, egocentric) each dataset stresses. • Baseline Models. Describes the compared baselines, including LVLMs (e.g., VideoLLaVA ( 24 ) , ShareGPT4Video ( 8 ) , Qwen2.5-VL-7B ( 4 ) ), commercial models (GPT-4o, Gemini 2.5 Pro), and structured captioning methods (SEM-POS, Vid2Seq, AKGNN, GIT, CEN), and clarifies their reasoning limitations. • § I Analyses of Cross-Dataset Transfer Learning. Evaluates whether procedural and causal knowledge learned on YouCook2 can transfer to ViTT and ActivityNet under 10% low-resource settings, comparing LogicAgent with Vid2Seq ( 52 ) , GIT ( 18 ) , and CEN. • § J Cross-Domain Reasoning Chain Sensitivity Analysis. Studies how sparsity hyperparameters and logic-operator ablations affect chain length and BLEURT scores across VIST, Ego4D, MMIIU, and WebQA, revealing the optimal regime and the contributions of temporal vs. semantic operators. • § M Causal Intervention and Decoding Dependency. Applies adversarial interventions (semantic flip, time reversal, structural shuffle) on reasoning chains to quantify how strongly the decoder depends on chain correctness on VIST and MMIU. • § N Event-Density Robustness Analysis. Partitions Ego4D and VIST into sparse/medium/dense event regimes and compares LogicAgent with CEN to show robustness under increasing event density and narrative complexity. Appendix B Theoretical Analysis of Logic Codebook Identifiability In this section, we provide a formal analysis of the optimization dynamics governing the Logical Operator Codebook Z . We aim to prove that the proposed functional optimization paradigm prevents symbol grounding collapse —a failure mode where distinct logical operators degenerate into a single representation ( 17 ; 23 ) . B.1 Preliminaries and Definitions Let \mathcal{V} denote the manifold of video event pairs, and Z=\{z_{m}\}_{m=1}^{M}\subset\mathbb{R}^{d} be the set of learnable operator embeddings. The system is trained under the objective \mathcal{L}=\mathcal{L}_{LTL}+\lambda\mathcal{L}_{CF} ( 22 ) . Definition B.1 ( Operator Collapse ) . We say that the codebook Z suffers from Operator Collapse if there exists a pair of functionally distinct operators z_{i},z_{j}\in Z ( i\neq j ) such that: \lim_{t\to\infty}\|z_{i}^{(t)}-z_{j}^{(t)}\|_{2}<\epsilon (9) where \epsilon\to 0 and t represents training steps. Definition B.2 ( \delta -Discriminative Data Distribution ) . We assume the training data distribution \mathcal{D} is \delta -discriminative. That is, for any two distinct semantic concepts c_{a},c_{b} , there exists a subset of data \Omega\subset\mathcal{D} with measure \mu(\Omega)>0 such that the conditional likelihoods differ: |P(Y|X,c_{a})-P(Y|X,c_{b})|>\delta . B.2 Identifiability Analysis We now define the main proposition regarding the separability of the learned operators. Proposition B.3 ( Global Identifiability of Logic Operators ) . Under the \delta -discriminative data assumption and the hybrid objective \mathcal{L} , the gradient flow guarantees that for any distinct z_{i},z_{j}\in Z , the expected inner product of their optimization directions satisfies: \mathbb{E}_{\mathcal{D}}\left[\langle\nabla_{z_{i}}\mathcal{L},\nabla_{z_{j}}\mathcal{L}\rangle\right]<\|\nabla_{z_{i}}\mathcal{L}\|\|\nabla_{z_{j}}\mathcal{L}\| (10) implying divergent trajectories and ensuring \|z_{i}-z_{j}\|_{2}>0 at convergence. To prove Proposition B.3 , we establish two lemmas handling the temporal and semantic subsets of Z respectively. Lemma B.4 ( Orthogonality of Temporal Constraints ) . For any z_{a},z_{b}\in Z_{T} associated with distinct temporal relations (e.g., before vs. after), the gradients derived from the Symbolic Verifier V_{T} are orthogonal or strictly opposing. Proof. The function V_{T} is non-learnable and defined as f_{T}:(\tau,z)\to[0,1] . Consider z_{before} and z_{after} . The loss \mathcal{L}_{LTL} minimizes the negative log-likelihood. Let \Delta\tau=\tau_{2}-\tau_{1} . The gradients w.r.t. the selection probability logits are: \frac{\partial\mathcal{L}}{\partial\pi_{before}}\propto-(1-\sigma(k\Delta\tau)),\quad\frac{\partial\mathcal{L}}{\partial\pi_{after}}\propto-(1-\sigma(-k\Delta\tau)) (11) For any grounded event pair, \Delta\tau is fixed. If \Delta\tau>0 , the gradient boosts \pi_{before} while suppressing \pi_{after} . Geometrically, this forces the embeddings z_{before} and z_{after} to occupy disjoint regions in the embedding space to maximize their respective dot-products with the context state. Thus, collapse is impossible solely due to the fixed, hard constraints of V_{T} . ∎ Lemma B.5 ( Semantic Separation via Counterfactual Barrier ) . For semantic operators z\in Z_{S} , the Counterfactual Loss \mathcal{L}_{CF} creates an energy barrier m_{s} that prevents collapse into non-causal (correlation-based) representations. Proof. We employ proof by contradiction. Hypothesis H_{0} : Assume a semantic operator z_{cause} collapses to a generic correlation vector z_{corr} , such that it relies only on visual feature similarity \|v_{a}-v_{b}\| and ignores causal direction. Consider a positive sample V^{+} (valid causality) and a constructed negative sample V^{-} (shuffled/reversed, invalid causality). Under H_{0} , since visual features are preserved in V^{-} , a correlation-based verifier yields: V_{S}(V^{+},z_{corr})\approx V_{S}(V^{-},z_{corr}) (12) Substituting this into the Counterfactual Loss \mathcal{L}_{CF}=\max(0,m_{s}-(V_{S}(V^{+})-V_{S}(V^{-}))) : \mathcal{L}_{CF}\approx\max(0,m_{s}-0)=m_{s} (13) Since m_{s}>0 , the loss is non-zero and the system is not at a stationary point. The gradient descent update is: z^{(t+1)}\leftarrow z^{(t)}-\eta\nabla_{z}\mathcal{L}_{CF} (14) The term \nabla_{z}\mathcal{L}_{CF} acts to maximize the difference \Delta=V_{S}(V^{+})-V_{S}(V^{-}) . To increase \Delta , z must move away from z_{corr} towards a manifold that is sensitive to structural changes (causality) rather than just feature presence. Therefore, the stable equilibrium exists only where \|z_{cause}-z_{corr}\|>\xi , contradicting the collapse hypothesis H_{0} . ∎ Proof of Proposition B.3 : Combining Lemma B.4 and Lemma B.5 , we conclude that all operators in Z are subject to forces (either hard temporal constraints or soft counterfactual margins) that penalize feature collapse. The codebook Z thus remains identifiable throughout the optimization process. ∎ Appendix C Extended Analysis: Robustness of Symbolic Identifiability While Section B.2 established the non-collapse property of the operator codebook, we now address four deeper theoretical constraints necessary for rigorous neuro-symbolic grounding: (1) Identifiability up to permutation, (2) Prevention of gradient bypass, (3) Multi-class semantic separation, and (4) Chain-level uniqueness ( 27 ; 44 ) . C.1 Identifiability Modulo Permutation Address to Gap 1: Since the mapping from discrete symbols to continuous embeddings is learned, we must define identifiability relative to the geometric symmetries of the latent space (e.g., rotation or permutation of basis vectors). Proposition C.1 (Identifiability up to Isometry) . Let Z^{*} be the ground-truth operator representations. The learned codebook Z is considered identifiable if it recovers Z^{*} up to an isometric transformation. Specifically, for any learned solution \hat{Z} , there exists a permutation matrix P and an orthogonal rotation matrix Q such that: \hat{Z}\approx PQZ^{*} (15) Proof. The loss functions \mathcal{L}_{LTL} and \mathcal{L}_{CF} are defined on scalar distinctness (dot products and norms). Since \|Qz_{i}-Qz_{j}\|_{2}=\|z_{i}-z_{j}\|_{2} for orthogonal Q , the objective function is invariant to global rotation. Similarly, since the Generator samples indices k , swapping index i and j alongside swapping z_{i} and z_{j} (via P ) leaves the distribution P(\mathcal{C}|\mathcal{E}) invariant. Thus, the optimization converges to the unique equivalence class of codebooks defined by the quotient space Z/\sim_{iso} , ensuring that the relative geometric structure of operators is preserved. ∎ C.2 Non-Degenerate Gradient Flow Address to Gap 2: We reject the hypothesis that the optimizer effectively ignores Z by shifting all discrimination burdens to the Eventifier or Verifier weights (a ”gradient bypass” attack). Lemma C.2 (Conditioning Dependency) . The gradients with respect to the operator embeddings are non-vanishing, i.e., \nabla_{z}\mathcal{L}\neq\mathbf{0} , provided the set of logical functions \mathcal{F}_{logic}=\{f_{z}:\mathcal{V}\times\mathcal{V}\to[0,1]\mid z\in Z\} are functionally distinct. Proof. The Semantic Verifier is modeled as a conditional probability estimator V_{S}(v_{a},v_{b}|z) . Assume for contradiction that the gradients \nabla_{z}\mathcal{L}\to\mathbf{0} . This implies the Verifier’s output is independent of z : V_{S}(v_{a},v_{b}|z)\approx g(v_{a},v_{b}) . However, distinct operators (e.g., z_{cause} vs. z_{prevent} ) have contradictory truth values for the same visual evidence pair (v_{a},v_{b}) . For a video depicting a ”kick” followed by a ”goal”: • Target for z_{cause} is 1 (True). • Target for z_{prevent} is 0 (False). A z -independent function g(v_{a},v_{b}) cannot satisfy both targets simultaneously, leading to high loss. Therefore, to minimize \mathcal{L}_{total} , the Verifier must utilize the information in z , ensuring non-zero gradients that drive z_{cause} and z_{prevent} apart. ∎ C.3 Pairwise Separation of Semantic Operators Address to Gap 3: We extend the separation proof from binary cases (cause vs. correlation) to the full multi-class codebook (e.g., cause vs. enable vs. prevent). Lemma C.3 (Pairwise Multi-Margin Separation) . Under the counterfactual objective, for any triplet of distinct semantic operators z_{a},z_{b},z_{c}\in Z_{S} , the learned embeddings satisfy a pairwise separation constraint: \min_{i,j\in\{a,b,c\},i\neq j}\|z_{i}-z_{j}\|_{2}>\delta (16) Proof. The Counterfactual Loss \mathcal{L}_{CF} is not limited to binary ”real vs. fake” shuffling. It implicitly enforces a multi-way classification margin. For any video sample V valid under operator z_{a} (ground truth), treating it as a sample for operator z_{b} yields a ”logical negative.” The optimization of \mathcal{L}_{LTL} effectively maximizes the likelihood P(z_{a}|V) while minimizing P(z_{b}|V) and P(z_{c}|V) via the softmax normalization in the generator’s policy or the sigmoid saturation in the verifier. By the Triangle Inequality in the metric space, minimizing the overlap between the decision boundaries of z_{a},z_{b} , and z_{c} necessitates maximizing the Euclidean distance between their conditioning embeddings. Thus, the separation generalizes to all functionally distinct operators in Z_{S} . ∎ C.4 Corollary: Identifiability of Reasoning Chains Address to Gap 4: Finally, we link the identifiability of individual operators to the uniqueness of the entire reasoning chain \mathcal{C} . Corollary C.4 (Reasoning Chain Identifiability) . Given an identifiable operator codebook Z (Prop. C.1 ) and a grounded event set \mathcal{E} , the mapping from a logical sequence to its vector representation \Phi(\mathcal{C}) is injective. Specifically: \mathcal{C}_{i}\neq\mathcal{C}_{j}\implies\Phi(\mathcal{C}_{i})\neq\Phi(\mathcal{C}_{j}) (17) Proof. A reasoning chain \mathcal{C} is a sequence of tokens alternating between grounded events E\in\mathcal{E} and logical operators z\in Z . 1. From Section B.2 , distinct operators map to distinct embeddings: z_{m}\neq z_{n}\implies\mathbf{e}(z_{m})\neq\mathbf{e}(z_{n}) . 2. From the Eventifier definition (Sec. 3.2), distinct events have distinct spatiotemporal features: E_{p}\neq E_{q}\implies v_{p}\neq v_{q} . 3. The chain representation \Phi(\mathcal{C}) is computed via a Transformer or sequence encoder (D). Under the assumption of Positional Encoding uniqueness and the universal approximation theorem for Transformers, the encoding of a sequence of distinct discrete tokens is unique. Therefore, since the atomic components ( E and z ) are distinguishable and the composition function is order-sensitive (via positional encodings), distinct reasoning strategies result in distinct latent chains. This guarantees that the model cannot ”hide” illogical reasoning behind a collapsed chain representation. ∎ Appendix D Discussion: Methodological Paradigm and Complexity Analysis To clearly position LogicAgent within the current landscape of video reasoning methodologies, we provide a systematic comparison against dominant paradigms in Table 4 . Our framework departs from correlation-driven latent modeling and instead adopts a neuro-symbolic, explicit reasoning perspective. This shift fundamentally changes how a model interprets, verifies, and computes over temporal processes, resulting in both stronger interpretability and more efficient computation. Methodology Paradigm Reasoning Mechanism Computational Profile (Black-box vs. White-box) Logical Representation Verifiability Input Scale Complexity End-to-End LVLMs Implicit Latent Attention Low Dense Tokens ( T ) \mathcal{O}(T^{2}) (e.g., VideoLLaVA, GPT-4o) (Correlation-driven) (Continuous Vectors) (Unverifiable) (Frame-level) (High Redundancy) Dense Captioning Implicit Positional Embeddings Medium Frame Features ( T ) \mathcal{O}(T^{2}) (e.g., Vid2Seq, CEN) (Sequence-based) (Implicit State) (Text-only) (Frame-level) (Quadratic) LogicAgent (Ours) Explicit Symbolic Chain \mathcal{C} High Sparse Events ( K ) \mathbf{\mathcal{O}(K^{2})} (Reasoning-driven) (Neuro-Symbolic) (Functional) ( K\ll T ) (Efficient) Table 4 : Comparison of reasoning paradigms and complexity. Unlike baselines that operate on dense frame tokens, LogicAgent lifts video understanding into a symbolic event space. This transition transforms reasoning from an implicit correlation-seeking process into an explicit and verifiable computational graph, while also reducing complexity from \mathcal{O}(T^{2}) to \mathcal{O}(K^{2}) since K\ll T . White-Box Verifiability vs. Black-Box Correlation. Current LVLMs and dense captioning systems encode the narrative process \mathcal{P} into continuous, opaque latent vectors or global attention maps. Although these methods excel at perceptual alignment, their “black-box” representations blur causal structure with spurious statistical co-occurrence. This often results in narrative fragmentation, reversed causality, or visually unsupported assertions. LogicAgent introduces an explicit Reasoning Bottleneck by requiring the model to produce a discrete symbolic chain \mathcal{C} . Each step in the chain corresponds to a verifiable operator ( before , cause , enable , etc.), allowing our Hybrid Differentiable Logic Verifier \mathcal{F}_{V} to evaluate consistency against video evidence. This design exposes the internal reasoning process, enabling the system to distinguish whether an error arises from perceptual grounding or from faulty logical inference—capabilities unavailable in end-to-end LVLMs. Complexity and Sparse Efficiency. Modular reasoning systems are sometimes assumed to incur additional overhead; however, LogicAgent is computationally more efficient than dense LVLM pipelines due to Semantic Sparsity . • Baseline LVLMs. Transformer-based models operate on a dense sequence of frame-level tokens of length T , invoking quadratic self-attention \mathcal{O}(T^{2}) . This becomes prohibitive for long-horizon videos such as Ego4D or cinematic content. • LogicAgent. Our Eventifier compresses raw video frames into a set of abstract event units K , where K\ll T . A typical 1,000-frame clip contains only K\approx 10 distinct events. The symbolic CoT Generator then reasons solely over this compact structure. Thus, the core reasoning complexity reduces from \mathcal{O}(T^{2}) to \mathcal{O}(K^{2}) , yielding substantial savings. Moreover, our sparsity objective \mathcal{L}_{\text{spar}} penalizes redundant steps, producing concise chains (average length 5.4), which further accelerates reasoning and improves robustness. Framework Type Primary Training Objective Theoretical Limitation Standard Captioning \min_{\theta}-\sum\log P(Y_{t}\mid V,Y_{ 6 events). We compare LogicAgent with a strong baseline, CEN , using BLEURT as the unified evaluation metric. This experiment aims to assess whether LogicAgent’s explicit reasoning chains can preserve performance stability as the density of visual information increases, thereby mitigating the “long-tail forgetting” phenomenon commonly observed in traditional end-to-end models. Table 14: Performance stability under event-density scaling on Ego4D and VIST. BLEURT is reported. Dataset Complexity Level CEN (BLEURT) LogicAgent (BLEURT) Gap ( \Delta ) Ego4D Sparse (Simple) 0.492 0.501 +1.80% Medium (Normal) 0.465 0.4885 +5.10% Dense (Hard) 0.352 0.4725 +34.2% VIST Sparse (Simple) 0.4615 0.472 +2.30% Medium (Normal) 0.428 0.465 +8.60% Dense (Hard) 0.315 0.448 +42.2% The complexity-robustness evaluation clearly highlights the core strength of LogicAgent —its inherent anti-entropy capability in reasoning-intensive scenarios. Under the Sparse (simple) setting, where video logic remains minimal (e.g., a single action such as “cutting a tomato”), CEN performs competitively due to its strong perceptual modeling, and the advantage of LogicAgent is relatively small (+1–2%). However, as event density increases to the Dense (hard) regime, the performance gap grows sharply. In Ego4D’s dense sequences (e.g., “pick up bowl \rightarrow wash bowl \rightarrow dry bowl \rightarrow place back”), CEN exhibits a steep performance drop—a characteristic sign of context erosion and logic fragmentation . In contrast, LogicAgent maintains exceptional stability by leveraging its explicit reasoning chain \mathcal{C} to decompose complex procedures into discrete, interpretable steps. These observations demonstrate that LogicAgent’s improvements primarily stem from its ability to conquer long-tail, high-complexity scenarios , rather than from overfitting to simple instances. Figure 6 : Our method (Ours) accurately captures key temporal–spatial cues such as kicking direction, ball trajectory, and goalkeeper readiness. GPT-4o and Qwen2.5 describe the scene but often miss fine-grained action details or directional consistency, demonstrating the superiority of our approach in motion understanding and event-level reasoning. Figure 7 : Our method (Ours) reliably captures fine-grained motion details such as hand–handle interaction, body posture, and lighting cues while preserving temporal coherence. GPT-4o and Qwen2.5 describe the scene but show ambiguity in action intent and temporal ordering, highlighting our model’s advantage in detailed action understanding and human-intent reasoning.