CascadeMind at SemEval-2026 Task 4: A Hybrid Neuro-Symbolic Cascade for Narrative Similarity
Sebastien Kawada Dylan Holyoak · 2026
Read CascadeMind at SemEval-2026 Task 4: A Hybrid Neuro-Symbolic Cascade for Narrative Similarity by Sebastien Kawada Dylan Holyoak (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19931.txt.
Introduction
Sebastien Kawada and Dylan Holyoak describe a system entered in a shared task on story similarity. SemEval-2026 Task 4 asks systems to judge how similar two narratives are. Their entry, CascadeMind, mixes neural and symbolic methods in a cascade. The neural part uses a language model that votes many times in parallel, a technique called self-consistency voting.
A supermajority threshold settles confident cases at once. Uncertain cases escalate to more voting rounds. A symbolic ensemble that analyses narrative structure at several scales acts as tiebreaker. Cascades spend heavy computation only where doubt remains. The design reflects a wider pattern in applied AI: fast neural judgement, checked by slower structured analysis.
Catalog record
| CREATOR | Sebastien Kawada Dylan Holyoak |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19931
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CascadeMind at SemEval-2026 Task 4: A Hybrid Neuro-Symbolic Cascade for Narrative Similarity Sebastien Kawada Dylan Holyoak Abstract We present a hybrid neuro-symbolic system for the SemEval-2026 Task 4 on Narrative Story Similarity. Our approach combines neural self-consistency voting with a novel Multi-Scale Narrative Analysis Ensemble that operates as a symbolic tiebreaker. The neural network component uses a large language model with multiple parallel votes, applying a supermajority threshold for confident decisions and escalating uncertain cases to additional voting rounds. When votes result in a perfect tie, a symbolic ensemble combining five narrative similarity signals (lexical overlap, semantic embeddings, story grammar structure, event chain alignment, and narrative tension curves) provides the final decision. Our cascade architecture achieves 81% accuracy on the development set, demonstrating that selective deferral to symbolic methods can enhance neural predictions on genuinely ambiguous narrative comparisons. 1 Introduction Narrative similarity, the task of determining whether two stories share meaningful commonality, is a fundamental challenge in computational narratology ( Piper 2021 ) . SemEval-2026 Task 4 uses the comparative judgment paradigm: given an anchor story and two candidates, systems must determine which candidate is more narratively similar to the anchor. Beyond surface-level text similarity, this requires understanding deeper storytelling aspects: the abstract theme (ideas and motives), course of action (sequence of events), and outcomes (results and resolutions) ( Hatzel and Biemann 2024 ) . This task design reflects how humans naturally compare stories and has applications in narrative recommendation, plagiarism detection, and literary analysis. While large language models (LLMs) excel at semantic understanding, previous research also demonstrate that LLMs can struggle on genuinely ambiguous cases where multiple valid interpretations exist Keluskar et al. 2024 . To address this challenge, we take inspiration from human decision making where different reasoning strategies are applied depending on the task difficulty and available knowledge as opposed to treating all cases uniformly Kahneman 2011 . We developed a hybrid neuro-symbolic model, called CascadeMind , by combining combining LLMs and rule-based symbolic reasoning. The CascadeMind model (1) uses self-consistency voting algorithm ( Wang et al. 2023 ) to assess uncertainty in LLM decisions, (2) employs a supermajority threshold to identify confident vs. uncertain predictions, and (3) defers the most uncertain decisions (e.g., perfect tie) to a symbolic ensemble module based on narrative theory for further analysis. Our contributions are: • A cascade architecture combining neural self-consistency with rule-based symbolic reasoning • A Multi-Scale Narrative Analysis Ensemble incorporating five signals from different levels of narrative abstraction which give auxiliary reasoning to the most ambiguous cases • Empirical analysis showing that cascade design provides more value than the symbolic component alone 2 Related Work Self-Consistency Decoding Self-consistency has roots in ensemble learning, where aggregating multiple hypotheses improves predictions Hansen and Salamon 1990 . Wang et al. 2023 introduced self-consistency as a decoding strategy that samples multiple reasoning paths and selects the most consistent answer through majority voting, showing that diverse reasoning traces yield significantly higher accuracy than single samples. This approach has been extended to medical question answering ( Maharjan et al. 2024 ) and code generation ( Huang et al. 2024a ) , while recent work on mirror-consistency addresses overconfidence in minority responses ( Huang et al. 2024b ) . Narrative Representation Learning Computational approaches to narrative understanding have evolved from rule-based story grammars ( Propp 1968 ) to neural network embedding representations. Hatzel and Biemann 2024 introduced story embeddings that capture narrative similarity by training on reformulations of the same story. This work is directly relevant to our task as it comes from the task organizers. The CoRRPUS framework ( Dong et al. 2023 ) demonstrated that neurosymbolic approaches can outperform pure neural methods on story understanding tasks by leveraging structured representations. Ensemble Methods and Selective Prediction Dietterich 2000 shows that ensembles can classify data points by weighted voting of predictions. Selective prediction allows models to abstain when uncertain, trading coverage for accuracy ( Geifman and El-Yaniv 2017 ) . Our cascade architecture implements a form of selective prediction where uncertain neural predictions are escalated to symbolic reasoning rather than abstained entirely. Narrative Theory Our symbolic component draws on classical narrative theory. Propp’s morphology of the folktale ( Propp 1968 ) identified recurring structural elements across stories. Freytag’s pyramid models narrative tension through exposition, rising action, climax, falling action, and resolution ( Freytag 1894 ) . Todorov’s equilibrium theory ( Todorov 1969 ) describes narratives as movements between stable states. We operationalize these theories as computable similarity signals. 3 System Architecture We use a simple, direct prompt in the CascadeMind model: Which story (A or B) is more similar to the Anchor story? , Anchor: [text] , Story A: [text] , Story B: [text] , Return your decision as JSON with a "decision" field set to either "A" or "B". Our system implements a two-stage cascade combining neural voting with symbolic rule-based reasoning for most uncertain cases. Figure 1 illustrates the overall architecture. Stage 1: Self-Consistency Voting \mathcal{V}=\{v_{1},\ldots,v_{8}\}\quad v_{i}\sim\text{LLM}(x_{\text{anchor}},x_{A},x_{B}) Stage 2: Confidence Check \hat{y}=\begin{cases}\arg\max_{X}|\{v_{i}=X\}|&\text{if }\max_{X}|\{v_{i}=X\}|\geq 7\\[2.0pt] \text{ESCALATE}&\text{otherwise}\end{cases} Stage 3: Escalation (if needed) \mathcal{V}^{\prime}=\mathcal{V}\cup\{v_{9},\ldots,v_{32}\}\quad\hat{y}=\text{majority}(\mathcal{V}^{\prime}) Stage 4: Symbolic Tiebreaker (if |\mathcal{V}^{\prime}_{A}|=|\mathcal{V}^{\prime}_{B}| ) \hat{y}=\arg\max_{X}\sum_{i=1}^{5}w_{i}\cdot\text{sim}_{i}(x_{\text{anchor}},x_{X}) 74% 21% 5% Supermaj. Escalated Symbolic Figure 1: Cascade decision process. Most cases (74%) resolve via supermajority; 21% require escalation; 5% invoke the symbolic ensemble. 3.1 Neural Self-Consistency Voting We use Gemini 2.5 Flash as our base LLM, leveraging its native candidateCount parameter to generate 8 parallel responses per API call. Each response provides a binary decision (A or B) for which story is more similar to the anchor. Decision Logic Let V=\{v_{1},\ldots,v_{8}\} be the set of votes where v_{i}\in\{A,B\} . We define the vote count c_{X}=|\{v_{i}:v_{i}=X\}| for X\in\{A,B\} . Supermajority: If \max(c_{A},c_{B})\geq 7 , we return the majority decision immediately. This threshold (87.5%) indicates high model confidence. Escalation: If votes are split (5-3, 6-2, or 4-4), we request three additional independent API calls, each using the models candidateCount=8 setting. Votes from all calls are compiled, totaling 32 votes. The majority across all votes determines the decision, unless a perfect tie (16-16 votes) occurs. 3.2 Multi-Scale Narrative Analysis Ensemble When neural voting produces a perfect tie after escalation, we invoke a symbolic ensemble component combining five signals at different levels of narrative abstraction (Figure 2 ). Let s_{i}^{A} and s_{i}^{B} denote the similarity scores between the anchor and stories A and B for signal i . Ensemble Decision: \displaystyle\hat{y}=\arg\max_{X\in\{A,B\}}\sum_{i=1}^{5}w_{i}\cdot s_{i}(x_{\text{anc}},x_{X}) s_{1} =\cos(\mathbf{t}_{\text{anc}},\mathbf{t}_{X}) TF-IDF vectors w_{1}{=}0.49 s_{2} =\frac{1}{5}\sum\limits_{p=1}^{5}\cos(\mathbf{e}_{p}^{\text{anc}},\mathbf{e}_{p}^{X}) Story grammar w_{2}{=}0.40 s_{3} =\cos(\mathbf{e}_{\text{anc}},\mathbf{e}_{X}) Semantic emb. w_{3}{=}0.08 s_{4} =\text{corr}(\tau_{\text{anc}},\tau_{X}) Tension curve w_{4}{=}0.02 s_{5} =\frac{|\text{LCS}(E_{\text{anc}},E_{X})|}{\max(|E|)} Event chain w_{5}{=}0.01 Lexical Grammar \leftarrow\mathbf{w}^{*} Figure 2: Multi-Scale Narrative Ensemble with five weighted similarity signals ( \mathbf{w}^{*} optimized via differential evolution). Signal 1: Lexical Similarity (TF-IDF) We compute TF-IDF Salton and Buckley 1988 vectors, which represent narratives as numerical feature vectors based on word usage and importance. For each problem, we compute TF-IDF vectors for anchor narrative and the two option narratives, and then measure cosine similarity between the anchor and option narratives: s_{\text{lex}}^{X}=\cos(\text{tfidf}(\text{anchor}),\text{tfidf}(X)) (1) This TF-IDF–based lexical similarity captures surface-level overlap in word usage, reflecting shared situations, characters, or domain-specific terminology. Signal 2: Semantic Similarity Using the all-MiniLM-L6-v2 sentence transformer that encodes narratives into dense vector embeddings ( Reimers and Gurevych 2019 ) , we compute pairwise cosine similarity between