An Interaction Language Model: Mechanism Discovery from Statistical Patterns of Physical Interactions

Triparna Ganguly, Hanqi Jiang, Xinliang Li, Yi Pan, Junhao Chen, Miyuki Karunathilaka, Tianming Liu, Yohannes Abate · 2026

Read An Interaction Language Model: Mechanism Discovery from Statistical Patterns of Physical Interactions by Triparna Ganguly, Hanqi Jiang, Xinliang Li, Yi Pan, Junhao Chen, Miyuki Karunathilaka, Tianming Liu, Yohannes Abate (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30922.txt.

Introduction

Triparna Ganguly and seven colleagues propose treating physical interactions as a language that a model can learn. Just as language models learn which words follow others, their Interaction Language Model learns which physical phenomena follow others, and under what conditions. The design keeps two jobs separate. One part proposes chains of interactions. Another checks every step against a fixed evidence graph built from the literature. Each accepted explanation thus carries an audit trail. Two components, PhenoLink and PhenoSeq, apply the idea to molecular diffusion.

Across four held-out suites totalling 172 queries, the pipeline matched a zero-shot Claude Opus 4.7 baseline on in-distribution accuracy. The difference showed on impossible queries: the baseline fabricated a chain for every one, while the new system refused up to 93.5% of them. Every accepted step was grounded in corpus evidence by construction.

Catalog record

CREATORTriparna Ganguly, Hanqi Jiang, Xinliang Li, Yi Pan, Junhao Chen, Miyuki Karunathilaka, Tianming Liu, Yohannes Abate
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE97 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30922

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Interaction Language Model: Mechanism Discovery from Statistical Patterns of Physical Interactions Triparna Ganguly, Hanqi Jiang, Xinliang Li, Yi Pan, Junhao Chen, Miyuki Karunathilaka, Tianming Liu, Yohannes Abate Abstract Interactions among elementary building blocks across physical, chemical, and biological systems follow structured patterns that can be interpreted as a learnable language: just as natural language models learn which words tend to follow others, one can learn which physical phenomena tend to follow others and under what conditions. We introduce an Interaction Language Model (ILM): a framework that treats interaction as a statistically structured, learnable language for design-to-function reasoning across scientific fields, with a deliberate architectural commitment to keeping statistical chain proposal separate from corpus-grounded chain verification. By capturing statistical dependencies and ordered relationships among interacting components and verifying every proposed transition against a fixed evidence graph, ILMs can infer interaction pathways, identify missing steps, and propose new functions while exposing a per-step audit trail that is reproducible from the same artifact. We demonstrate this framework through two complementary components, which we call PhenoLink and PhenoSeq, applied here to molecular diffusion, a ubiquitous mechanism that governs energy and particle transport across natural and engineered systems. PhenoLink is a directed graph of interactions among diffusion based events extracted from scientific publications, in which each edge aggregates paragraph-level evidence and carries a transition probability interpreted as an information cost. PhenoSeq complements this structure with a sequence model that proposes missing mechanistic steps under endpoint constraints, yielding a generate-then-verify pipeline in which every accepted step carries a reproducible, corpus-grounded audit trail. Together they form a generate-then-verify pipeline that returns every explanation with a reproducible, per-step audit trail. Across four held-out test suites of 172 queries, the PhenoLink–PhenoSeq pipeline matches a zero-shot Claude Opus 4.7 baseline on in-distribution accu- racy, yet unlike the baseline, which fabricates a chain for every impossible query, it refuses up to 93.5% of them and grounds 100% of its accepted tran- sitions in corpus evidence by construction. ILM thus delivers what zero-shot generation structurally cannot: deterministic refusal of evidence-absent queries and auditable, per-step support. The framework can be extended to a wide range of natural and engineered systems where function emerges from sequential and conditional interactions among molecules, cells, devices, or other fundamental components. keywords corpus-grounded reasoning, scientific knowledge graph, evidence-weighted graph, auditable AI, constrained sequence modeling, refusal behaviour, molecular diffusion, transport phenomena. 1 Introduction Interactions among elementary components can give rise to functional units in natural and engineered systems. These interactions follow structured patterns governed by physical laws, where certain transitions between states are warranted under specific conditions and others are not. We observe that these patterns share a fundamental property with natural language: they are sequential, context-dependent, and statistically learnable. Just as language models learn which words tend to follow others, one can learn which physical phenomena tend to follow others, and under what conditions. Motivated by this observation, we introduce the Interaction Language Model (ILM): a framework that captures these statistical dependencies between interacting phenomena and uses them for prediction of interaction pathways, identification of missing steps, and auditing of unsupported transitions. The architectural feature of the ILM framework is a deliberate separation between statistical proposal and corpus-grounded verification : candidate reasoning chains are generated by a sequence model whose outputs are independently checked, step by step, against a precompiled directed graph of evidence-weighted phenomenon transitions, so that every accepted explanation is reproducible from a fixed graph artifact and queries lacking corpus support are refused rather than completed. We note that LLMs can generate domain-specific reasoning for interaction towards a function but may embed unsupported transitions that are difficult to detect without domain expertise Ji et al. 2023 ; Huang et al. 2025 . Domain fine-tuning improves recall but does not provide per-step evidence mapping. The ILM framework we propose addresses this shortcoming by starting from a fundamentally different perspective: we separate generation from support, constructing reusable statistical knowledge objects that can audit any candidate explanation. The framework consists of two complementary components we call PhenoLink and PhenoSeq . PhenoLink is a directed graph of phenomenon-to-phenomenon interactions extracted from scientific publications. We use the term interaction here in a specific, operational sense: a directed mechanistic transition in which one phenomenon causally or conditionally precedes another under specified physical conditions, with the precedence supported by paragraph-level corpus evidence. This usage is distinct from the symmetric, entity-level interactions familiar from systems biology (e.g., protein–protein binding, gene–gene co-expression, or regulator–target associations), which typically connect named entities rather than physical processes and do not encode causal direction. In PhenoLink , each edge aggregates paragraph-level evidence and carries a transition probability interpreted as an information cost Rissanen 1978 ; Grünwald 2007 . PhenoSeq complements this structure with a sequence model Sutskever et al. 2014 ; Vaswani et al. 2017 that proposes missing mechanistic steps under endpoint constraints. Together, they support a pipeline in which candidate explanations are generated, checked step by step against corpus-grounded evidence, and returned with transparent audit trails. The key distinction between ILM and standard LLMs lies not in raw pass rate on well-posed scientific queries, where modern LLMs are competitive on domains such as molecular diffusion that are well-represented in training corpora Wang et al. 2024 ; Sun et al. 2024 , but in two structural properties of the resulting reasoning. First, a standard LLM has no internal representation of which transitions are supported by corpus evidence and which are not. Asked an impossible question, it will produce a fluent chain anyway: in our evaluation, vanilla Claude Opus 4.7 fabricated a mechanistic chain for every one of 31 deliberately-constructed missing-edge queries, never refusing once. Standard LLMs treat phenomenon names as text tokens; “temperature gradient,” “diffusion,” and “mass transfer” are sequences of subword units whose relationships are learned implicitly from co-occurrence in training corpora and have no concept of evidence absence to refuse on. Second, even when a standard LLM produces a chain that is fluent and reasonably cited, the steps in that chain do not correspond to entries in any specific corpus or vocabulary; we observed that only 0.70% of consecutive (u,v) transitions in vanilla Claude’s chains match edges in our precompiled evidence graph, compared to 100% by construction in PhenoLink chains. In contrast, the ILM framework tokenises the phenomena themselves, not the words that describe them, and learns evidence-weighted transition scores grounded in paragraph-level corpus evidence. Each accepted transition in the resulting graph carries an explicit evidence trail, with the supporting paragraphs identified at construction time and reproducible from the released artifact. We therefore frame the operational distinction between ILM and standard LLMs as (i) deterministic refusal of queries for which the evidence graph contains no supported path, and (ii) per-step audit values reproducible from a fixed artifact under Tiers 0–2 (Sec. 3.4 ), rather than as a claim of pass-rate superiority on standard queries. Several recent systems address LLM auditability gaps by augmenting LLMs with structured knowledge or retrieval at inference time. GraphRAG Edge et al. 2024 extracts an entity-level knowledge graph from a text corpus and uses community summaries to support global question answering; CausalRAG Wang et al. 2025 integrates causal graphs into the retrieval pipeline; and a broader class of knowledge-graph-augmented LLM systems Pan

Read the complete text