From Categorized Neural Architectures to Subexponential Proof Theory

Carlos Ramírez Ovalle ORCID:0000-0002-4254-5610 · 2026

Read From Categorized Neural Architectures to Subexponential Proof Theory by Carlos Ramírez Ovalle ORCID:0000-0002-4254-5610 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28946.txt.

Introduction

Ramírez Ovalle studies how a logic can be read from a class of neural architectures. The start point is a category of zone labelled blocks, with records of which copying, discarding, and zone shifts the design allows. From that category, a subexponential signature is extracted. A sequent calculus is then defined, with rules indexed by the zones. Three results follow: the category is symmetric monoidal, the proof system admits cut elimination, and derivations are sound for the diagrams. Subexponential structure is thus read from data, not assumed.

Catalog record

CREATORCarlos Ramírez Ovalle ORCID:0000-0002-4254-5610
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87725
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.28946

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Categorized Neural Architectures to Subexponential Proof Theory Carlos Ramírez Ovalle ORCID:0000-0002-4254-5610 Abstract . We study a resource-sensitive fragment of the problem of extracting a logical discipline from a class of neural architectures by passing through categorization. The starting point is not a pre-existing logic but a category of zone-labelled parametrised blocks together with a disciplined record of which forms of copying, discarding, and zone coercion are architecturally licensed. From this categorized architecture we read off a subexponential signature and then define a tensorial sequent calculus whose structural rules are indexed by the extracted zones. The paper proves three kinds of results. First, the resulting architectural category is symmetric monoidal. Second, the extracted proof system admits cut elimination. Third, derivations are sound with respect to the licensed categorical diagrams generated by the architectural discipline. The outcome is a theorem-bearing core of the architecture-to-category-to-logic programme: subexponential structure is not postulated in advance but read from categorical data encoding differentiated memory and context behaviour. [a] 1. Introduction The use of category theory in machine learning has progressed well beyond analogy. Compositional accounts of supervised learning and backpropagation show that parametrised learning systems admit categorical semantics in which composition and update can be studied functorially [ 5 ] . More recently, categorical deep learning has been proposed as a broad algebraic language for architectural composition, reparametrisation, and weight sharing [ 6 ] . On the other hand, categorical logic studies how structural features of categories give rise to doctrines, internal languages, and proof systems [ 8 , 9 ] . These two lines suggest a natural question: can one begin from a suitably organized family of neural architectures, pass to a categorical description of their resource behaviour, and then extract an appropriate logic from that categorical structure? The present article develops a first theorem-bearing answer in a resource-sensitive setting. The emphasis is important. Our aim is not to begin with a fully formed logic and then search for a semantics. Instead, we start with a zone-labelled architectural formalism. Some forms of information are reusable, some discardable, some linear, and some coercible from one zone to another. These permissions are encoded categorically. Only after the categorical organization is fixed do we read off a subexponential signature and define the corresponding proof theory. This order of construction can be displayed schematically as \text{architecture family}\longrightarrow\text{categorized architecture}\longrightarrow\text{subexponential signature}\longrightarrow\text{proof theory}. The final step is then to show that the extracted proof system is sound in the original categorized architecture. In this sense the category plays two roles: it is first an abstraction of architectural structure and only afterwards a semantics validating the logic extracted from that structure. For broader background on categorical semantics of linear logic, including the passage from linear structure to categorical models and the treatment of exponentials, see [ 13 , 2 , 7 , 10 ] . The resulting logic is not intended to describe an entire transformer or a complete contemporary learning stack. That would require a richer treatment of nonlinearities, internal homs, and likely a linear–nonlinear adjunction in the sense of Benton [ 4 ] . The goal here is more focused. We isolate the part of the logical discipline already forced by differentiated structural behaviour. This leads naturally to a tensorial fragment with zone-indexed weakening and contraction, that is, to a subexponential proof theory in which structural permissions depend on zones [ 11 , 15 ] . The proof-theoretic stance is therefore deliberately modest but mathematically crisp. The main novelty of the paper is not the mere use of subexponentials. Subexponential proof theory and semantics are by now well established, and recent work has pushed their categorical analysis significantly further [ 12 ] . What is new here is the direction of travel: the subexponential data are not fixed beforehand as logical syntax, but extracted from a categorized resource discipline motivated by architectures with differentiated memory and context. The key theorem is therefore an extraction-and-soundness result rather than a purely semantic one. The contributions of the article are the following. • We define a category \mathbf{Arch}_{Z} of zone-labelled parametrised architectural blocks and prove that it is symmetric monoidal. • We introduce the notion of a coherent zone discipline on \mathbf{Arch}_{Z} , consisting of licensed zone coercions, discards, and diagonals. • From such a disciplined category we extract a subexponential signature \Sigma_{\mathsf{Lic}} and an associated tensorial sequent calculus \mathsf{TZ}_{\Sigma_{\mathsf{Lic}}} . • We prove cut elimination for \mathsf{TZ}_{\Sigma_{\mathsf{Lic}}} . • We prove soundness of \mathsf{TZ}_{\Sigma_{\mathsf{Lic}}} with respect to the class of licensed diagrams generated by the categorized architecture. The article should therefore be read as a foundational first step in the programme \text{neural architecture}\to\text{category}\to\text{logic}, with particular attention to resource-sensitive behaviour. The missing connective is linear implication. We explain below why its absence does not undercut the present contribution: the current theorems already identify the structural fragment of the logic that is forced by the architecture, and that fragment is the one most directly tied to differentiated resource usage. At a high level, the main theorem-bearing content of the paper can be summarized as follows: from a coherently disciplined category of zone-labelled architectural blocks one can canonically reconstruct a subexponential signature, define the associated tensorial proof theory, and interpret every derivation back into the licensed categorical diagrams. Accordingly, the present article should not be read as a logic of all neural architectures, nor as a full logic of transformers, but as a theorem-bearing identification of the structural resource fragment already forced by categorized architectural permissions. The individual results of Sections 2–4 may thus be read as the categorical, syntactic, and semantic components of a single extraction theorem. Section 4 closes with explicit examples, including a two-block neural architecture showing concretely how differentiated input roles induce the extracted substructural discipline. 2. Categorized architectures 2.1. Typed resource contexts and the architectural category We now introduce the categorical object that mediates between architecture and logic. The purpose of this subsection is to extract, from a resource-sensitive architectural description, a category whose objects are zone-labelled typed contexts and whose morphisms are parametrised computational blocks. This construction is the first step in the chain \text{architecture}\;\longrightarrow\;\text{categorisation}\;\longrightarrow\;\text{subexponential discipline}\;\longrightarrow\;\text{proof theory}. At this stage, only the compositional structure of contexts and blocks is relevant. Accordingly, we work over a category with finite products and make no further assumptions. Let \mathbf{Ctx} be a category with finite products, and let Z be a fixed set of zone labels. {defi} [Typed resource context] A typed resource context is a finite list \Gamma=((z_{1},A_{1}),\dots,(z_{n},A_{n})), where each z_{i}\in Z and each A_{i}\in\Ob(\mathbf{Ctx}) . Its carrier is the object [\![\Gamma]\!]:=A_{1}\times\cdots\times A_{n}, with the convention that the carrier of the empty list is the terminal object 1 of \mathbf{Ctx} . The empty context is denoted by \emptyset . If \Gamma=((z_{1},A_{1}),\dots,(z_{n},A_{n}))\quad\text{and}\quad\Delta=((w_{1},B_{1}),\dots,(w_{m},B_{m})), their tensor concatenation is the context \Gamma\otimes\Delta:=((z_{1},A_{1}),\dots,(z_{n},A_{n}),(w_{1},B_{1}),\dots,(w_{m},B_{m})). The notation \Gamma\otimes\Delta is justified by the fact that concatenation of contexts is implemented on carriers by the product operation in \mathbf{Ctx} . Lemma 1 . For all typed resource contexts \Gamma and \Delta , there is a canonical isomorphism \mu_{\Gamma,\Delta}\colon[\![\Gamma\otimes\Delta]\!]\xrightarrow{\cong}[\![\Gamma]\!]\times[\![\Delta]\!]. Proof 2.1 . Write \Gamma=((z_{1},A_{1}),\dots,(z_{n},A_{n})),\qquad\Delta=((w_{1},B_{1}),\dots,(w_{m},B_{m})). By definition, [\![\Gamma\otimes\Delta]\!]=A_{1}\times\cdots\times A_{n}\times B_{1}\times\cdots\times B_{m}, whereas [\![\Gamma]\!]\times[\![\Delta]\!]=(A_{1}\times\cdots\times A_{n})\times(B_{1}\times\cdots\times B_{m}). The universal property of finite products yields a unique morphism \mu_{\Gamma,\Delta}\colon[\![\Gamma\otimes\Delta]\!]\to[\![\Gamma]\!]\times[\![\Delta]\!] whose first component is the tuple of

Read the complete text