Decomposing Evolutionary Mixture-of-LoRA Architectures: The Routing Lever, the Lifecycle Penalty, and a Substrate-Conditional Boundary

Ramchand Kumaresan [email protected] · 2026

Read Decomposing Evolutionary Mixture-of-LoRA Architectures: The Routing Lever, the Lifecycle Penalty, and a Substrate-Conditional Boundary by Ramchand Kumaresan [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11153.txt.

Introduction

Ramchand Kumaresan decomposes an evolutionary mixture-of-LoRA system on a from-scratch widened-1536 substrate, about 150 million parameters, into three factors. The factors are a router rewrite, a per-domain leave-one-out evaluation scope, and a lifecycle of death plus alpha-blend inheritance plus SVD mutation plus slot reallocation.

A 5-of-8 partial factorial run at three seeds and 25,000 adaptation steps per cell gives a sharp attribution chain on this substrate. The router rewrite alone carries the entire plus 0.0426 nat balanced log-PPL improvement attributed to the full evolutionary system versus the static B3 baseline, while the headline full-system contrast itself is plus 0.015 nats and does not clear the 0.05 significance level. Mixture-of-experts researchers get a caution: the router, not the lifecycle, drives the gain here.

Catalog record

CREATORRamchand Kumaresan [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE150763
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11153

Browse the full library · About the Tower of Babel