Decomposing Evolutionary Mixture-of-LoRA Architectures: The Routing Lever, the Lifecycle Penalty, and a Substrate-Conditional Boundary
Ramchand Kumaresan [email protected] · 2026
Read Decomposing Evolutionary Mixture-of-LoRA Architectures: The Routing Lever, the Lifecycle Penalty, and a Substrate-Conditional Boundary by Ramchand Kumaresan [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11153.txt.
Introduction
Ramchand Kumaresan decomposes an evolutionary mixture-of-LoRA system on a from-scratch widened-1536 substrate, about 150 million parameters, into three factors. The factors are a router rewrite, a per-domain leave-one-out evaluation scope, and a lifecycle of death plus alpha-blend inheritance plus SVD mutation plus slot reallocation.
A 5-of-8 partial factorial run at three seeds and 25,000 adaptation steps per cell gives a sharp attribution chain on this substrate. The router rewrite alone carries the entire plus 0.0426 nat balanced log-PPL improvement attributed to the full evolutionary system versus the static B3 baseline, while the headline full-system contrast itself is plus 0.015 nats and does not clear the 0.05 significance level. Mixture-of-experts researchers get a caution: the router, not the lifecycle, drives the gain here.
Catalog record
| CREATOR | Ramchand Kumaresan [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 150763 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11153