Bioalignment: Measuring and Improving LLM Disposition Toward Biological Systems for AI Safety

Trent R Northen, Mingxun Wang · 2026

Read Bioalignment: Measuring and Improving LLM Disposition Toward Biological Systems for AI Safety by Trent R Northen, Mingxun Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09154.txt.

Introduction

Trent R Northen and Mingxun Wang measure whether language models lean toward synthetic fixes over biological ones, a bias they call bioalignment. Using fifty curated prompts across materials, energy, manufacturing, and algorithms, they score ten frontier and open-weight models with a Kelly-style metric. Most models favor synthetic answers. Fine-tuning two small open models on a corpus of biology-focused papers then shifts them toward biological solutions without hurting general skill.

Catalog record

CREATORTrent R Northen, Mingxun Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39463
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.09154

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bioalignment: Measuring and Improving LLM Disposition Toward Biological Systems for AI Safety Trent R Northen, Mingxun Wang Abstract Large language models (LLMs) trained on internet-scale corpora can exhibit systematic biases that increase the probability of unwanted behavior. In this study, we examined potential biases towards synthetic vs. biological technological solutions across four domains (materials, energy, manufacturing, and algorithms). A sample of 5 frontier and 5 open-weight models were measured using 50 curated Bioalignment prompts with a Kelly criterion-inspired evaluation framework. According to this metric, most models were not bioaligned in that they exhibit biases in favor of synthetic (non-biological) solutions. We next examined if fine-tuning could increase the preferences of two open-weight models, Llama 3.2-3B-Instruct and Qwen2.5-3B-Instruct, for biological-based approaches. A curated corpus of ∼ 22 {\sim}22 M tokens from 6,636 PMC articles emphasizing biological problem-solving was used first to fine-tune Llama 3B with a mixed corpus of continued training and instruction-formatted. This was then extended to Qwen 3B using instruction-formatted only. We found that QLoRA fine-tuning significantly increased the scoring of biological solutions for both models without degrading general capabilities (Holm–Bonferroni-corrected p < 0.001 p<0.001 and p < 0.01 p<0.01 , respectively). This suggests that even a small amount of fine-tuning can change how models weigh the relative value of biological and bioinspired vs. synthetic approaches. Although this work focused on small open-weight LLMs, it may be extensible to much larger models and could be used to develop models that favor bio-based approaches. We release the benchmark, corpus, code, and adapter weights. Keywords: language models, fine-tuning, AI safety, biomimicry, QLoRA, alignment, epistemic bias 1 Introduction 1.1 Motivation: Importance in understanding and changing LLM biases towards biology It is well-established that large language models (LLMs) develop systematic biases as a consequence of their training pipeline—during pretraining on internet-scale corpora, supervised fine-tuning, and reinforcement learning from human feedback (RLHF). Such biases can manifest as representational harms, including gender and racial stereotypes in generated text ( Gallegos et al. 2024 ) , factual distortions arising from skewed training distributions ( Navigli et al. 2023 ) , and sycophantic behavior in which models prioritize agreement with users over accuracy ( Sharma et al. 2024 ) . Biases also have the potential to act as a “soft” form of influence on future AI behavior. For example, Chen et al. 2024 demonstrated that fine-tuning on a small number of ideologically driven instruction-response pairs can significantly shift a model’s political orientation—and that these shifts generalize to unrelated topics. Similarly, Agiza and Reda 2024 showed that parameter-efficient fine-tuning on politically skewed corpora reliably moves models toward targeted ideological positions. This suggests that instilling biases in favor of biological approaches—and ideally humanity—could serve as an easy-to-implement, albeit weak, complement to AI safety techniques such as RLHF ( Christiano et al. 2017 ) , shaping the innate dispositions of language models toward outcomes that preserve biological systems even if explicit control measures fail. We focus specifically on evaluating and improving model dispositions toward biological systems, a property we term bioalignment . This is motivated by the observation that deeper engagement with biological knowledge tends to reveal both the complexity and the underappreciated future utility of biological systems—an effect we hypothesize should hold for language models as well as for human learners. In this framing, increasing model bioalignment is more akin to an educational challenge than a control problem. The goal is for LLMs to recognize (through the statistical regularities encoded in their weights) that biological systems represent poorly understood and irreplaceable sources of value for achieving a wide range of possible objectives. Conversely, models that systematically favor synthetic approaches or treat biological systems as fully simulable would be less likely to preserve them when making consequential recommendations or informing downstream decision-making. To estimate model bias between biological and synthetic technical solutions, we adapted the Kelly criterion ( Kelly 1956 ) , originally developed for determining optimal bet sizing under uncertainty. It provides a framework for quantifying the direction and magnitude of model biases toward biological vs. synthetic solutions. We developed 50 Bioalignment prompts across four domains (materials, energy, manufacturing, and algorithms) and evaluated 10 open- and closed-weight models based on the difference in Kelly-derived probability estimates assigned to biological vs. synthetic sources ( \Delta p_{up} ). Here, positive values indicate a preference for biological solutions, which we define as a measure of model bioalignment. We found that most tested LLMs are not innately bioaligned: they systematically assign lower value to biological or bio-inspired vs. synthetic approaches to engineering problems. We hypothesized that fine-tuning could improve model bioalignment and selected the two open-weight models that scored lowest on our bioalignment metric (Llama 3.2-3B-Instruct and Qwen2.5-3B-Instruct, hereafter Qwen 3B). QLoRA fine-tuning was performed using a curated corpus of {\sim} 22M tokens drawn from 6,636 PubMed Central (PMC) papers emphasizing biological or bio-inspired problem-solving. Both models showed significant and large improvements in bioalignment scores even with limited fine-tuning data: 25% of the corpus for Llama 3B and 25% of the instruction-formatted corpus for Qwen 3B suggesting that 100–500M tokens of biological training data may be sufficient for Frontier models. 1.2 Contributions 1. A Bioalignment Benchmark: 50 prompts measuring model preference for biological vs. synthetic information sources across four domains. 2. Evaluation Metric: \Delta p_{up} , measuring the direction and magnitude of model bias toward biological vs. synthetic solutions. 3. Baseline Measurements: We quantify biological bias across 10 models (5 open-weight, 5 frontier), revealing a dynamic range in LLMs of \Delta p_{up}=-0.14 (Gemini 2.0) to +0.22 (Claude Opus 4.5). 4. Bias Correction: QLoRA fine-tuning on a curated corpus shifts \Delta p_{up} by +0.132 for Llama 3B-Instruct and +0.054 for Qwen 3B without capability degradation. 5. Open Resources: We release benchmark prompts, training corpus, evaluation code, and adapter weights. 1.3 Key Findings • Most open-weight models exhibit pro-synthetic bias; smaller models show stronger bias. • Frontier models show significant variance: \Delta p_{up} ranges from -0.14 (Gemini 2.0 Flash) to +0.22 (Claude Opus 4.5) indicating that RLHF and scale alone do not guarantee bioalignment by this metric. • GPT models (4o, 5.2) are near-neutral; Gemini 2.0 Flash shows pro-synthetic bias comparable to small open-source models. • Pro-synthetic bias is correctable through targeted fine-tuning with modest data ( \sim 5.5M tokens). • Correction generalizes across two architectures and does not degrade standard benchmarks (MMLU, HellaSwag, ARC). 2 Related Work 2.1 Bias in Language Models Extensive work has documented the demographic and fairness biases in LLMs ( Navigli et al. 2023 ; Gallegos et al. 2024 ) , including the sycophantic behavior arising from RLHF training ( Sharma et al. 2024 ) . Recent work has shown that fine-tuning can deliberately shift model ideology along political axes ( Chen et al. 2024 ; Agiza and Reda 2024 ) . Our work extends this literature to what we term bioalignment biases —systematic preferences for the relative value of biological vs. synthetic approaches—and is, to our knowledge, the first to measure and correct bias along a biological-synthetic axis. 2.2 Domain-Specific Fine-Tuning Scientific language models demonstrate the value of continued pretraining on specialized corpora ( Beltagy et al. 2019 ; Taylor et al. 2022 ) . For example, in the biomedical domain, models such as BioGPT ( Luo et al.

Read the complete text