Omni-DNA: A Unified Genomic Foundation Model for Cross-Modal and Multi-Task Learning

Zehui Li, Vallijah Subasri, Yifei Shen, Dongsheng Li, Yiren Zhao, Guy-Bart Stan, Caihua Shan · 2025

Read Omni-DNA: A Unified Genomic Foundation Model for Cross-Modal and Multi-Task Learning by Zehui Li, Vallijah Subasri, Yifei Shen, Dongsheng Li, Yiren Zhao, Guy-Bart Stan, Caihua Shan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03499.txt.

Description

Zehui Li and co-authors build one genomic model that handles many tasks at once in a 2025 paper. Language models generalize broadly, but genomic foundation models still need separate tuning per task. Their rigid outputs narrow their use further. The team's model, Omni-DNA, returns to the plain autoregressive transformer design.

Training runs in two stages. First the model learns DNA by predicting each next token. Then special task tokens are added, and many downstream tasks are tuned together. Sizes range from twenty million to one billion parameters. On two standard benchmark suites, Omni-DNA took top scores on eighteen of twenty-six tasks. One tuning run handled ten chemical-mark tasks at once, beating singly trained rivals. Two new tasks map DNA to written function notes and to images. The authors release all models openly.

Catalog record

CREATORZehui Li, Vallijah Subasri, Yifei Shen, Dongsheng Li, Yiren Zhao, Guy-Bart Stan, Caihua Shan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-03499

Browse the full library · About the Tower of Babel