Optimizing large language models for ontology-based annotation: a study on gene ontology in biomedical texts

Pratik Devkota, Somya D Mohanty, Prashanti Manda · 2025

Read Optimizing large language models for ontology-based annotation: a study on gene ontology in biomedical texts by Pratik Devkota, Somya D Mohanty, Prashanti Manda (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12781589.txt.

Description

Pratik Devkota, Somya Mohanty, and Prashanti Manda present a 2025 study on using large language models to tag biomedical papers with Gene Ontology terms. Accurate tagging powers search and knowledge linking in biology, but older neural models struggle with complex terms. The team fine-tuned four language models on a curated corpus and compared them with a recurrent network baseline on accuracy, meaning-level agreement, memory use, and speed.

The older baseline stayed competitive on raw accuracy. The language models sometimes produced tags that matched the intended meaning better, especially for long multi-word terms, though the edge was not uniform. They also demanded far more computing resources. Tricks like training only small adapter weights cut the cost while keeping performance. The authors conclude deployment is a trade: richer tagging against heavier machinery. They call for more domain training and optimization before routine use.

Catalog record

CREATORPratik Devkota, Somya D Mohanty, Prashanti Manda
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12781589

Browse the full library · About the Tower of Babel