Clinical named entity recognition in the Portuguese language: a benchmark of modern BERT models and LLMs

Vinicius A. de Almeida, Sandro S. da Silva, Josimar Chire, Nícolas H. Borges, [0.4em] Leonardo Vicenzi, Helena Kociolek, Sarah M. de C. Rocha, Frederico N. Gomes, [0.4em] Júlia C. Ferreira, Oge Marques, Lucas E. S. e Oliveira, [0.8em] Spesia, Curitiba - PR, Brazil · 2026

Read Clinical named entity recognition in the Portuguese language: a benchmark of modern BERT models and LLMs by Vinicius A. de Almeida, Sandro S. da Silva, Josimar Chire, Nícolas H. Borges, [0.4em] Leonardo Vicenzi, Helena Kociolek, Sarah M. de C. Rocha, Frederico N. Gomes, [0.4em] Júlia C. Ferreira, Oge Marques, Lucas E. S. e Oliveira, [0.8em] Spesia, Curitiba - PR, Brazil (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26510.txt.

Description

Almeida and co-authors benchmark modern BERT models and large language models for clinical named entity recognition in Portuguese. Clinical notes hold rich facts, but Portuguese test sets for pulling them out are scarce. The team trains BioBERTpt, BERTimbau, ModernBERT, and mmBERT beside models like GPT-5 and Gemini on shared terms. They test split and weighting tricks to ease class imbalance. The mmBERT-base model wins with a micro F1 of 0.76, and careful split methods lift balance and scores further.

Catalog record

CREATORVinicius A. de Almeida, Sandro S. da Silva, Josimar Chire, Nícolas H. Borges, [0.4em] Leonardo Vicenzi, Helena Kociolek, Sarah M. de C. Rocha, Frederico N. Gomes, [0.4em] Júlia C. Ferreira, Oge Marques, Lucas E. S. e Oliveira, [0.8em] Spesia, Curitiba - PR, Brazil
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26591
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26510

Browse the full library · About the Tower of Babel