Evaluation of Finetuned Large Language Models in Abstract Meaning Representation Parsing

Ho Shu Han · 2025

Read Evaluation of Finetuned Large Language Models in Abstract Meaning Representation Parsing by Ho Shu Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05028.txt.

Description

Shu Han Ho, writing alone in 2025, evaluates fine-tuned large language models for semantic parsing in a 2025 paper. Abstract Meaning Representation encodes sentence meaning as a rooted graph, with nodes for concepts and edges for relations. Fine-tuning decoder-only language models is a promisingly simple route to building such graphs.

Ho fine-tuned four architectures, Phi, Gemma, LLaMA, and a DeepSeek-distilled model, and tested them on the standard AMR 3.0 benchmark. Straightforward fine-tuning reached performance comparable to complex state-of-the-art systems. Simple methods matching elaborate pipelines would lower the barrier to semantic parsing.

Catalog record

CREATORHo Shu Han
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-05028

Browse the full library · About the Tower of Babel