Introducing TrGLUE and SentiTurca: A Comprehensive Benchmark for Turkish General Language Understanding and Sentiment Analysis

Duygu Altinok · 2025

Read Introducing TrGLUE and SentiTurca: A Comprehensive Benchmark for Turkish General Language Understanding and Sentiment Analysis by Duygu Altinok (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22100.txt.

Introduction

Duygu Altinok introduces TrGLUE, a benchmark for testing how well language models understand Turkish. English has long had the GLUE benchmark, and Chinese, French, and Japanese have versions of their own, but Turkish had none. Alongside TrGLUE, Altinok presents SentiTurca, a companion benchmark devoted to sentiment analysis, plus code for fine-tuning and scoring transformer models.

TrGLUE is built from Turkish-native texts rather than translations, so the test material sounds natural. Its labels come from a semi-automated pipeline that combines annotation by strong language models, agreement checks across models, and final human validation. The design aims to give Turkish language research a shared, reproducible yardstick and a worked example of building quality datasets with partial automation.

Catalog record

CREATORDuygu Altinok
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE168 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-22100

Browse the full library · About the Tower of Babel