The LLM Data Auditor A Metric-oriented Survey on Quality and Trustworthiness in Evaluating Synthetic Data

Kaituo Zhang, Mingzhi Hu, Hoang Anh Duy Le, Fariha Kabir Torsha, Zhimeng Jiang, Minh Khai Bui, Chia-Yuan Chang, Yu-Neng Chuang, Zhen Xiong, Ying Lin, Guanchu Wang, Na Zou · 2026

Read The LLM Data Auditor A Metric-oriented Survey on Quality and Trustworthiness in Evaluating Synthetic Data by Kaituo Zhang, Mingzhi Hu, Hoang Anh Duy Le, Fariha Kabir Torsha, Zhimeng Jiang, Minh Khai Bui, Chia-Yuan Chang, Yu-Neng Chuang, Zhen Xiong, Ying Lin, Guanchu Wang, Na Zou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17717.txt.

Introduction

Kaituo Zhang and eleven co-authors survey how to judge synthetic data made for large language models. The 2026 preprint takes a metric-based view of two questions. First, is the data good enough to train on? Second, can the data and its scores be trusted? The survey sorts the measures in use and compares what each one can and cannot show.

Catalog record

CREATORKaituo Zhang, Mingzhi Hu, Hoang Anh Duy Le, Fariha Kabir Torsha, Zhimeng Jiang, Minh Khai Bui, Chia-Yuan Chang, Yu-Neng Chuang, Zhen Xiong, Ying Lin, Guanchu Wang, Na Zou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE252 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17717

Browse the full library · About the Tower of Babel