ScrapeGraphAI-100k: A Large-Scale Dataset for LLM-Based Web Information Extraction

William Brach, Francesco Zuppichini, Marco Vinciguerra, Lorenzo Padoan · 2026

Read ScrapeGraphAI-100k: A Large-Scale Dataset for LLM-Based Web Information Extraction by William Brach, Francesco Zuppichini, Marco Vinciguerra, Lorenzo Padoan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15189.txt.

Description

Brach and colleagues offer ScrapeGraphAI-100k, a data set for schema-constrained generation. Fitting output to a given JSON schema powers tool use, extraction, and knowledge base building. Yet public data sets stay small, synthetic, or text-only, rarely pairing real pages with real prompts and schemas. This corpus offers 93695 schema-constrained events from opt-in telemetry in mid-2025. It was deduped and evened by schema from 9 million events.

The corpus spans 18000 schemas across 15 named languages plus a long-tail Other group. English and Traditional Chinese make 88 percent of found content. Each instance pairs Markdown pages with a prompt, schema, response, and structural conformance labels. The team maps diversity of structure and finds sharp failure thresholds as complexity grows. As a case study, a small student fine-tuned on this data tracks its GPT-5-nano teacher. It still trails a 30-billion-size model with about 3 billion active weights.

Catalog record

CREATORWilliam Brach, Francesco Zuppichini, Marco Vinciguerra, Lorenzo Padoan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-15189

Browse the full library · About the Tower of Babel