ScrapeGraphAI-100k: A Large-Scale Dataset for LLM-Based Web Information Extraction
William Brach, Francesco Zuppichini, Marco Vinciguerra, Lorenzo Padoan · 2026
Read ScrapeGraphAI-100k: A Large-Scale Dataset for LLM-Based Web Information Extraction by William Brach, Francesco Zuppichini, Marco Vinciguerra, Lorenzo Padoan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15189.txt.
Description
Brach and colleagues offer ScrapeGraphAI-100k, a data set for schema-constrained generation. Fitting output to a given JSON schema powers tool use, extraction, and knowledge base building. Yet public data sets stay small, synthetic, or text-only, rarely pairing real pages with real prompts and schemas. This corpus offers 93695 schema-constrained events from opt-in telemetry in mid-2025. It was deduped and evened by schema from 9 million events.
The corpus spans 18000 schemas across 15 named languages plus a long-tail Other group. English and Traditional Chinese make 88 percent of found content. Each instance pairs Markdown pages with a prompt, schema, response, and structural conformance labels. The team maps diversity of structure and finds sharp failure thresholds as complexity grows. As a case study, a small student fine-tuned on this data tracks its GPT-5-nano teacher. It still trails a 30-billion-size model with about 3 billion active weights.
Catalog record
| CREATOR | William Brach, Francesco Zuppichini, Marco Vinciguerra, Lorenzo Padoan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-15189