CompactPrompt: A Unified Pipeline for Prompt and Data Compression in LLM Workflows DOI: XXXXXXX.XXXXXXX Conference: The 2nd Workshop on LLMs and Generative AI for Finance, November 15, Singapore; November 15; Singapore
Joong Ho Choi, Jiayang Zhao, Jeel Shah, Ritvika Sonawane, Vedant Singh, Avani Appalla, Will Flanagan, Filipe Condessa · 2025
Read CompactPrompt: A Unified Pipeline for Prompt and Data Compression in LLM Workflows DOI: XXXXXXX.XXXXXXX Conference: The 2nd Workshop on LLMs and Generative AI for Finance, November 15, Singapore; November 15; Singapore by Joong Ho Choi, Jiayang Zhao, Jeel Shah, Ritvika Sonawane, Vedant Singh, Avani Appalla, Will Flanagan, Filipe Condessa (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18043.txt.
Description
Joong Ho Choi, with seven co-authors, shrinks the prompts and files that agent workflows feed to language models. Long chained prompts and rich data streams make such work slow and costly. CompactPrompt cuts low-value tokens from prompts and groups linked phrases so meaning survives the trim.
Attached documents are compressed in parallel, with repeated patterns shortened and numeric columns quantized. On finance question benchmarks, total token use fell by up to about three fifths, while answer quality dipped only slightly for the strong models tested. Teams running agents at scale get a pipeline that lowers bills without gutting results.
Catalog record
| CREATOR | Joong Ho Choi, Jiayang Zhao, Jeel Shah, Ritvika Sonawane, Vedant Singh, Avani Appalla, Will Flanagan, Filipe Condessa |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18043