Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs
Guangyu Feng, Huanzhi Mao, Prabal Dutta, Joseph E. Gonzalez · 2026
Read Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs by Guangyu Feng, Huanzhi Mao, Prabal Dutta, Joseph E. Gonzalez (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15077.txt.
Description
Guangyu Feng and three others offer AsyncFC, a run-time layer that frees language-model decoding from waiting on tool calls. Synchronous function calling blocks decoding until each call ends, inflating latency. AsyncFC mixes decoding with run time and runs solo calls side by side, layering over existing models and untouched functions with no fine-tuning. On coding tasks it reaches 1.4 times end-to-end speedup at unchanged accuracy, revealing native reasoning over symbolic futures.
Catalog record
| CREATOR | Guangyu Feng, Huanzhi Mao, Prabal Dutta, Joseph E. Gonzalez |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51518 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15077