Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs

Guangyu Feng, Huanzhi Mao, Prabal Dutta, Joseph E. Gonzalez · 2026

Read Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs by Guangyu Feng, Huanzhi Mao, Prabal Dutta, Joseph E. Gonzalez (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15077.txt.

Description

Guangyu Feng and three others offer AsyncFC, a run-time layer that frees language-model decoding from waiting on tool calls. Synchronous function calling blocks decoding until each call ends, inflating latency. AsyncFC mixes decoding with run time and runs solo calls side by side, layering over existing models and untouched functions with no fine-tuning. On coding tasks it reaches 1.4 times end-to-end speedup at unchanged accuracy, revealing native reasoning over symbolic futures.

Catalog record

CREATORGuangyu Feng, Huanzhi Mao, Prabal Dutta, Joseph E. Gonzalez
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51518
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15077

Browse the full library · About the Tower of Babel