Knowledge Augmented Complex Problem Solving with Large Language Models: A Survey DOI: XXXXXXX.XXXXXXX Journal: JACM Volume: 37 4 111 8

Da Zheng, Lun Du, Junwei Su, Yuchen Tian, Yuqi Zhu, Jintian Zhang, Lanning Wei, Ningyu Zhang, Huajun Chen · 2025

Read Knowledge Augmented Complex Problem Solving with Large Language Models: A Survey DOI: XXXXXXX.XXXXXXX Journal: JACM Volume: 37 4 111 8 by Da Zheng, Lun Du, Junwei Su, Yuchen Tian, Yuqi Zhu, Jintian Zhang, Lanning Wei, Ningyu Zhang, Huajun Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03418.txt.

Description

Da Zheng and eight co-authors survey, in a 2025 preprint, how outside knowledge can help language models solve hard problems. Language models pair raw computing power with a rough form of reasoning. They stumble, though, on tasks needing many steps, deep domain facts, or checked answers. The survey maps the fixes now in use. These include chain-of-thought prompting, ways to fetch or inject knowledge, and tools that verify each step or the final result.

The authors then walk through fields where the problems bite hardest. Software work, math proving, data modeling, and lab science each get a section. Recurring limits include shaky multi-step logic and knowledge that goes stale. Verification stays hard when no ground truth is cheap. The paper closes with future directions grouped by its three themes. It aims to give researchers a shared map of a fast-moving area.

Catalog record

CREATORDa Zheng, Lun Du, Junwei Su, Yuchen Tian, Yuqi Zhu, Jintian Zhang, Lanning Wei, Ningyu Zhang, Huajun Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-03418

Browse the full library · About the Tower of Babel