Knowledge Augmented Complex Problem Solving with Large Language Models: A Survey DOI: XXXXXXX.XXXXXXX Journal: JACM Volume: 37 4 111 8
Da Zheng, Lun Du, Junwei Su, Yuchen Tian, Yuqi Zhu, Jintian Zhang, Lanning Wei, Ningyu Zhang, Huajun Chen · 2025
Read Knowledge Augmented Complex Problem Solving with Large Language Models: A Survey DOI: XXXXXXX.XXXXXXX Journal: JACM Volume: 37 4 111 8 by Da Zheng, Lun Du, Junwei Su, Yuchen Tian, Yuqi Zhu, Jintian Zhang, Lanning Wei, Ningyu Zhang, Huajun Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03418.txt.
Description
Da Zheng and eight co-authors survey, in a 2025 preprint, how outside knowledge can help language models solve hard problems. Language models pair raw computing power with a rough form of reasoning. They stumble, though, on tasks needing many steps, deep domain facts, or checked answers. The survey maps the fixes now in use. These include chain-of-thought prompting, ways to fetch or inject knowledge, and tools that verify each step or the final result.
The authors then walk through fields where the problems bite hardest. Software work, math proving, data modeling, and lab science each get a section. Recurring limits include shaky multi-step logic and knowledge that goes stale. Verification stays hard when no ground truth is cheap. The paper closes with future directions grouped by its three themes. It aims to give researchers a shared map of a fast-moving area.
Catalog record
| CREATOR | Da Zheng, Lun Du, Junwei Su, Yuchen Tian, Yuqi Zhu, Jintian Zhang, Lanning Wei, Ningyu Zhang, Huajun Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-03418