PEA: Enhancing LLM Performance on Computational-Reasoning Tasks

Zi Wang, Shiwei Weng, Mohannad Alhanahnah, Somesh Jha, Tom Reps · 2025

Read PEA: Enhancing LLM Performance on Computational-Reasoning Tasks by Zi Wang, Shiwei Weng, Mohannad Alhanahnah, Somesh Jha, Tom Reps (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10938.txt.

Description

Zi Wang, Shiwei Weng, Mohannad Alhanahnah, and a wider team wrote this machine learning paper, published in 2025. It gives language models a formal workbench for problems that need real computation, splitting each task into predicates to state, possibilities to enumerate, and results to aggregate.

Models are fluent but sloppy at exact reasoning. The framework, called PEA, has the model write programs instead of answers. Given rules for what counts as a solution, how to enumerate candidates, and how to combine them, it synthesizes code that is then simply run. Benchmarks covered logic satisfiability, the game of 24, and planning puzzles. Accuracy jumped by about fifty percent on average over the bare models, with better efficiency too. The authors argue that knowing the shape of a reasoning task, formally, is what turns a chatbot into a reliable solver.

Catalog record

CREATORZi Wang, Shiwei Weng, Mohannad Alhanahnah, Somesh Jha, Tom Reps
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10938

Browse the full library · About the Tower of Babel