STeCa: Step-level Trajectory Calibration for LLM Agent Learning

Hanlin Wang, Jian Wang, Chak Tou Leong, Wenjie LiDepartment of Computing, The Hong Kong Polytechnic University {hanlin-henry.wang,chak-tou.leong}@[email protected] [email protected] · 2025

Read STeCa: Step-level Trajectory Calibration for LLM Agent Learning by Hanlin Wang, Jian Wang, Chak Tou Leong, Wenjie LiDepartment of Computing, The Hong Kong Polytechnic University {hanlin-henry.wang,chak-tou.leong}@[email protected] [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14276.txt.

Description

Hanlin Wang and co-authors present STeCa in a 2025 paper on training language-model agents. Such agents act step by step in a live setting, but on long tasks one weak choice can pull the whole run off course.

STeCa fixes drift at the step where it starts. During exploration, it scores each action and flags the weak ones by comparing step-level rewards. A model then reflects on the flagged steps and writes better paths, which become training data next to the clean successful runs. Tests showed STeCa beat rival training methods by a clear margin. The lesson is that quick, small corrections teach agents more than end-of-task feedback alone.

Catalog record

CREATORHanlin Wang, Jian Wang, Chak Tou Leong, Wenjie LiDepartment of Computing, The Hong Kong Polytechnic University {hanlin-henry.wang,chak-tou.leong}@[email protected] [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14276

Browse the full library · About the Tower of Babel