ELMES: An Automated Framework for Evaluating Large Language Models in Educational Scenarios
Shou’ang Wei, Xinyun Wang, Shuzhen Bi, Jian Chen, Ruijia Li, Bo Jiang, Xin Lin, Min Zhang, Yu Song, BingDong Li, Aimin Zhou, Hao Hao · 2025
Read ELMES: An Automated Framework for Evaluating Large Language Models in Educational Scenarios by Shou’ang Wei, Xinyun Wang, Shuzhen Bi, Jian Chen, Ruijia Li, Bo Jiang, Xin Lin, Min Zhang, Yu Song, BingDong Li, Aimin Zhou, Hao Hao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22947.txt.
Description
Shou'ang Wei and co-authors introduce a tool to test large language models in school settings, in a 2025 paper. School uses for these models are growing fast, but tests vary by scene and many new scenes have no fit test at all. Most current tests check general skill, not teaching skill.
Their open tool, ELMES, lets users build multi agent talks from simple setup files, with no deep coding needed. A mixed engine scores teaching traits that are hard to judge, using a model as judge. Tests in four school scenes, from explaining ideas to making lesson plans, showed unlike strengths across models. The tool gives schools a shared way to compare models.
Catalog record
| CREATOR | Shou’ang Wei, Xinyun Wang, Shuzhen Bi, Jian Chen, Ruijia Li, Bo Jiang, Xin Lin, Min Zhang, Yu Song, BingDong Li, Aimin Zhou, Hao Hao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-22947