Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT’s Capabilities in Generating Metamorphic Relations
Yifan Zhang, Dave Towey*, Matthew Pike, Quang-Hung Luu, Huai Liu, and Tsong Yueh Chen · 2025
Read Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT’s Capabilities in Generating Metamorphic Relations by Yifan Zhang, Dave Towey*, Matthew Pike, Quang-Hung Luu, Huai Liu, and Tsong Yueh Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22141.txt.
Description
Zhang and five colleagues grade how well ChatGPT writes metamorphic relations for software testing in twenty twenty-five. Such relations state how outputs should shift when inputs change in set ways. GPT-4 and GPT-3.5 drafts were scored under old criteria first. A sharper criteria set then graded GPT-4 across nine test systems.
The systems ranged from plain code to AI laden stacks. GPT-4 beat its older sibling on accuracy and use. It kept quality high even on the complex systems. A custom GPT grader was set against human judges. The team sees AI and human skills as partners in testing work.
Catalog record
| CREATOR | Yifan Zhang, Dave Towey*, Matthew Pike, Quang-Hung Luu, Huai Liu, and Tsong Yueh Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-22141