Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT’s Capabilities in Generating Metamorphic Relations

Yifan Zhang, Dave Towey*, Matthew Pike, Quang-Hung Luu, Huai Liu, and Tsong Yueh Chen · 2025

Read Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT’s Capabilities in Generating Metamorphic Relations by Yifan Zhang, Dave Towey*, Matthew Pike, Quang-Hung Luu, Huai Liu, and Tsong Yueh Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22141.txt.

Description

Zhang and five colleagues grade how well ChatGPT writes metamorphic relations for software testing in twenty twenty-five. Such relations state how outputs should shift when inputs change in set ways. GPT-4 and GPT-3.5 drafts were scored under old criteria first. A sharper criteria set then graded GPT-4 across nine test systems.

The systems ranged from plain code to AI laden stacks. GPT-4 beat its older sibling on accuracy and use. It kept quality high even on the complex systems. A custom GPT grader was set against human judges. The team sees AI and human skills as partners in testing work.

Catalog record

CREATORYifan Zhang, Dave Towey*, Matthew Pike, Quang-Hung Luu, Huai Liu, and Tsong Yueh Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22141

Browse the full library · About the Tower of Babel