Human-Centered Evaluation of an LLM-Based Process Modeling Copilot: A Mixed-Methods Study with Domain Experts DOI: XXXXXXX.XXXXXXX Conference: conference on Human Factors in Computing Systems ; April 13–17, 2026; Barcelona, ES ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Human computer interaction (HCI)-Empirical studies in HCI CCS: Human-centered computing Human computer interaction (HCI) Interactive systems and tools

Chantale Lauer, Peter Pfeiffer, Nijat Mehdiyev · 2026

Read Human-Centered Evaluation of an LLM-Based Process Modeling Copilot: A Mixed-Methods Study with Domain Experts DOI: XXXXXXX.XXXXXXX Conference: conference on Human Factors in Computing Systems ; April 13–17, 2026; Barcelona, ES ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Human computer interaction (HCI)-Empirical studies in HCI CCS: Human-centered computing Human computer interaction (HCI) Interactive systems and tools by Chantale Lauer, Peter Pfeiffer, Nijat Mehdiyev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12895.txt.

Description

Chantale Lauer and co-authors evaluate a language model copilot for business process modeling with domain experts. Automated checks cover syntax and meaning, yet miss trust, usability, and fit with practice. Five experts tested the BPMN copilot in focus groups and questionnaires. Usability scored as acceptable, while trust ran notably lower. Reliability was the top concern among the group. Output quality and prompting proved hard, and experts wanted deeper clarifying questions from the tool.

Catalog record

CREATORChantale Lauer, Peter Pfeiffer, Nijat Mehdiyev
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32907
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.12895

Browse the full library · About the Tower of Babel