From customer survey feedback to software improvements: Leveraging the full potential of data 2023 From customer survey feedback to software improvements: Leveraging the full potential of data – References
Erik Bertram, Nina Hollender, Sebastian Juhl, Sandra Loop, Martin Schrepp · 2025
Read From customer survey feedback to software improvements: Leveraging the full potential of data 2023 From customer survey feedback to software improvements: Leveraging the full potential of data – References by Erik Bertram, Nina Hollender, Sebastian Juhl, Sandra Loop, Martin Schrepp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-10064.txt.
Introduction
Erik Bertram and 4 co-authors lay out a working routine in 2025 for turning customer survey answers into actual software changes inside a large company. Feedback piles up in every big software firm, yet the hard part is rarely collecting it: drawing the right conclusion and feeding it into development is where value leaks away. Their end-to-end account covers choosing metrics, gathering responses from end users, and testing them with inferential statistics.
Transparency comes next, through a prototype experience dashboard that shows stakeholders the findings in a form they can act on. The authors close the loop by describing how results were pushed into decisions that changed the product. For product teams drowning in survey exports, the paper offers a tested plumbing diagram rather than another plea to listen.
Catalog record
| CREATOR | Erik Bertram, Nina Hollender, Sebastian Juhl, Sandra Loop, Martin Schrepp |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-10064
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From customer survey feedback to software improvements: Leveraging the full potential of data 2023 From customer survey feedback to software improvements: Leveraging the full potential of data – References Erik Bertram, Nina Hollender, Sebastian Juhl, Sandra Loop, Martin Schrepp Abstract Converting customer survey feedback data into usable insights has always been a great challenge for large software enterprises. Despite the improvements on this field, a major obstacle often remains when drawing the right conclusions out of the data and channeling them into the software development process. In this paper we present a practical end-to-end approach of how to extract useful information out of a data set and leverage the information to drive change. We describe how to choose the right metrics to measure, gather appropriate feedback from customer end-users, analyze the data by leveraging methods from inferential statistics, make the data transparent, and finally drive change with the results. Furthermore, we present an example of a UX prototype dashboard that can be used to communicate the analyses to stakeholders within the company. 1 Introduction ‘‘What gets measured gets managed’’ is a frequently cited quote that, however, is incorrectly attributed to the famous Austrian American management consultant Peter Drucker. 1 1 1 The quote originated from the columnist Simon Caulkin who summarized an argument in a paper by Ridgway 1956 . While this quote originated from a direct critique of the narrow and lopsided utilization of performance measures in a business context, the importance of quantitative metrics for companies, especially large and globally acting software enterprises, is growing ( Bauer 2004 ; Morgan & Rego 2006 ; Van Looy & Shafagatova 2016 , see e.g.,) . As such, one of their main targets is to increase the adoption of cloud services ( Shimba 2010 ) and to keep a stable customer base to drive revenue. To do so, every software company is eager to continuously improve the experience of their cloud product portfolio and deliver the world’s best software to customers. Furthermore, in today’s competitive markets, user experience (UX) quality is a pre-requisite for the long-term success of products ( Sward & Macarthur 2007 ; Ross 2014 , see e.g.,) . Over time, competing products become more and more similar in terms of their functionality. For products with great UX, the experience becomes part of their brand, and therefore it is important to constantly measure the UX quality of products. Furthermore, previous studies have revealed the role of change management and its impact on business processes and employees ( Mento et al. 2002 ; By 2005 ; Kettinger & Grover 1995 ; Hiatt & Creasey 2003 ; Schöllhorn et al. 2019 , see e.g.,) . However, companies face some notable challenges. For example, channeling end-users feedback into the software development process in an agile manner remains a big problem. Furthermore, it is often unclear how the gap between survey feedback and business insights can be overcome, and how these insights can be leveraged for continuous code improvements. In this article, we aim to present a general and scalable end-to-end process and describe how companies can gather high-quality product feedback from end-users, analyze existing data with statistical methods, draw reliable conclusions, and finally feed this information into the development process. We will only use simulated data to illustrate our approach, as well as dummy products that we name Product A to Product F, for simplicity. All surveys presented below are publicly available on the internet and a common standard in many software enterprises ( Laugwitz et al. 2006 ; Schrepp & Thomaschewski 2019 ; Fisher & Kordupleski 2019 ; Lewis et al. 2013 , see e.g.,) . The article itself targets decision makers as well as developers, designers, and managers. In general, we believe that establishing a smooth end-to-end process always requires a similar strategy, which we would like to sketch out on the following pages. The readers might feel free to adapt one or the other idea for their own purpose as well. 2 Listening to customer end-users In the following, we describe several requirements and challenges that a company might face when listening to customer end-users with the help of surveys, including how to decide on appropriate survey items. 2.1 Using standardized questionnaires to measure UX If we want to measure the user experience of a product quantitatively, we need to develop a clear understanding of what this term means semantically. The ISO 9241-210 norm ( ISO 2019 ) defines UX as a “[…] person’s perceptions and responses that result from the use or anticipated use of a product, system, or service.” This definition entails two important aspects. First, UX is a subjective perception of users concerning a product. Therefore, we must ask users, and different users might express different opinions. Such differences can, for example, result from personal preferences or diverse levels of expertise with a product. Thus, it is important to collect feedback from larger user samples to adequately cover the spectrum of different opinions. Second, UX covers a wide range of different impressions. It does not only include quality aspects associated to working on typical tasks with the product (e.g., efficiency, controllability, or learnability), but also aspects like fun of use, or the aesthetic appeal of the user interface ( Schrepp 2021 ; Hinderks et al. 2021 , see e.g.,) . For many years now, the UX discipline has developed several techniques to collect feedback from users. However, only a few options exist to measure the UX quantitatively. Online surveys are a very efficient tool to do so, since they allow collecting feedback from large user groups with low effort and costs. To get high-quality data, one needs to ensure that the measurement method fulfills common quality criteria, such as, e.g., objectivity, reliability, and validity. However, this is difficult to achieve if the questions are defined to calculate a UX score from the answers ad hoc. Nevertheless, there are many standardized UX questionnaires available that are carefully constructed, validated, and described in scientific publications ( Schrepp 2021 , see, e.g.,) . 2.2 Choosing the correct UX questionnaires As explained above, UX is a heterogeneous concept and there are many questionnaires available that measure various aspects of UX. Hence, the first challenge is to decide which questionnaires to use. In general, we should measure those metrics that are most important for our users and that relate to common business goals ( Dalrymple et al. 2021 ; Sauro 2016 ) . In addition, it is important to limit the number of questions as much as possible to reduce the drop-out rate, since long surveys can cause frustration on the end-user side. As an example, we will discuss the selection of metrics to evaluate a product portfolio below. Business applications are used for professional work. Typical users include, for example, developers of cloud applications, administrators, analysts, decision-makers, sales representatives, or accountants. For those users, both usability and usefulness are of high importance, which is why we need to ensure that those metrics are measured adequately. Therefore, the UX-LITE questionnaire is a natural choice, which consists of two questions, as shown in Figure 1 . Figure 1: The two questions of the UX-LITE questionnaire range on a five-point ordinal scale and