A Comprehensive Framework for Statistical Inference in Measurement System Assessment Studies
Banafsheh Lashkari and Shojaeddin Chenouri · 2025
Read A Comprehensive Framework for Statistical Inference in Measurement System Assessment Studies by Banafsheh Lashkari and Shojaeddin Chenouri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18037.txt.
Introduction
Banafsheh Lashkari and Shojaeddin Chenouri built a full framework for judging measurement systems in 2025. Measurement system analysis asks how much of the spread in data comes from the measuring process itself, rather than from the things measured. Sound answers guide quality work in labs and factories.
Past methods cover single-variable cases well, but their statistical traits were never mapped in a systematic way. The authors study estimators for variance parts and other key values in depth. They examine how reliable those estimators are, how they perform, and where they apply. The aim is new insight that helps users trust and choose methods for measurement checks.
Catalog record
| CREATOR | Banafsheh Lashkari and Shojaeddin Chenouri |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18037
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Comprehensive Framework for Statistical Inference in Measurement System Assessment Studies Banafsheh Lashkari and Shojaeddin Chenouri Abstract Measurement system analysis aims to quantify the variability in data attributable to the measurement system and evaluate its contribution to overall data variability. This paper conducts a rigorous theoretical investigation of the statistical methods used in such analyses, focusing on variance components and other critical parameters. While established techniques exist for single-variable cases, a systematic theoretical exploration of their properties has been largely overlooked. This study addresses this gap by examining estimators for variance components and other key parameters in measurement system assessment, analyzing their statistical properties, and providing new insights into their reliability, performance, and applicability. keywords Gauge R&R studies; measurement system analysis; variance components; signal-to-noise ratio; estimation; inference; convergence; confidence interval. † † affiliation: University of Waterloo, Waterloo, ON, Canada 1 Introduction Maintaining and continuously improving quality is essential across all industries, as critical decisions regarding processes and products depend heavily on the accuracy and reliability of the measurement data ( Montgomery 2020 ) . However, measurement data often deviate from the true values due to a range of factors, including the limitations of the measurement devices, operator proficiency, environmental conditions, inherent item variability, and fluctuations across cycles, days, or machines ( Wheeler and Lyday 1989 ; Taver 1995 ) . As such, a comprehensive understanding of these error sources is essential to ensure that decisions based on the data are sound and reliable ( Smith, McCrary, and Callahan 2007 ) . All components involved in the process of data collection–including instruments, operators, methods, software, environmental conditions, and the broader measurement environment–constitute the measurement system ( Automotive Industry Action Group 1995 ; Montgomery 2020 ) . A measurement system analysis serves to quantify the variability in measurement data attributable to these components ( Montgomery and Runger 1993a ) . The primary objectives of this analysis are to assess the measurement system’s contribution to overall data variability, identify specific sources of variability within the measurement system, and assess its suitability for the intended application ( Montgomery and Runger 1993b ; Burdick, Borror, and Montgomery 2003 ; Majeske 2012 ) . The standard approach to assessing a measurement system ( Montgomery and Runger 1993a ; Burdick, Borror, and Montgomery 2003 ) involves randomly selecting a sample of units from the process and having each operator, or more broadly, each measurement system, perform repeated measurements on these units. Here, a unit refers to the object or item being measured. Data from this experiment are typically analyzed using a two-way model, which decomposes the measurement error into two primary components: the systematic error attributed to operator differences (reproducibility) and the error arising when the same measurement system is used multiple times over a short time period (repeatability). Measurement systems that are unaffected by operator bias or human factors such as skill, knowledge, or attitude are commonly referred to as measurement systems with no operator effect. These systems are typically automated, relying on machine-controlled processes like automated gauges or scanners to conduct measurements. Such systems are particularly important in industries like smart manufacturing ( Suriano et al. 2015 ; Yang et al. 2021 ; Majeske 2012 ) , aerospace, and the automotive sector ( Drouot et al. 2018 ; Browne, Mackay, and Steiner 2009 ) . By assuming the operator effect is negligible or non-existent, a simplified one-way model can be employed to capture repeatability. Notable studies in measurement system assessment that utilize one-way models include those by Browne, Mackay, and Steiner (2009) ; Browne, Steiner, and MacKay (2010) ; Weaver et al. (2012) . The field of measurement system assessment has experienced significant methodological advancements, particularly for the evaluation of single characteristics. The guidelines and standards developed by Automotive Industry Action Group (2003) provide a comprehensive framework to perform measurement system analyses and interpret the results. The practical considerations involved in designing and implementing measurement system studies are examined by Montgomery and Runger (1993a) , while Burdick, Borror, and Montgomery (2003) offer a detailed review of methodologies for evaluating measurement system capability, with a specific focus on the ANOVA procedure. Furthermore, alternative plans to the standard measurement system assessment plan are proposed by Browne, MacKay, and Steiner (2010) ; Stevens et al. (2010) ; Stevens et al. (2013) . The scope of measurement system analysis methodologies has also expanded to include setups involving non-numerical scales. For instance, Van Wieringen and De Mast (2008) and Danila, Steiner, and MacKay (2010) present frameworks for assessing measurement systems operating on binary scales, where units are classified as pass or fail. Similarly, Culp et al. (2018) propose a methodology for analyzing measurement systems with ordinal measurements, while Osthus et al. (2021) develop an approach for assessing repeatability and reproducibility in systems using count data. Despite the field’s significant methodological breadth, to the best of the authors’ knowledge, there remains a lack of documented theoretical analysis of these methods and their properties in the literature. This paper addresses this gap by providing a comprehensive theoretical investigation of measurement system assessment studies for univariate data. Specifically, we examine statistical properties and considerations related to measurement system analysis parameters, focusing on the one-way random effects model under a balanced standard plan. While the one-way model is valued for its simplicity, our analysis uncovers complexities in certain aspects. Nonetheless, the insights gained from this investigation offer a solid foundation for extending these theoretical analyses to more complex scenarios, such as two-way analysis of variance, advanced models, and diverse data types, including multivariate and functional data. This paper, therefore, concentrates on the one-way random effects model, which often suffices for many practical measurement system assessment applications. This paper is organized as follows: Section 2 presents the univariate one-way ANOVA model, which serves as the statistical framework for evaluating measurement system variability. Section 3 outlines key parameters for assessing measurement systems and defines the foundational notation used throughout the paper. These parameters are analyzed in greater detail in subsequent sections. Section 4 , provides a preliminary analysis of the univariate one-way ANOVA model, laying the groundwork for a deeper understanding of the measurement system. DSection 5 outlines various techniques for estimating the relevant parameters. A comprehensive examination of the statistical properties associated with these parameters, including estimator bias, sampling variance, hypothesis testing, convergence properties, and confidence intervals, is presented in Section 6 . Conclusions are drawn in Section 7 . Finally, the appendix contains detailed proofs that support the analysis of the paper. 2 The univariate one-way model We consider a setting where an experiment is conducted with a randomly selected sample of a>2 units drawn from a population of units. Each unit in the sample is measured r>1 times, with the order of measurements determined randomly. See, e.g., ( Automotive Industry Action Group 1995 , Section 3) . It is assumed that the measurand remains constant across repeated measurements. The model used to express the measured values is, \displaystyle Y_{ij}=\mu+U_{i}+\epsilon_{ij},\quad\textrm{for \;}i=1,\ldots,a,\textrm{ and }\,j=1,\ldots,r, (1) where Y_{ij} is the j th repeated measurement for the i th unit, \mu is a general mean parameter, U_{i} represents the random main effect of unit i , and \epsilon_{ij} represents the random measurement error associated with the j