Self-Evaluated Expertise in experimental physics: a measure of students’ physics self-recognition
Michael F. J. Fox, Taylor O. Pomfret · 2025
Read Self-Evaluated Expertise in experimental physics: a measure of students’ physics self-recognition by Michael F. J. Fox, Taylor O. Pomfret (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07885.txt.
Introduction
Michael Fox and Taylor Pomfret introduce Self-Evaluated Expertise, a new measure of how physics students see their own competence, in a two thousand twenty-five education paper. The measure captures the self-recognition part of a student's physics identity.
Self-Evaluated Expertise can be extracted from existing responses to the E-CLASS survey of views about experimental physics. The authors show its scores differ quantitatively from the traditional E-CLASS measure, so it tracks something distinct. Applying it across four hundred ninety-four courses from two thousand sixteen to two thousand nineteen, they find students' self-recognition falls from before instruction to after it, an uncomfortable pattern for course designers.
Catalog record
| CREATOR | Michael F. J. Fox, Taylor O. Pomfret |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07885
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Self-Evaluated Expertise in experimental physics: a measure of students’ physics self-recognition Michael F. J. Fox, Taylor O. Pomfret Abstract We introduce and theoretically justify a new measure of the self-recognition component of student physics identity called Self-Evaluated Expertise (SEE). This measure is constructed such that it can be extracted from existing responses to the E-CLASS. In this work, we compare scores from SEE with the traditional measure calculated from the E-CLASS, which probes student views about experimental physics, to show that the SEE score is a quantitatively different measure. Consequently, we show that student self-recognition decreases from pre-instruction administration of the E-CLASS to the post-instruction administration when averaged across data from 494 courses having taken place between 2016–2019. Preprint: APS/123-QED I Introduction One common goal of physics education is to develop students’ views to become more expert like [ 1 , 2 , 3 ] . It has been argued that an expert in a subject demonstrates a distinct epistemology from that of novices [ 4 , 5 , 6 ] and as such their answers to survey questions can be used as the yardstick for measuring how close students are to thinking like experts [ 3 , 7 ] . Notwithstanding the issue of establishing consensus among experts [ 3 ] , this method has been used to score epistemological surveys such as the Colorado Learning Attitudes about Science Survey (CLASS) [ 7 ] and the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS) [ 3 ] . This definition of what is an expert is external to the student and therefore may be interpreted as providing an objective measure of epistemological development. Another possible measure of epistemological development is how students view themselves relative to their own perception of what an expert thinks. This centres the student in the analysis. This is naturally a more complex measure, as students’ view of their own thinking and their view of the way experts think could change over time. Let us consider the case where the goal of a course is for students to think of themselves as experts, this means that they would say that an expert would give the same response to a survey question as they do. The obvious issue is that this rewards students who are confident in their own abilities even if those are misplaced relative to what a “true” expert would think - hence it measures a student’s calibration of their own abilities. With this example we have illustrated that such a measure is recording something rather different from traditional scoring for epistemological surveys. In this paper we introduce a measure we call Self-Evaluated Expertise (SEE), and from the outset we relate it to an aspect of students’ identity. Student identity development frameworks have been used extensively in the discourse of the experiences of under-represented groups in physics [ 8 , 9 , 10 ] . We base this work in the Critical Physics Identity framework of Hyater-Adams et al. [ 10 ] , which constructs identity through six components: three related to racialized identity resources (relational, ideational, and material), and three related to physics identity constructs (recognition, interest, and competence/performance). We particularly focus on the recognition component, which Hyater-Adams et al. break down into internal and external sources of recognition (and positive and negative for encouraging participation in physics). The distinction between internal and external recognition builds on Carlone and Johnson’s science identity framework [ 8 ] , who identified self-recognition and recognition by others as two components of recognition. It is this self-recognition component of identity that we relate our Self-Evaluated Expertise measure to. The assumption of this paper is that if one believes that they are an expert — or at least hold the same views as an expert — this contributes positively to confidence and participation in the discipline of physics and has important consequences for who considers themself capable of becoming a physicist or being a “physics person” [ 10 ] . Typically works that investigate aspects of identity use interview and/or survey methodologies to collect data, however, interviews are limited, typically, to small sample sizes, and the practicalities of running multiple surveys needed to probe different aspects of students’ development on a course can lead to survey fatigue. This motivates our interest in developing an analysis of an existing survey (E-CLASS) in a new direction that we hope to show gives insights into students’ physics identities. Indeed, previous work with E-CLASS has shown that students often have a good idea of what an expert response to the survey items would be, even if they do not hold those views themself and that the gap between these two decreases when comparing first-year and beyond-first-year students [ 11 ] . Similar work by Gray et al. [ 12 ] using the CLASS survey compared “physicist” (expert) scores and “personal” (student’s own scores) and investigated how the difference between the two varied with gender. They found: Women have a larger gap between their “physicist” and “personal” scores… on 78% of the scored statements. Six of the seven statements that had gap differences greater than +10% had men’s “personal” scores that were notably more expertlike than the women’s “personal” scores… These six statements… all dealt with either the student’s interest in physics or the student’s confidence in his or her problem solving abilities. This, therefore, motivates the development of a measure that captures such differences to help explore the identity-related factors that affect engagement with (experimental) physics. The purposes of this paper are two-fold: P1: theoretically justify and practically describe the construction of a measure of self-recognition using the E-CLASS survey, and P2: demonstrate that measure provides new information about students that would not be accessible using the traditional E-CLASS scores. We approach the first purpose by grounding the work in the physics identity literature above in this Introduction, then, in the following sections, defining the Self-Evaluated Expertise score and explaining how it can be considered a measure of self-recognition. To meet the second purpose we apply the measure to data collected with E-CLASS and compare the score with the traditional scoring system used to analyse E-CLASS (the YOU score, see Sec. II.1.2 ), highlighting results that provide new insights into this one component of student identity. Practically, we demonstrate the differences between the SEE measure and the traditional E-CLASS scoring by: (1) checking the correlation between E-CLASS YOU and SEE scores total scores; (2) checking the correlation between YOU and SEE mean item scores; and, (3) investigating whether Self-Evaluated Expertise scores change in the same way as E-CLASS scores from the beginning to the end of a course on an item-by-item basis. Throughout this process, we aim to provide the reader insight into how to interpret SEE scores. While part of the motivation comes from the gender-based observations made by Gray et al. [ 12 ] , we leave the exploration of how the SEE score provides insight into demographic inequities to later work. II Methods II.1 Construction of the SEE score II.1.1 The E-CLASS Figure 1: Item 1 from the E-CLASS pre-test. Reproduced from the E-CLASS website with permission [ 13 ] . The E-CLASS principally consists of 30