Modeling Active Learning Classrooms

Olive Ross, Meagan Sundstrom, N.G. Holmes · 2026

Read Modeling Active Learning Classrooms by Olive Ross, Meagan Sundstrom, N.G. Holmes (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14335.txt.

Introduction

Ross, Sundstrom, and Holmes model which mixes of classroom activities predict student learning gains. Their data cover over 10,000 students at 24 institutions. Four time uses prove enough for a solid forecast: lecture, group worksheets, clicker questions, and student questions. One class type stands out, with effect sizes above two. Those classes spend modest shares on worksheets and clicker work and field at least two student questions per hour. Classes with no group worksheets learn about as much as pure lecture classes.

Catalog record

CREATOROlive Ross, Meagan Sundstrom, N.G. Holmes
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25723
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14335

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Modeling Active Learning Classrooms Olive Ross, Meagan Sundstrom, N.G. Holmes Abstract 1 Abstract Over the past several decades, a large body of research has shown that undergraduate science students learn more and more equitably in classrooms that are not entirely lecture-based. Non-lecture activities are collectively referred to as “active learning;” however, this term lacks definition and little research has examined which types and combinations of active learning strategies are most effective. In this study, we use a dataset that includes more than 10,000 students and spans a range of scientific disciplines, institutions, and instructors to create a predictive model that maps time spent on different classroom activities to student conceptual learning. We find that four variables – classroom time spent on lecture, group worksheets, clicker questions, and student questions – are sufficient to reliably predict student learning, as measured by concept inventory scores. We identify two types of classes that consistently lead to exceptional student learning gains (effect sizes greater than 2). The first are classes that spend 10-20% of class time on group worksheets, 20-40% of class time on group clicker questions, and average two or more student questions per hour of class time. The second is classes spending 30% or more of class time on group worksheets. We also find that classes which do not include any group worksheets consistently have learning outcomes comparable to fully lecture classes, even when other active learning strategies are used. These results provide testable recommendations for future controlled studies to investigate effective active learning implementation. 2 Introduction Despite lecture being the most common form of instruction for undergraduate science courses ( 12 ; 23 , e.g.,) , an extensive body of work has shown that classes that are composed of all lecture lead to higher failure rates ( 13 ; 19 ) , lower student learning ( 13 ) , and less equitable outcomes across demographic groups ( 25 ) when compared to classes that utilize non-lecture instruction methods. These non-lecture methods are collectively referred to as “active learning” and encompass a wide variety of classroom activities, such as clicker questions, group worksheets, and think-pair-share activities ( 23 ; 22 ) . Accordingly, governmental and institutional bodies are recommending that instructors incorporate active learning into their classrooms ( 18 , e.g.,) . There are, however, myriad definitions of the term active learning, creating ambiguity around how to enact these recommendations ( 14 ) . There is also relatively little research pointing to which particular active learning strategies are most effective for student learning and for what portion of class time each strategy should be used to achieve these outcomes. Research studies that directly compare the effects of different active learning approaches on student learning outcomes are necessary to help instructors decide the types of active learning methods to implement and the best ways to implement them. Several existing studies have started to address this goal. One study, 24 , compared student learning outcomes in different physics education research-based pedagogical approaches, finding that the SCALE-UP (Student-Centered Active Learning Environment with Upside-down Pedagogies ) pedagogy ( 4 ) leads to higher student learning gains than other commonly used active learning pedagogies. 26 related the extent to which different active learning activities were used during class to student learning outcomes and found that spending more time on group worksheets was positively correlated with student learning. Other research has applied the ICAP (Interactive, Constructive, Active, and Passive) framework ( 7 ) to distinguish between different types of engagement, finding that activities promoting higher levels of cognitive engagement are associated with better learning outcomes ( 8 ) . While this growing body of work has importantly begun to disentangle the relative impacts of different active learning strategies, the impacts of different combinations of these strategies has yet to be rigorously analyzed in a way that produces testable predictions about student learning outcomes in future classes. In this study, we combine data from extant studies ( 24 ; 10 ; 26 ) –spanning 24 institutions, 3 scientific disciplines, and class sizes ranging from 11 to 576 students–with new data collected by the authors to identify combinations of instructional strategies that coincide with the largest student learning gains. To do so, we analyze two data sources: classroom activities and concept inventory scores. We characterize classroom activities using the Classroom Observation Protocol for Undergraduate STEM (COPUS) ( 22 ) . The COPUS is a structured observation protocol that consists of 26 different codes, or student and instructor behaviors, and observers mark which codes occur in 2-minute segments of class time. The COPUS has been used both as an internal assessment of teaching practices 3 and as a research tool ( 9 ; 23 , e.g.,) . Concept inventories are commonly used by discipline-based education researchers to measure student learning. Concept inventories are, usually, multiple choice assessments that measure students’ conceptual understanding of core concepts in a given topic (e.g., mechanics). These assessments are typically administered both at the beginning of a course (pre-test) to determine students’ baseline level of knowledge and at the end of a course (post-test) to measure how much students have learned from the received instruction. As in prior work ( 13 ; 24 , e.g.,) , we use effect sizes between pre-test and post-test scores to quantify student learning. We particularly use Cohen’s d , a standardized mean difference between the two sets of scores, as this measure can be applied across a range of concept inventories and student populations ( 6 ; 17 ; 24 ) . We leverage COPUS observations and student concept inventory scores from 69 undergraduate science courses in this analysis. This dataset represents more than 10,000 students and 40 unique instructors across 24 American and Canadian Universities. We use these data to develop quantifiable and testable recommendations for which combinations of active learning strategies optimize student learning gains in undergraduate science courses. Notably, we move beyond the descriptive and/or explanatory analyses conducted in prior studies of the effect of active learning strategies and instead utilize a predictive framework as is common in many other science fields ( 21 ; 1 ) . We create a predictive model that maps class time spent on different active learning strategies to student learning. 3 Results We use multiple linear regression to train a model that maps the fraction of class intervals in which specific COPUS codes were present (approximating the fraction of class time spent on a given activity) to the concept inventory effect size in that class. We also use bootstrap sampling to create a suite of functions rather than a single function, such that the model outputs a distribution of predicted effect sizes rather than a single predicted effect size. The final model prediction is then taken as the mean of this distribution and the prediction error (due to sample bias) is taken as the standard deviation of the distribution. We use the final model to predict the effect sizes for simulated COPUS data that span the parameter space of the existing data. This model is limited by the data it was trained on; therefore, we define two criteria that must be met for a prediction to be considered reliable. First, in

Read the complete text