Adjusting for Heavy Censoring and Double-Dipping to Compare Risk Stratification Abilities of Existing Models for Time to Diagnosis of Huntington Disease

Kyle F. Grosser Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A, Abigail G. Foes Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A.Stellen LiDepartment of Biostatistics, University · 2025

Read Adjusting for Heavy Censoring and Double-Dipping to Compare Risk Stratification Abilities of Existing Models for Time to Diagnosis of Huntington Disease by Kyle F. Grosser Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A, Abigail G. Foes Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A.Stellen LiDepartment of Biostatistics, University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03596.txt.

Introduction

Kyle F Grosser and co-authors fairly compare four models that predict time to Huntington disease diagnosis. The models, built on repeat length, age, and combined scores, often disagree, and past comparisons risked bias. Testing models on their own training data flatters them, and heavy censoring, with most people still undiagnosed, distorts scores further.

The team explains each model's foundations in plain terms, weighing practical use. External data then test how well each model separates high-risk from low-risk people once censoring is handled properly. Trial designers need honest rankings, since a weak model wastes slots and can mislead hopeful participants. The study offers a cleaner yardstick for a field where timing guides care.

Catalog record

CREATORKyle F. Grosser Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A, Abigail G. Foes Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A.Stellen LiDepartment of Biostatistics, University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-03596

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adjusting for Heavy Censoring and Double-Dipping to Compare Risk Stratification Abilities of Existing Models for Time to Diagnosis of Huntington Disease Kyle F. Grosser Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A, Abigail G. Foes Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A.Stellen LiDepartment of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A.Vraj ParikhDepartment of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A. Tanya P. Garcia Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, U.S.A. Sarah C. Lotspeich Department of Statistical Sciences, Wake Forest University, Winston-Salem, North Carolina, U.S.A. [email protected] Abstract Huntington disease (HD) is a genetically inherited neurodegenerative disease with progressively worsening symptoms. Accurately modeling time to HD diagnosis is essential for clinical trial design and treatment planning. Langbehn’s model, the CAG-Age Product (CAP) model, the Prognostic Index Normed (PIN) model, and the Multivariate Risk Score (MRS) model have all been proposed for this task. However, differing in methodology, assumptions, and accuracy, these models may yield conflicting predictions. Few studies have systematically compared these models’ performance, and those that have could be misleading due to (i) testing the models on the same data used to train them and (ii) failing to account for high rates of right censoring ( 80 % + 80\%+ ) in performance metrics. We discuss the theoretical foundations of the four most common models of time to HD diagnosis, offering intuitive comparisons about their practical feasibility. Further, we externally validate their risk stratification abilities using data from the ENROLL-HD study and performance metrics that adjust for censoring. Our findings guide the selection of a model for HD clinical trial design. The MRS model, which incorporates the most covariates, performed the best. However, the simpler CAP and PIN models were not far behind and may be logistically simpler to adopt. We also show how these models can be used to estimate sample sizes for an HD clinical trial, emphasizing that previous estimates would lead to underpowered trials. K eywords Brier score \cdot Censored covariates \cdot Cox model \cdot Inverse probability of censoring weights \cdot Neurodegenerative disease \cdot ROC curves 1 Introduction 1.1 Huntington Disease, Genetic Testing, and Observational Studies Huntington disease (HD) is a hereditary neurodegenerative disease caused by a repeat expansion of the trinucleotide CAG (cytosine-adenine-guanine) in the Huntingtin gene 11 . This disease is fully penetrant for patients with \geq 40 CAG repeats, meaning that they will meet the diagnostic criteria for Huntington disease with probability >90\% 23 . An HD diagnosis is made based on a clinician’s assessment of a patient’s motor impairment, following the Unified Huntington Disease Rating Scale (UHDRS) 4 . The full penetrance of HD is unique among neurodegenerative diseases. With genetic testing, researchers can identify patients who will develop HD before symptom onset and construct valuable observational cohorts (see Table 2 for examples). These studies all collected crucial clinical measurements of HD symptom severity. The UHDRS Diagnostic Confidence Level (DCL) is a categorical rating from 0–4 assigned by a clinician, where a DCL of 0 indicates no motor impairment and 4 indicates that the clinician is 99% certain that the patient is exhibiting motor impairment due to HD 15 . Crucially, a DCL rating of 4 indicates a clinical diagnosis. The UHDRS Total Motor Score (TMS) 4 is a 31-item, clinician-rated assessment of motor impairment, where higher scores indicate greater impairment. The Symbol Digit Modalities Test (SDMT) 20 and Stroop Word, Color, and Interference tests 21 are timed assessments that quantify cognitive ability, with lower scores indicating worse cognitive impairment. Table 1: Summary of major Huntington disease observational studies. Study Years Sample Size Right-Censoring Rate Citation COHORT 2005–2011 1true326 81% Dorsey and Investigators (2012) 2 TRACK-HD 2008–2011 257 85% Tabrizi et al. (2009) 22 PREDICT-HD 2002–2014 1true159 77% Paulsen et al. (2006) 14 ENROLL-HD 2012–present 5true173 88% Sathe et al. (2021) 19 Table 2: Summary of Huntington disease studies, including study name, years active, sample size, and right-censoring rate (the percent of patients undiagnosed by the end of study). 1.2 Designing Clinical Trials: Traditional Versus Preventative Clinically, HD is characterized by progressive motor dysfunction, cognitive decline, and loss of functional independence. Numerous pharmacological, psychiatric, and behavioral treatments have been proposed for HD patients, but none so far have been approved for delaying or stopping disease progression. However, several studies are in progress and one has shown promise in its human trials to reduce Huntington disease progression 25 . Another focus is on palliative care and improving quality of life, but treatments remain limited. Chorea, characterized by involuntary movements, is the only HD symptom with an approved pharmacological treatment 12 . Approved symptom treatments and recent clinical breakthroughs further highlight the need for early intervention. Risk stratification models are key to designing preventative clinical trials and identifying patients before symptoms manifest, allowing for potential interventions to have the most effect before irreversible symptoms and damage are incurred. Traditionally, clinical trials for HD recruit patients who have already received their clinical diagnosis, and are thus displaying severe motor, cognitive, and functional impairment. This recruitment strategy allows for shorter trials and increases the likelihood of detecting treatment effects, which are both desirable traits to trial coordinators 6 . However, this approach has a major limitation: By the time of diagnosis (and thus trial recruitment), neurological damage is irreversible and therapeutic interventions may be ineffective. Moreover, neurodegenerative diseases like HD progress slowly for decades prior to clinical diagnosis. Thus, trials that only recruit subjects after their clinical diagnosis could fail to detect interventions that impact the disease’s early stages. Given these limitations, researchers have begun to shift clinical trial focus to patients with prodromal HD, that is, those who have not yet been diagnosed but are genetically guaranteed to develop the disease 18 ; 6 . These studies, called preventative clinical trials , aim to slow or stop symptom development and thus delay or prevent the clinical diagnosis of a patient with HD. However, one unique challenge with preventative trials is the small proportion of patients expected to be diagnosed during the trial; Paulsen et al. (2019) 15 report that less than 1\% of patients in an observational study of prodromal HD patients were diagnosed within 3 years, a typical trial length. Since statistical power is tied to the number of “events” (HD diagnoses) in the untreated group, these trials often require large sample sizes to be sufficiently powered to detect a treatment effect. Put simply, when fewer patients are expected to be diagnosed during a trial, more must be enrolled to detect a treatment effect. With larger sample sizes, these trials can become more expensive and difficult to implement. Fortunately, time-to-diagnosis models can help to overcome this challenge via a strategy known as sample enrichment 28 ; 10 ; 15 ; 7 . We can use them to calculate log-risk scores for potential patients and recruit only those whose log-risk scores lie above a particular threshold (i.e., who are closer to diagnosis). This approach increases the expected rate of diagnosis in the untreated group, reducing the sample size needed for a desired

Read the complete text