Recommendations for application of the functional evidence PS3/BS3 criterion using the ACMG/AMP sequence variant interpretation framework.

Brnich SE, Abou Tayoun AN, Couch FJ, Cutting GR, Greenblatt MS, Heinen CD, Kanavy DM, Luo X, McNulty SM, Starita LM, Tavtigian SV, Wright MW, Harrison SM, Biesecker LG, Berg JS, Clinical Genome Resource Sequence Variant Interpretation Working Group. · 2019

Read Recommendations for application of the functional evidence PS3/BS3 criterion using the ACMG/AMP sequence variant interpretation framework. by Brnich SE, Abou Tayoun AN, Couch FJ, Cutting GR, Greenblatt MS, Heinen CD, Kanavy DM, Luo X, McNulty SM, Starita LM, Tavtigian SV, Wright MW, Harrison SM, Biesecker LG, Berg JS, Clinical Genome Resource Sequence Variant Interpretation Working Group. (2019) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc6938631.txt.

Introduction

Brnich and co-authors set rules for using lab test evidence when judging gene variants. Their recommendations appeared in Genome Medicine. Clinical guidelines sort variants with evidence codes. Two codes, PS3 and BS3, cover functional assays that show a variant harms or spares gene function. The guidelines never said how to weigh such assays, so laboratories often disagree.

A working group of the Clinical Genome Resource built a structured approach. Evaluators first define how the disease works. They then judge which assay types fit, and whether a given assay was properly validated. A four-step framework assigns the right strength of evidence. Shared rules, the group argues, should cut discordant calls between laboratories.

Catalog record

CREATORBrnich SE, Abou Tayoun AN, Couch FJ, Cutting GR, Greenblatt MS, Heinen CD, Kanavy DM, Luo X, McNulty SM, Starita LM, Tavtigian SV, Wright MW, Harrison SM, Biesecker LG, Berg JS, Clinical Genome Resource Sequence Variant Interpretation Working Group.
YEAR2019
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC6938631

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Recommendations for application of the functional evidence PS3/BS3 criterion using the ACMG/AMP sequence variant interpretation framework By Sarah E. Brnich, Ahmad N. Abou Tayoun, Fergus J. Couch, Garry R. Cutting, Marc S. Greenblatt, Christopher D. Heinen, Dona M. Kanavy, Xi Luo, Shannon M. McNulty, Lea M. Starita, Sean V. Tavtigian, Matt W. Wright Published in: Genome Medicine DOI: 10.1186/s13073-019-0690-2 ABSTRACT Background The American College of Medical Genetics and Genomics (ACMG)/Association for Molecular Pathology (AMP) clinical variant interpretation guidelines established criteria for different types of evidence. This includes the strong evidence codes PS3 and BS3 for “well-established” functional assays demonstrating a variant has abnormal or normal gene/protein function, respectively. However, they did not provide detailed guidance on how functional evidence should be evaluated, and differences in the application of the PS3/BS3 codes are a contributor to variant interpretation discordance between laboratories. This recommendation seeks to provide a more structured approach to the assessment of functional assays for variant interpretation and guidance on the use of various levels of strength based on assay validation. Methods The Clinical Genome Resource (ClinGen) Sequence Variant Interpretation (SVI) Working Group used curated functional evidence from ClinGen Variant Curation Expert Panel-developed rule specifications and expert opinions to refine the PS3/BS3 criteria over multiple in-person and virtual meetings. We estimated the odds of pathogenicity for assays using various numbers of variant controls to determine the minimum controls required to reach moderate level evidence. Feedback from the ClinGen Steering Committee and outside experts were incorporated into the recommendations at multiple stages of development. Results The SVI Working Group developed recommendations for evaluators regarding the assessment of the clinical validity of functional data and a four-step provisional framework to determine the appropriate strength of evidence that can be applied in clinical variant interpretation. These steps are as follows: (1) define the disease mechanism, (2) evaluate the applicability of general classes of assays used in the field, (3) evaluate the validity of specific instances of assays, and (4) apply evidence to individual variant interpretation. We found that a minimum of 11 total pathogenic and benign variant controls are required to reach moderate-level evidence in the absence of rigorous statistical analysis. Conclusions The recommendations and approach to functional evidence evaluation described here should help clarify the clinical variant interpretation process for functional assays. Further, we hope that these recommendations will help develop productive partnerships with basic scientists who have developed functional assays that are useful for interrogating the function of a variety of genes. BACKGROUND The American College of Medical Genetics (ACMG) and the Association for Molecular Pathology (AMP) jointly developed standards and guidelines for the assessment of evidence to increase consistency and transparency in clinical variant interpretation [1]. One type of evidence defined in this guideline was the effect of a variant on gene/protein function as determined by a “well-established” functional assay, which provides strong support of a pathogenic or benign impact (rule codes PS3 and BS3, respectively). The full definition is provided in Table 1. Functional studies can provide powerful insight into the effect of a variant on protein function and have the capacity to reclassify variants of uncertain significance (VUS) [2], underscoring the need for experimental evidence to be applied accurately and consistently in variant interpretation. However, the ACMG/AMP standards did not provide detailed guidance on how functional evidence should be evaluated, and differences in the application of the PS3/BS3 codes represent a major contributor to variant interpretation discordance among clinical laboratories [3]. Table 1Text of original ACMG/AMP recommendation for functional assays, reproduced with permission [1]“Functional studies can be a powerful tool in support of pathogenicity; however, not all functional studies are effective in predicting an impact on a gene or protein function. For example, certain enzymatic assays offer well-established approaches to assess the impact of a missense variant on enzymatic function in a metabolic pathway (e.g., α-galactosidase enzyme function). On the other hand, some functional assays may be less consistent predictors of the effect of variants on protein function. To assess the validity of a functional assay, one must consider how closely the functional assay reflects the biological environment. For example, assaying enzymatic function directly from biopsied tissue from the patient or an animal model provides stronger evidence than expressing the protein in vitro. Likewise, evidence is stronger if the assay reflects the full biological function of the protein (e.g., substrate breakdown by an enzyme) compared with only one component of function (e.g., adenosine triphosphate hydrolysis for a protein with additional binding properties). Validation, reproducibility, and robustness data that assess the analytical performance of the assay and account for specimen integrity, which can be affected by the method and time of acquisition, as well as storage and transport, are important factors to consider. These factors are mitigated in the case of an assay in a Clinical Laboratory Improvement Amendments laboratory–developed test or commercially available kit. Assays that assess the impact of variants at the messenger RNA level can be highly informative when evaluating the effects of variants at splice junctions and within coding sequences and untranslated regions, as well as deeper intronic regions (e.g., messenger RNA stability, processing, or translation). Technical approaches include direct analysis of RNA and/or complementary DNA derivatives and in vitro minigene splicing assays.” In response to calls to further standardize variant interpretation [3, 4], the Clinical Genome Resource (ClinGen) established the Sequence Variant Interpretation Working Group (SVI) [5] and condition-specific Variant Curation Expert Panels (VCEPs) to refine ACMG/AMP guidelines for each evidence criterion [6]. To date, six VCEPs have published recommendations, including which assays they approved for PS3/BS3 evidence application, as well as the validation metrics they required for said approval [7–12]. VCEP-approved assays varied greatly and included splicing assays, animal and cellular models, and different in vitro systems [13]. VCEPs generally approved assays that considered the disease mechanism and most included wild-type controls, but statistical analyses and the inclusion of other controls were less consistent. The VCEPs vary significantly in how they defined which assays were “well-established” [13], including consideration of parameters such as experimental design, replication, controls, and validation, indicating the subjective nature of assessing the quality and applicability of functional evidence, potentially leading to discordance in variant classification. In this manuscript, we detail additional guidance developed by the SVI regarding the assessment of the clinical validity of functional studies and a provisional framework for the determination of suitable evidence strength levels, with the goal that experimental data cited as evidence in clinical variant interpretation meets a baseline quality level. We expect to further refine these approaches in collaboration with VCEPs as they apply these recommendations moving forward. METHODS In November 2018, during the monthly SVI Working Group conference call, we first outlined our goals of defining what constitutes a well-established functional assay and how functional assay evidence should be structured for computation and curation. In this meeting, we presented a preliminary approach to curating functional evidence and important considerations for assay validation. This process was subsequently presented at the ClinGen Steering Committee in-person meeting in Seattle, WA, in December 2018 for comments and further refinement. The proposed PS3/BS3 evaluation process was then discussed on the SVI Working Group call in March 2019 and again in-person at the American College of Medical

Read the complete text