Appraisal of international, patient‐facing resources on heavy menstrual bleeding Authors: Olivia Carere, Lauren Clarfield, Lacey Brennan, Hilary O D Critchley, Jade Desilets, Laura Diamond, Yasushi Hirota, Kinshuk Kumar, Sarah Maheux‐Lacroix, Kristen A Matteson, Ilza Monteiro, Malcolm G Munro, Orli Silverberg, M Talat Uppal, Chelsie Warshafsky, Ally Murji Published: 2026 ABSTRACT AbstractThis study aimed to systematically evaluate the quality of widely accessible, English language, patient‐facing resources on heavy menstrual bleeding (HMB), identifying strengths, gaps, and opportunities for improvement. Resources were obtained from (1) a systematic Google Trends‐informed Google search and (2) submissions from subject matter experts. Eligible resources were independently reviewed and scored using validated tools for credibility (QUEST), aesthetics (modified Abbott's scale), and readability. To evaluate clinical utility, resources were graded using a tool designed by international experts for comprehensiveness and accuracy across six domains. Inter‐rater reliability was assessed with the intraclass correlation coefficient (ICC) and Cohen's kappa. Of 353 resources identified, 63 met the inclusion criteria. Mean QUEST score (maximum = 28) was 18.7 ± 5.1, with 4/63 (6%) resources meeting all credibility criteria. Mean aesthetics score (maximum = 7) was 5.3 ± 1.1, with only 15/63 (24%) resources with graphics. Most resources (40/63, 64%) were written at a grade 10–12 reading level. Mean comprehensiveness score (maximum = 6) was 4.6 ± 0.8, with gaps most often observed in advice on when to seek emergency care and information about iron deficiency. Mean accuracy score (maximum = 12) was 8.0 ± 2.3, with only 3/63 (13%) resources containing completely accurate content. There was moderate‐to‐substantial agreement across reviewers (ICC = 0.60–65 for aesthetics credibility; κ = 0.38–49 for accuracy comprehensiveness). In conclusion, most online resources accessed by patients are moderately credible, difficult to read, and underutilize figures. Content gaps exist mainly related to education on safety and iron deficiency. Very few resources are entirely accurate. We recommend targeted revisions to patient education resources to better inform and empower patients experiencing HMB.Keywords: digital health resources, health communication, health literacy, information‐seeking behavior, menorrhagia, patient education INTRODUCTION Heavy menstrual bleeding (HMB), describing excessive menstrual volume, affects quality of life in up to half of all menstruating girls and women. 1 , 2 , 3 Previous studies have reported that 50%–80% of women do not seek medical care for this debilitating symptom and instead turn to the Internet, often as their first or only source of information. 4 , 5 , 6 The widespread accessibility and immediacy of the Internet offer unique opportunities to support patient education and autonomy, particularly in remote or underserved areas. 7 However, online health information is highly variable in quality, credibility, and readability. Studies evaluating online resources for other conditions, such as menopause hormone therapy, have highlighted issues including incomplete or outdated content, poor readability, and lack of evidence‐based information. 8 These limitations can lead to misinformation, inadequate treatment decisions, and subsequent potential harm to patients. Given the rise in online health information seeking and the high search volume for HMB, there is a need to evaluate existing online resources systematically. To address this gap, members of the International Federation of Gynecology and Obstetrics (FIGO) Committee on Menstrual Disorders and Related Health Impacts (MDRHI) undertook a systematic assessment of the quality of online patient education material related to HMB. We also aimed to identify high‐quality resources to promote to enhance menstrual health literacy. METHODS This cross‐sectional study systematically evaluated the credibility, aesthetics, readability, comprehensiveness, and accuracy of patient‐facing online resources on HMB. The study did not involve human participants and used publicly available data; hence, it did not require ethics approval. Search strategy Resources were gathered through two complementary methods: systematic Internet searches and submissions from members of the FIGO Committee for MDRHI and their networks. Internet searches were conducted on October 8, 2024, using Google, the most commonly used global search engine. 9 Search terms included “heavy menstrual bleeding” and “menorrhagia,” which were selected based on Google Trends data showing these as the most frequently searched terms related to HMB (available at: https://trends.google.com). The searches were conducted in private browsing mode to avoid personalized results, and data collection was limited to the first page of search results, as studies suggest that 95% of users do not navigate beyond this page. 10 The search included countries represented on the FIGO Committee for MDRHI, including Australia, Brazil, Canada, Egypt, Greece, India, Ireland, Japan, Mexico, UK, and USA. In parallel, FIGO Committee members were asked to submit at least three patient‐facing HMB resources they personally recommended for patients. Committee members were also asked to submit one or more relevant patient organizations, which were then searched for additional HMB‐related sources. Inclusion and exclusion criteria Resources were included if written in English, intended for patient use, focused on HMB, and contained a minimum of 12 lines of original content. We excluded the following resources: Wikipedia pages, books, open forums, discussion platforms, or videos; websites focused solely on specific pathologies within HMB (e.g., leiomyomas); or websites requiring payment or login credentials for access. Website evaluation Credibility The credibility of the resources was evaluated using the QUality Evaluation Scoring Tool (QUEST), a validated and reliable instrument designed to assess six key aspects of online health information: authorship, attribution, conflict of interest, currency, complementarity, and tone. 11 The tool is scored from 0 to 28, with higher scores indicating better credibility. Aesthetics The aesthetics of a site was scored between 0 and 7 points, and was evaluated using the aesthetics component of Abbott's Scale, 12 which assesses visual design and layout. Readability A site's readability was assessed using the Flesch–Kincaid Grade Level (FKGL), which uses an equation to estimate the USA grade level required to understand the text. Medical information is recommended to be written at a 6th‐grade reading level to ensure accessibility for most adults in the USA, based on estimated health literacy levels in the general population. 13 Quality and clinical utility No validated tool currently exists to evaluate the comprehensiveness and accuracy of online resources addressing HMB. In line with previous literature, 14 members of the FIGO Committee for MDRHI developed a tool to evaluate HMB resources that assessed the accuracy and comprehensiveness across six key identified domains: definition of HMB, etiology, workup, management, iron deficiency (ID)/iron deficiency anemia (IDA), and safety (i.e., when to seek emergency care, including red‐flag symptoms such as prolonged heavy bleeding, symptoms of severe anemia, or signs of hemodynamic instability). For each domain, resources were scored for comprehensiveness (1 = present, 0 = absent) and, if present, accuracy (2 = correct, 1 = partially correct/missing details, 0 = incorrect). Comprehensiveness and accuracy scores for each domain yielded a total quality score in the range of 0–18. Reviewers also assessed clinical utility by answering, “Would you feel comfortable using this resource to educate a patient?” (1 = yes, 0 = no) and were asked to provide general comments on each resource. Details for all evaluation tools are found in the supplemental data. Data collection and analysis All resources were scored for credibility, aesthetics, readability, comprehensiveness, accuracy, and clinical utility. Readability was evaluated using an objective online calculator (FKGL). Two independent, medical resident reviewers evaluated each resource for credibility and aesthetics (non‐clinical scoring tools). A third medical trainee reviewer adjudicated any discrepancies. Separately, comprehensiveness, accuracy, and clinical utility (clinical scoring tools) were evaluated by expert clinicians with experience assessing and managing reproductive‐aged girls and women with the symptom of HMB. From a pool of 14 experts, two independent reviewers assessed each resource. No two resources were reviewed by the same pair of clinicians. Scores for clinical domains were averaged rather than adjudicated, reflecting real‐world expert judgment. All scores were summarized using descriptive statistics. Inter‐rater reliability was measured using the intraclass correlation coefficient (ICC) and Cohen's kappa coefficient for agreement within each domain. The Mann–Whitney test was used for inter‐ and intragroup comparisons. Statistical significance was defined as P < 0.05. All analyses were conducted using R version 4.3.1. RESULTS A total of 353 online resources on HMB were identified. After removing duplicates and applying exclusion criteria, 63 unique, patient‐facing resources were included for complete evaluation (Figure 1). Flow diagram of resource identification, screening, and inclusion. Credibility The mean QUEST score was 18.7/28 ± 5.1, with only 4/63 (6%) websites meeting all credibility criteria. All resources (63/63, 100%) supported the patient–physician relationship, and most presented unbiased information (50/63, 79%), but fewer clearly stated the authors' qualifications (24/63, 38%) or cited scientific sources (17/63, 27%) (Table 1). Inter‐rater reliability for QUEST scoring was moderate (ICC = 0.65, 95% confidence interval [CI] = 0.47–0.77; P < 0.001). TABLE 1Credibility and aesthetics of online resources on heavy menstrual bleeding. a VariableValue Credibility (0–28) 18.7 ± 5.61 Authorship0 = No indication of authorship or username4 (6)1 = All other indications of authorship35 (56)2 = Author's name and qualification clearly stated24 (38)Attribution0 = No sources15 (23)1 = Mention of expert source, research findings, links to sites, advocacy body, or other26 (41)2 = Reference to at least one identifiable scientific study5 (8)3 = Reference to mainly identifiable scientific studies17 (27)Type of study0 = In vitro, animal models, or editorial39 (62)1 = All observational work4 (6)2 = Meta‐analyses, randomized controlled trials, clinical studies20 (32)Conflict of interest0 = Endorsement or promotion of intervention designed to prevent or treat2 (3)1 = Endorsement or promotion of educational products and services11 (18)2 = Unbiased information50 (79)Currency0 = No date15 (23)1 = Article is dated, but 5 years or older8 (13)2 = Article is dated within the past 5 years40 (64)Complementarity0 = No support of the patient–physician relationship0 (0)1 = Support of the patient–physician relationship63 (100)Tone0 = Strong vocabulary, non‐conditional verb tenses, no discussion of limitations3 (5)1 = More cautious vocabulary, no discussion of limitations17 (27)2 = Author's statements are balanced by caution; includes statements of limitations43 (68) Aesthetics (0–7) 5.17 ± 1.07 Document has a distinguishable header, body, and footer58 (92)Major headings and subheadings are easily identifiable57 (91)Additional relevant links48 (76)Use of relevant graphics15 (24)Minimal hidden information/page layering55 (87)The page does not contain outside advertisements44 (70)Any of the following features present: e.g., an internal search engine, audio or video support, a satisfaction questionnaire, the possibility of sending requests to the web admins or the authors, etc.49 (78) Readability Extremely easy – fairly easy (7th grade or below)1 (2)Standard (8th–9th grade)20 (32)Fairly difficult (10th–12th grade)40 (64)Difficult (college and above)2 (3) a Values are given as number (percentage) or mean ± SD. Credibility and aesthetics of online resources on heavy menstrual bleeding. a Values are given as number (percentage) or mean ± SD. Aesthetics The mean aesthetics score was 5.3 ± 1.1 (out of 7). Although most resources included headers (58/63, 92%), subheadings (57/63, 91%), and relevant links (48/63, 76%), fewer included graphics (15/63, 24%) (Table 1). Inter‐rater reliability for aesthetic scores was moderate (ICC = 0.60, 95% CI = 0.42–0.74; P < 0.001). Readability Only 1/63 (2%) resources was written at or below the 6th‐grade reading level recommended by the American Medical Association for health information. Most resources (40/63, 64%) were written at a 10th–12th grade level, with an additional 2/63 (3%) requiring college‐level literacy. Comprehensiveness The mean comprehensiveness score was 4.6 ± 0.84 out of 6. Most resources addressed definition (63/63, 100%), etiology (61/63, 97%), workup (58/63, 92%), and management (61/63, 97%). However, fewer addressed the important related health impacts of ID/IDA (51/63, 81%) and when to seek emergency care (22/63, 35%) (Table S4, Figure 2). Inter‐rater reliability for comprehensiveness was moderate (ICC = 0.49, 95% CI = 0.25–0.67; P < 0.001). Cohen's kappa values indicated moderate agreement for all subdomains. (a) Comprehensiveness and (b) accuracy scores by heavy menstrual bleeding content domain. ID, iron deficiency; IDA, iron deficiency anemia. Accuracy Table S4 displays the accuracy scores for the various domains. Expert reviewers frequently noted inaccurate or misleading treatment information, omissions of vital investigations or structural causes of HMB, or continued use of outdated terminology (e.g., “menorrhagia”) (Table S5). 15 , 16 The mean accuracy score (maximum = 12) was 8.0 ± 2.3, with definition (43/63, 68%) and workup (38/63, 66%) rated as most accurate, and safety (3/63, 13%) the least (Figure 2). Inter‐rater reliability for accuracy scoring was fair (ICC = 0.38, 95% CI = 0.12–0.59, κ = 0.38). When scores for comprehensiveness and accuracy were summed to create a total quality score (0–18), the mean quality score (maximum = 18) was 11.3 ± 2.6. Clinically useful subgroup A total of 45/63 (71%) resources were deemed useful for patients by at least one expert reviewer. Within the subset of 15/63 (24%) resources endorsed by both reviewers, the mean comprehensiveness score (maximum = 6) was 4.6 ± 0.95, and the mean accuracy score (maximum = 12) was 8.1 ± 1.8. Notably, even the five resources with the highest total quality score within this subset contained substantial issues, including omission of malignancy in etiology, misuse of terms such as “vaginal bleeding,” and limited discussion of diagnostic parameters or iron deficiency (Table S5). No significant differences in either credibility (P = 0.60) or total scores (P = 0.79) were observed between resources sourced via Google versus those submitted by providers (Figure S2). DISCUSSION Despite the growing reliance on the Internet for health information, our evaluation of 63 patient‐facing resources suggests that most online patient education HMB materials fall short in delivering credible, readable, and high‐quality content. Only 6% of resources met all credibility criteria, with most omitting information on authorship and lacking credible reference attribution, factors known to reduce patient trust in online health resources. 17 , 18 Graphics, helpful for comprehension, particularly for readers with limited health literacy, were absent in 75% of resources, posing barriers to accessibility. Readability was also consistently poor, with only one resource meeting the recommended 6th‐grade reading level for health information (age 9–11 years), and the majority (64%) were written at a 10th–12th‐grade level (age 15–18 years). 19 Similar results have previously been observed in studies evaluating content from other gynecology societies. 13 This presents a barrier to comprehension and may disproportionately affect patients with lower health literacy. 20 Although a 6th‐grade reading level is a well‐established, evidence‐based benchmark for patient education materials aimed at maximizing accessibility, achieving this target for complex clinical topics may not be realistic without oversimplifying essential content. Although true, the majority of resources evaluated in this study are written at levels substantially above recommended thresholds, which may disproportionately impact more vulnerable patients. Instead of aiming for a specific‐grade level, authors should aim to balance readability with preservation of key clinical detail and/or provide varying tiers of literary complexity for varying audiences. This is exemplified by platforms such as UpToDate, which provide patient education pages on both “The Basics” (plain‐language summaries addressing key patient questions) and “Beyond the Basics” (more detailed content for readers comfortable with medical terminology). 21 We found critical gaps in content, including limited guidance on when to seek emergency care and inadequate information on the symptoms of ID/IDA. This information is important for facilitating appropriate self‐triage and recognition of symptoms associated with HMB that can have a profound impact on quality of life (such as ID/IDA). We also uncovered accuracy issues in these resources, especially in the safety domain (13% correct), raising concerns that patients may receive inappropriate reassurance or fail to seek emergency care. Collectively, these limitations across credibility, readability, accuracy, and content comprehensiveness may disproportionately impact those in underserved settings, including low‐ and middle‐income countries, where access to specialist care and high‐quality patient education materials can be limited and reliance on online information may be greater. These findings align with prior studies of gynecologic content that report poor readability and quality of online information, 22 , 23 and add to existing work by incorporating expert‐validated scoring and domain‐specific assessments. Interestingly, Google‐sourced resources did not differ significantly in credibility and quality from provider‐sourced materials. Our study also found little consensus among expert clinicians regarding their comfort in providing this resource to patients. Although 71% of resources were recommended by at least one expert reviewer, only 24% were endorsed by both. Among this top subset of recommended resources, total quality scores were in the range of 6–16 out of 18, highlighting that even the “best” available resources have content gaps and inaccuracies and would benefit from thorough review and improvements. Among the top three highest‐quality resources, the National Health Service (NHS) Heavy Period Decision Guide 24 excluded malignancy as a potential etiology of HMB, the Health Service Executive (HSE) Ireland Heavy Periods Resource 25 required users to access multiple embedded links to retrieve complete information, and the Gynecology Quality Improvement (GynQI) Heavy Periods Overview 26 misclassified treatment information and omitted key details regarding iron deficiency assessment. To raise the collective standard of quality for online menstrual health resources, the next step will be to engage directly with these organizations to provide structured feedback and encourage the incorporation of FIGO‐endorsed diagnostic terminology and safety guidance to ensure patient‐centered information. Based on the gaps identified across evaluated resources, authors of existing or new patient facing HMB materials should prioritize several key improvements: (1) clearly describe when to seek emergency or specialist care, ensuring patients can recognize red‐flag symptoms; (2) include education on iron deficiency and iron deficiency anemia, linking these concepts explicitly to HMB; (3) improve readability with plain‐language summaries or text simplification using AI tools; (4) incorporate visual or interactive elements (e.g., flowcharts, infographics) to support understanding across literacy levels; (5) enhance transparency by disclosing the author's name and qualifications, as well as references to high‐quality sources (e.g., systematic and/or meta‐analyses, clinical guidelines). Collectively, these steps can improve accessibility, trust, and health literacy for individuals seeking information on HMB. These findings must be interpreted in the context of the study design. Comprehensiveness and accuracy were assessed using an expert‐derived, guideline‐aligned tool grounded in FIGO recommendations and PALM‐COEIN terminology. 16 Importantly, a non‐validated tool was used in lieu of an existing validated tool specific to this topic. Though the tool was not validated, it was created by an expert panel and served as the only plausible choice to capture the quality, safety, and utility of condition‐specific webpages. In addition, accuracy scoring was inherently subjective, and although inter‐rater reliability was fair to moderate (ICC = 0.38 for accuracy, 0.49 for comprehensiveness), the two reviewers' scores from the clinical scoring tools were averaged without a third adjudicator or consensus. This was an intentional choice, intended to reflect variability in real‐world clinician judgment and to avoid artificially inflating or underestimating scores by requiring a binary consensus. The lower agreement for accuracy likely reflects both variability in clinical interpretation among clinician reviewers, individualized standards for patient‐facing information, and the design of the expert‐derived tool, which permits nuanced judgment rather than reliance on rigid checklist‐based criteria. Regardless of moderate to fair ICC, the average score remains clinically relevant, likely reflecting the true differences in clinical interpretation, which mimics real‐world utility of these tools. Importantly, this study did not account for or evaluate the rapidly evolving role of artificial intelligence–based platforms as a source of patient health information, which may be used increasingly in lieu of existing patient‐facing resources. Further, readability metrics, calculated using formulas that consider sentence length and word syllables, may have been skewed by the use of necessary clinical terminology. Finally, the evaluation excluded multimedia content and was limited to English‐language materials, thereby limiting the generalizability of our findings in a global context. Future work should evaluate resources in other major languages and across multimedia platforms, including video and social media, to better reflect global patient information access and help ensure the findings contribute to global menstrual health literacy. Moving forward, we plan to collaborate with resource authors to target content editing and updates, encourage platforms like Google to prioritize high‐quality results, and actively promote the high‐quality resources identified in this study among healthcare providers and societies, such as FIGO (including national professional organizations), as part of broader quality‐improvement efforts. In addition, we plan to evaluate the accuracy, safety, and readability of AI‐generated menstrual health content compared to these existing tools, and to understand how this increasingly accessed body of text will be used by patients. CONCLUSION Overall, although many resources were rated as moderately credible and clinically useful, few met readability standards, most lacked visual aids, and all had critical content omissions or inaccuracies. With a growing number of patients relying on health information to gain accurate information on this debilitating symptom, these gaps may contribute to delays in care and promote misinformation. From a quality improvement perspective, knowledge translation opportunities exist to create online content that is understandable and accurate. AUTHOR CONTRIBUTIONS OC, LC, and AM contributed to conceptualization, data analysis, writing, editing, and finalizing of the manuscript. LD, OS, SM, IM, JD, HC, LB, MM, CW, YH, MU, KM, and KK contributed to conceptualization, data analysis, and finalizing of the manuscript. FUNDING INFORMATION This research received no external funding. However, MU acknowledges support from the Gates Foundation and Hey Sister (Grant Recipient), and WHR Medical Centre (CRC‐Digital funded). CONFLICT OF INTEREST STATEMENT Some authors (AM) were involved in the development of the online patient information portal “gyneqi.com,” which is discussed in the study; however, the website evaluation was not performed by any individual directly involved to avoid potential bias. MU is CEO of the Bleed Better Initiative and a consultant for Hologic; reports receiving remunerated clinician education fees from Bayer, Orion, CSL Vifor, Seqirus, Besins, and Menarini; and serves as an Implanon trainer for Organon. She has received research equipment support from Lumicare and GE Healthcare, and research grants or site support from the Gates Foundation, Hey Sister, and WHR Medical Centre (University of Sydney). MU has received travel or registration support from Besins and Bayer; and has participated in sponsored media training or spokesperson roles for RANZCOG, Bayer, Organon, and Hologic. She serves as an ambassador for Heidi Health and Remie Australia, and as an advisor for Ovum AI and the Fidelius app. In addition, she reports receiving slide support from Lawley Pharmaceuticals and participating in clinical trials for Sphere EMP, Endozone, A‐PAM, and Digital Diaries. HC has received royalties from UpToDate for an article on abnormal uterine bleeding. HODC has also received clinical research support for laboratory consumables and staff from Bayer AG and has provided advisory board/consultancy advice (all paid to the Institution) for Bayer AG, PregLem SA, Gedeon Richter, Vifor Pharma UK Ltd., AbbVie Inc., Myovant Sciences GmbH, Theramex, Pharmacosmos, and BII (BioInnovation Institute), Copenhagen. The authors have no other conflicts of interest to declare. Supporting information Supplemental Table 1. The Quality Evaluation Scoring Tool (QUEST) used to assess the credibility of online patient health information. Supplemental Table 2. Web page quality assessment criteria used to evaluate online patient health information. Supplemental Table 3. Quality expert‐designed tool. Supplemental Table 4. Comprehensiveness and accuracy of key HMB domains across resources. Supplemental Table 5. Summary of resources endorsed by both expert clinicians. Supplemental Table 6. Readability of online resources on heavy menstrual bleeding. Supplemental Figure 1. Readability tool (FKGL). Abbreviation: FKGL, Fleisch–Kincaid Grade Level. Supplemental Figure 2. Comparison of (a) total credibility and (b) quality by source type. DATA AVAILABILITY STATEMENT Research data are not shared. REFERENCES Associated Data Supplementary Materials Supplemental Table 1. The Quality Evaluation Scoring Tool (QUEST) used to assess the credibility of online patient health information. Supplemental Table 2. Web page quality assessment criteria used to evaluate online patient health information. Supplemental Table 3. Quality expert‐designed tool. Supplemental Table 4. Comprehensiveness and accuracy of key HMB domains across resources. Supplemental Table 5. Summary of resources endorsed by both expert clinicians. Supplemental Table 6. Readability of online resources on heavy menstrual bleeding. Supplemental Figure 1. Readability tool (FKGL). Abbreviation: FKGL, Fleisch–Kincaid Grade Level. Supplemental Figure 2. Comparison of (a) total credibility and (b) quality by source type. Data Availability Statement Research data are not shared.