Is transcutaneous auricular vagus nerve stimulation effective and safe for primary insomnia? A PRISMA-compliant protocol for a systematic review and meta-analysis Authors: Ting Yang, Yunhuo Cai, Xingling Li, Lianqiang Fang, Hantong Hu, Jaspinder Kaur, Yung-Hsiang Chen, Yung-Hsiang Chen Published: 2024 ABSTRACT BackgroundInsomnia is a highly prevalent sleep disorder with substantial impacts on health and quality of life. Current treatment options have certain limitations, highlighting the need for novel therapeutic approaches. Transcutaneous auricular vagus nerve stimulation (ta-VNS) is gaining recognition as a promising non-invasive neuromodulation technique for treating insomnia, but its efficacy has not been systematically evaluated. Therefore, this protocol outlines the framework for a systematic review and meta-analysis designed to comprehensively assess the effectiveness and safety of ta-VNS in treating primary insomnia.MethodsA thorough literature search will be carried out in Embase, PubMed, the Cochrane Library, PsycINFO, AMED, PEDro, Wangfang database, Chinese National Knowledge Infrastructure, and Chinese BioMedical Literature Database, covering publications from their inception until December 31, 2024. Randomized controlled trials evaluating ta-VNS for primary insomnia in adults will be included. Two independent reviewers will screen studies, gather data, and evaluate the risk of bias based on the Cochrane RoB 2.0 tool. Meta-analyses will be conducted where appropriate, and the quality of evidence will be evaluated using GRADE. Subgroup and sensitivity analyses are planned.DiscussionThis systematic review and meta-analysis will deliver a thorough synthesis of existing evidence regarding the efficacy and safety of ta-VNS for insomnia, potentially informing clinical practice and future research directions.Trial registrationPROSPERO registration number: CRD42024529039. 1 Introduction Insomnia is a widespread sleep disorder involving problems with starting or sustaining sleep, waking up early in the morning, and resulting daytime functional impairments. Insomnia significantly impacts global health. A comprehensive review [1] highlights that around 10% of adults experience insomnia disorders, while an additional 20% deal with intermittent insomnia symptoms. Women, seniors, and those facing economic challenges are particularly susceptible to insomnia [1]. This condition tends to be long-lasting, with a 40% recurrence rate over five years [1]. A recent epidemiological study conducted in Norway highlights a substantial prevalence of insomnia, particularly among individuals with mental disorders. The study found that 61.3% of females with comorbid depression and 83.3% with comorbid schizophrenia reported insomnia [2]. These studies underscore the extensive burden of insomnia and its strong association with both mental and physical health conditions worldwide. Moreover, insomnia often persists chronically, following a pattern of relapse and remission [3]. As such, insomnia represents a major public health problem globally. The pathophysiology of insomnia involves a complex interplay of psychological, behavioral, and physiological factors that lead to hyperarousal and an inability to down-regulate wakefulness [4]. Current treatment approaches for insomnia include cognitive-behavioral therapy for insomnia (CBT-I) as first-line treatment [5], followed by pharmacological therapies such as benzodiazepines, non-benzodiazepine hypnotics, melatonin receptor agonists, and sedating antidepressants [6]. However, the efficacy of existing treatments remains suboptimal for many patients, with issues such as limited access to CBT-I, modest effect sizes, side effects, and concerns about long-term use of medications [5]. As a result, there is a clear need for novel therapeutic options for insomnia that are effective, safe, well-tolerated and easily accessible. Transcutaneous auricular vagus nerve stimulation (ta-VNS) is now recognized as a promising neuromodulation technique for a range of neurological and psychiatric conditions [7]. By delivering electrical stimulation to the auricular branch of the vagus nerve in the ear, ta-VNS can modulate brain activity in regions involved in autonomic function, emotion regulation, and cortical excitability [8]. Compared to implantable VNS, ta-VNS provides a noninvasive, convenient and low-risk alternative. ta-VNS has shown promising results in treating insomnia. In recent years, ta-VNS has become a potential non-invasive neuromodulation method for the treatment of insomnia, given its ability to modulate the autonomic nervous system and functional connectivity specific cortex between specific brain regions [9, 10]. Increasing clinical trials involving ta-VNS for treating insomnia have shown promising results. For instance, a randomized clinical trial [11] demonstrated that ta-VNS significantly improved sleep quality, reduced fatigue, and alleviated depression and anxiety symptoms in insomnia patients. Another study [12] found that ta-VNS significantly decreased the Pittsburgh Sleep Quality Index (PSQI) scores in participants with insomnia, highlighting its efficacy in improving sleep quality. Furthermore, Zhang et al. [13] reported that ta-VNS modulates brain functional connectivity of medial prefrontal cortex, which is crucial for sleep regulation, suggesting a potential mechanism for its effectiveness in treating primary insomnia. Notably, when compared to other non-invasive neuromodulation techniques like transcranial magnetic stimulation (TMS), which has been studied as a possible treatment for insomnia, ta-VNS presents several potential advantages. Unlike TMS, which requires specialized equipment and trained personnel, potentially limiting its accessibility, ta-VNS is more portable and allows for self-administration by patients at home after initial training, which could improve treatment adherence and lower healthcare costs. Additionally, ta-VNS has a more favorable side effect profile, with most reported adverse events being mild and transient. However, it should be noted that the evidence base for ta-VNS in insomnia treatment is still developing, and more large-scale, long-term studies are needed to fully establish its efficacy and safety profile relative to other neuromodulation techniques. To date, the effects of ta-VNS on insomnia have not been systematically evaluated. A comprehensive synthesis of the existing evidence is needed to 1) clarify whether ta-VNS is beneficial for insomnia; 2) quantify the magnitude of effects across studies; 3) characterize the safety of the intervention. Nonetheless, to date, no systematic review (SR) or meta-analysis of ta-VNS for insomnia has been conducted. Therefore, this proposed SR and meta-analysis aims to address this key knowledge gap by rigorously collating and analyzing all available data from randomized controlled trials (RCTs) of ta-VNS in insomnia. The timely synthesis of existing trial data will shed new light on the therapeutic potential of ta-VNS, accelerating progress towards evidence-based neuromodulation treatments for the millions suffering from insomnia worldwide. 2 Methods The reporting of this section adheres to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P) guidelines [14] to guarantee thorough and transparent reporting. 2.1 Protocol registration This SR and meta-analysis protocol has been pre-registered in the International Prospective Register of Systematic Reviews (PROSPERO) with the registration number CRD42024529039. 2.2 Eligibility criteria The eligibility criteria for study selection are carefully designed based on the PICOS (i.e., Populations, Interventions, Comparators, Outcomes, Study designs) framework. 2.2.1 Populations Eligible participants will be adult patients (minimum age of 18 years) clinically diagnosed with primary insomnia according to well-established diagnostic manuals, such as the Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition (DSM-IV) [15] or Fifth Edition (DSM-5) [16], and the Third version of the International Classification of Sleep Disorders (ICSD-3) [17]. Individuals whose insomnia is secondary to or comorbid with other physical health conditions such as pain or neurodegenerative diseases, will be excluded. 2.2.2 Interventions ta-VNS can be administered alone or together with the same therapy as the control group. There will be no restrictions on stimulation parameters, duration of ta-VNS, or treatment frequency. 2.2.3 Comparators Studies comparing ta-VNS with placebo, sham ta-VNS, no treatment, waitlist control, or other active treatments will be eligible for inclusion. 2.2.4 Outcomes (1) Primary outcome. Primary outcome is sleep quality, which can be assessed using self-reported scales known for their reliability and validity (e.g., the Insomnia Severity Index (ISI) [18], PSQI [19]). If available, objective sleep metrics, such as total sleep time and sleep efficiency (the ratio of time spent asleep to time spent in bed), will also be measured using sleep detection devices. (1) Primary outcome. Primary outcome is sleep quality, which can be assessed using self-reported scales known for their reliability and validity (e.g., the Insomnia Severity Index (ISI) [18], PSQI [19]). If available, objective sleep metrics, such as total sleep time and sleep efficiency (the ratio of time spent asleep to time spent in bed), will also be measured using sleep detection devices. (2) Secondary outcomes. 1) The proportion of recovered patients. It can be evaluated based on specified criteria, such as Sieigel’s Criteria or other measures categorizing patients’ recovery as complete, marked, slight, or none based on improved hearing in specified insomnia-related scales. (2) Secondary outcomes. 1) The proportion of recovered patients. It can be evaluated based on specified criteria, such as Sieigel’s Criteria or other measures categorizing patients’ recovery as complete, marked, slight, or none based on improved hearing in specified insomnia-related scales. 2) Psychological symptom severity. The severity of psychological symptoms, such as anxiety and depression, will be measured using standardized questionnaires. For instance, the Self-Assessment Anxiety Scale (SAS) [20] for evaluating the anxiety severity, and the Hamilton Depression Scale (HAMD) for evaluating the depression severity [21]. 2) Psychological symptom severity. The severity of psychological symptoms, such as anxiety and depression, will be measured using standardized questionnaires. For instance, the Self-Assessment Anxiety Scale (SAS) [20] for evaluating the anxiety severity, and the Hamilton Depression Scale (HAMD) for evaluating the depression severity [21]. 3) Quality of life. Quality of life can be assessed by validated and reliable questionnaires like the 36-Item Short Form Health Survey (SF-36) [22]. 3) Quality of life. Quality of life can be assessed by validated and reliable questionnaires like the 36-Item Short Form Health Survey (SF-36) [22]. 4) Adverse events associated with interventions. The number of adverse events (AEs) linked to the interventions will be evaluated. 4) Adverse events associated with interventions. The number of adverse events (AEs) linked to the interventions will be evaluated. 2.2.5 Study designs Only RCTs will be considered eligible study designs. Additionally, we will only accept studies with at least 20 participants per group, as this is widely recognized as the minimum for meaningful statistical analysis in clinical trials. The language of publication will be limited to English and Chinese. Non-RCTs, cohort studies, case reports, and other observational studies without a control group will be excluded. 2.3 Literature search strategy A thorough search for literature will be performed in these bibliographic databases: Embase, PubMed, the Cochrane Library, PsycINFO, AMED, PEDro, Wangfang database, Chinese National Knowledge Infrastructure, and Chinese BioMedical Literature Database, covering publications from their inception until December 31, 2024. The search strategy will combine MeSH terms and free-text words related to "transcutaneous auricular vagus nerve stimulation," "ta-VNS," "insomnia," and "sleep disorders." Additionally, using the snowballing method for literature search, we will manually the reference lists of pertinent review articles on this topic. Table 1 contains the search strategy used in PubMed. To ensure a comprehensive search across all databases, we have made specific adjustments to other databases’ search strategy. For instance, in English databases, we have expanded our search to include not only the subject headings "insomnia" but also related terms (e.g., "sleep disorder" "difficulty sleeping", "trouble sleeping") in both the title and abstract fields. This approach allows us to identify studies that use various terminologies to describe insomnia, thereby enhancing the sensitivity of our search. In the Chinese databases (Wangfang, CNKI, and CBM), we used Chinese terms equivalent to ’insomnia’, ’sleep disorder’, and various forms of ’vagus nerve stimulation’ to ensure we capture all relevant Chinese literature. These strategies are designed to be as inclusive as possible while maintaining specificity to our research question. The detailed search strategies for the remaining databases are uploaded in the S1 and S2 Files. 10.1371/journal.pone.0313101.t001Table 1Search strategy in PubMed.No.Search items#1Randomized controlled trial [Publication type]#2Controlled clinical trial [Publication type]#3Randomized OR Randomised [Title/Abstract]#4Clinical trials [MeSH]#5Randomly [Title/Abstract]#6Trial [Title/Abstract]#7#1 OR #2 OR #3 OR #4 OR #5 OR #6#8Humans [MeSH]#9#7 AND #8#10Insomnia [MeSH]#11insomnia OR sleep disorder OR difficulty sleeping OR trouble sleeping [Title/Abstract]#12#10 OR #11#13"taVNS"[Title/Abstract] OR "ta-VNS"[Title/Abstract] OR "VNS"[Title/Abstract]#14("vagus nerve"[MeSH] OR "vagus nerve"[Title/Abstract] OR "vagus"[Title/Abstract] OR "vagal"[Title/Abstract]) AND "stimulation"[Title/Abstract] AND "transcutaneous"[Title/Abstract]#15#13 OR #14#16#9 AND #12 AND #15 Search strategy in PubMed. Moreover, an add-on search for ongoing or unpublished trials will be undertaken by comprehensively searching a total of 5 major clinical trial registries as follows: International Clinical Trial Registration Platform, ClinicalTrials.gov registry, Australian New Zealand Clinical Trials Registry, Chinese Clinical Trial Registry, ISRCTN registry. 2.4 Study screening and data collection The titles and abstracts of the retrieved articles will be independently screened by two reviewers. Subsequently, they will read the full texts of potentially qualified studies to determine study selection. Disputes will be settled by consulting a third referee. Data from the included RCTs will be collected into a standardized form, which records study characteristics (e.g., authors, country, year of publication), patient characteristics (e.g., sex, mean age, diagnostic criteria for insomnia), intervention details (e.g., stimulation parameters of ta-VNS, treatment duration), comparator details, outcomes, and adverse events. The PRISMA flowchart (Fig 1) presents the procedure for study selection in details. Flow diagram of study selection. 2.5 Risk of bias assessment Two raters will independently appraise the methodological quality of enrolled studies via the Cochrane risk of bias 2.0 tool [23]. This tool assesses five key items: the randomization process, deviations from intended interventions, missing outcome data, outcome measurement, and the selection of the reported result. Every item will be evaluated and categorized as having a low risk of bias, some concerns, or a high risk of bias. The overall risk of bias for each study will then be appraised by considering the evaluations of these individual domains. In cases of disagreement between raters, a consensus will be reached through discussion. If consensus cannot be achieved, a third reviewer will be consulted to make the final decision. 2.6 Heterogeneity analysis of and data synthesis Cochran’s Q test and the I2 statistic will be utilized to appraise statistical heterogeneity. Nevertheless, the decision to pool these studies will also consider clinical heterogeneity. Key clinical characteristics that will be considered when assessing clinical heterogeneity include patient demographics (e.g., age, gender), insomnia severity and duration, comorbid conditions, and specific ta-VNS protocols (e.g., stimulation parameters, treatment duration). If studies are judged to be too clinically heterogeneous to produce meaningful summary effect estimates when pooled, we will not perform meta-analysis, even if there is no significant statistical heterogeneity. In such instances, a descriptive qualitative synthesis will be performed instead. If studies are found to be adequately homogeneous both clinically and statistically for performing meta-analysis, we will employ a fixed-effect model if the P-value from the Q test is greater than 0.10 and the I2 value is 50% or less [24]. Should the p-value be less than 0.10 and the I2 value exceed 50%, we will adopt a random-effect model. Data synthesis for the meta-analysis will be undertaken via RevMan version 5.4.1. 2.7 Subgroup and sensitivity analyses If substantial heterogeneity is present, we will explore potential sources through subgroup analyses based on different participant characteristics, stimulation parameters, comparator interventions, and time points for primary outcomes. Sensitivity analyses will be conducted by excluding studies identified as having a high risk of bias. 2.8 Safety evaluation The safety assessment of ta-VNS versus control interventions will involve pooling the number of AEs from the original studies through a meta-analytic approach. 2.9 Publication bias assessment Funnel plots and Egger’s test will be employed to evaluate publication bias, provided that the analysis includes a minimum of ten studies [25]. 2.10 Evaluating the quality of evidence The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) methodology will be utilized to evaluate the quality of evidence for each outcome [26]. This methodology takes into account several criteria, including imprecision, inconsistency of findings, indirectness of evidence, study limitations, and publication bias. According to these factors, the quality of evidence could be categorized as high, moderate, low, or very low. 3 Discussion Insomnia is a common sleep disorder that can greatly affect an individual’s quality of life, cognitive abilities, and mental well-being [27]. Current treatment options for insomnia, such as cognitive-behavioral therapy and pharmacological interventions, have limitations in terms of accessibility, adherence, and potential side effects [5]. ta-VNS has become an encouraging neuromodulation approach for treating insomnia. Regarding the therapeutic mechanisms of ta-VNS in treating insomnia, it is mainly linked to the modulation of autonomic nervous system function and brain activity in specific cortex or brain networks. For instance, a study [28] discovered that ta-VNS significantly altered the functional activity within the sensorimotor network and autonomic regulation, suggesting that these changes contribute to its efficacy in the treatment of insomnia [28]. Another study [13] indicated that ta-VNS decreases the functional connectivity (FC) between the medial prefrontal cortex (mPFC) and other brain cortices, including the dorsal anterior cingulate gyrus and the occipital cortex. This reduction in FC was correlated with improvements in sleep quality, indicating that ta-VNS helps regulate the default mode network and its interactions with other brain networks critical for sleep maintenance. In recent years, the number of RCTs investigating the efficacy and safety of ta-VNS is increasing [11, 12]. Nonetheless, based on literature search, no systematic reviews or meta-analysis of ta-VNS for insomnia has been undertaken so far. The timely synthesis of current trial data will provide fresh insights into the therapeutic potential of ta-VNS, advancing the development of evidence-based neuromodulation treatments for the millions affected by insomnia globally. Consequently, this protocol outlines the framework for a subsequent SR and meta-analysis designed to comprehensive evaluate the therapeutic effect and safety of ta-VNS for the treatment of insomnia. While this meta protocol does not present final results of meta-analyses, we anticipate that our primary efficacy outcomes will focus on changes in validated insomnia scales (such as the ISI or PSQI) and objective sleep parameters (such as total sleep time and sleep efficiency) following ta-VNS treatment. We expect to conduct meta-analyses on these outcomes, which will provide quantitative estimates of the overall effect of ta-VNS on insomnia symptoms. These findings will be crucial in determining the clinical significance of ta-VNS as a treatment for insomnia. Therefore, this SR and meta-analysis will yield findings that are significant for clinical practice and research. If ta-VNS is found to be beneficial and safe for the treatment of insomnia, it could provide a valuable alternative or complementary therapy for patients who do not respond to or cannot tolerate conventional treatments. The results may also guide future research by identifying optimal stimulation parameters and treatment durations, as well as highlighting potential subgroups of patients who may benefit most from ta-VNS. Apart from its innovative nature as the first SR and meta-analysis on this topic, the strengths of this research include the use of a rigorous methodology, adherence to PRISMA guidelines, and a comprehensive search strategy encompassing multiple databases and clinical trial registries. The inclusion of RCTs ensures a high level of evidence, and the assessment of risk of bias and quality of evidence using well-established tools (RoB 2 and GRADE) enhances the reliability and transparency of our findings. 3.1 Limitations First, the general quality of evidence may be impacted by factors such as small sample sizes in individual studies and potential risk of bias. Therefore, we will consider studies with a minimum sample size of 20 participants per group as acceptable, as this is generally considered the lower limit for meaningful statistical analysis in clinical trials. We also recognize the need for future studies to include long-term follow-up assessments. The current literature on ta-VNS for insomnia predominantly focuses on short-term outcomes, and there is a lack of data on the sustained effects and long-term safety of this intervention. This limitation highlights an important area for future research to address. Second, since the members of the review group are only proficient in English and Chinese and are unable to afford translation costs for other languages, this study includes only RCTs published in English and Chinese, which may result in potential language bias. Third, potential limitations may arise from the heterogeneity of the included studies in terms of participant characteristics, stimulation parameters, and comparator interventions. If available, subgroup and sensitivity analyses will be employed to resolve these issues and offer a more comprehensive perspective on the efficacy of ta-VNS for insomnia. 4 Conclusions In conclusion, this planned SR and meta-analysis will provide a comprehensive evaluation of the efficacy and safety of ta-VNS for the treatment of insomnia. The findings will contribute to the growing body of evidence on non-invasive neuromodulation methods for sleep disorders and inform clinical decision-making and future research directions. Supporting information PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) 2015 checklist: Recommended items to address in a systematic review protocol. (PDF) Search strategies in other databases. (PDF) 12 Aug 2024 PONE-D-24-23880Is transcutaneous auricular vagus nerve stimulation effective and safe for primary insomnia? A PRISMA-compliant protocol for a systematic review and meta-analysisPLOS ONE Dear Dr. Hu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Sep 22 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jaspinder Kaur, MD Academic Editor PLOS ONE Journal requirements: 1. When submitting your revision, we need you to address these additional requirements. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf. 2. When completing the data availability statement of the submission form, you indicated that you will make your data available on acceptance. We strongly recommend all authors decide on a data sharing plan before acceptance, as the process can be lengthy and hold up publication timelines. Please note that, though access restrictions are acceptable now, your entire data will need to be made freely accessible if your manuscript is accepted for publication. This policy applies to all data except where public deposition would breach compliance with the protocol approved by your research ethics board. If you are unable to adhere to our open data policy, please kindly revise your statement to explain your reasoning and we will seek the editor's input on an exemption. Please be assured that, once you have provided your new statement, the assessment of your exemption will not hold up the peer review process. 3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions? The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses? The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable? Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors described where all data underlying the findings will be made available when the study is complete? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics. You may also provide optional suggestions and comments to authors that they might find helpful in planning their study. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for the opportunity to review this manuscript. I would like to commend the authors for their thorough investigation into the efficacy and safety of transcutaneous auricular vagus nerve stimulation (ta-VNS) for primary insomnia through a systematic review and meta-analysis. I have the following comments: 1. While the Introduction mentions ta-VNS as a noninvasive alternative to implantable VNS, it doesn't offer a detailed comparison with other non-invasive treatments for insomnia. Consider including a comparative analysis of ta-VNS with other non-invasive neuromodulation techniques such as transcranial magnetic stimulation (TMS) which has been explored as a pontential treatment for insomnia, while still a relatively novel approach some studies have shown promising results. If possible, highlight the advantages and potential limitations of ta-VNS compared to these treatments. 2. In section 2.3 Literature Search Strategy: It would be helpful to add a brief summary or highlight the key points from the search strategies of other databases within the main text. This summary could mention any unique adjustments made for specific databases and ensure that readers understand the comprehensiveness of the search strategy without referring to the supplementary file. 3. In Section: 2.5 Risk of Bias Assessment: The manuscript outlines the use of the Cochrane risk of bias 2.0 tool effectively. However, it could benefit from a brief mention of how disagreements between raters will be handled. 4. In Section: 2.6 Heterogeneity Analysis and Data Synthesis : Please add a brief sentence specifying some key clinical characteristics that will be considered when assessing clinical heterogeneity. 5. The Discussion provides a good foundation for the rationale and anticipated impact of the study, but could benefit from adding a clear and concise summary of the primary efficacy outcomes or any significant statistical findings derived from the meta-analysis. 6. In the Limitations section please specify the minimum sample size considered acceptable. 7. In the Limitation section Consider highlighting the need for future studies to include long-term follow-up to better understand the sustained effects and safety of ta-VNS. Reviewer #2: I would like to congratulate the authors for their work and study design. The methodology is sound and adheres to high standards. The protocol is well written. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Mohsin Raza Reviewer #2: Yes: Abbas Alshami ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. 8 Oct 2024 Point-by-point response to Reviewer 1's Comments 1.While the Introduction mentions ta-VNS as a noninvasive alternative to implantable VNS, it doesn't offer a detailed comparison with other non-invasive treatments for insomnia. Consider including a comparative analysis of ta-VNS with other non-invasive neuromodulation techniques such as transcranial magnetic stimulation (TMS) which has been explored as a pontential treatment for insomnia, while still a relatively novel approach some studies have shown promising results. If possible, highlight the advantages and potential limitations of ta-VNS compared to these treatments. Response: Thank you for this insightful comment. We have addressed this by adding a comparative analysis of ta-VNS with transcranial magnetic stimulation (TMS) in the revised Introduction section (page 4, lines 104-114 in the clean version of the revised manuscipt; or you can directly check the revised manuscript with tracked changes) . We have highlighted the potential advantages of ta-VNS, such as its portability and potential for self-administration, as well as its favorable side effect profile. We have acknowledged that the evidence base for ta-VNS is still developing and that more research is needed to fully establish its comparative efficacy and safety. This addition provides a more comprehensive context for the potential of ta-VNS as a treatment for insomnia. For your earliest convenience, you can read the corresponding revisions in the revised manuscript (page 8, lines 197-198) as follows: “Notably, when compared to other non-invasive neuromodulation techniques like transcranial magnetic stimulation (TMS), which has been studied as a possible treatment for insomnia, ta-VNS presents several potential advantages. Unlike TMS, which requires specialized equipment and trained personnel, potentially limiting its accessibility, ta-VNS is more portable and allows for self-administration by patients at home after initial training, which could improve treatment adherence and lower healthcare costs. Additionally, ta-VNS has a more favorable side effect profile, with most reported adverse events being mild and transient. However, it should be noted that the evidence base for ta-VNS in insomnia treatment is still developing, and more large-scale, long-term studies are needed to fully establish its efficacy and safety profile relative to other neuromodulation techniques.” 2. In section 2.3 Literature Search Strategy: It would be helpful to add a brief summary or highlight the key points from the search strategies of other databases within the main text. This summary could mention any unique adjustments made for specific databases and ensure that readers understand the comprehensiveness of the search strategy without referring to the supplementary file. Response: We appreciate this suggestion to improve the clarity and comprehensiveness of our search strategy description. We have added a brief summary in the main text that highlights key points from the search strategies for other databases. This summary mentions specific adjustments made for the remaining English databases and the Chinese databases (Wangfang, CNKI, and CBM). This addition provides readers with a clear understanding of our comprehensive approach without needing to refer to the supplementary file For your earliest convenience, you can read the corresponding revisions in the revised manuscript (pages 7-8; lines 200-211 in the clean version of the revised manuscipt; or you can directly check the revised manuscript with tracked changes) as follows: “Table 1 contains the search strategy used in PubMed. To ensure a comprehensive search across all databases, we have made specific adjustments to other databases’ search strategy. For instance, in English databases, we have expanded our search to include not only the subject headings "insomnia" but also related terms (e.g., "sleep disorder" "difficulty sleeping", "trouble sleeping") in both the title and abstract fields. This approach allows us to identify studies that use various terminologies to describe insomnia, thereby enhancing the sensitivity of our search. In the Chinese databases (Wangfang, CNKI, and CBM), we used Chinese terms equivalent to 'insomnia', 'sleep disorder', and various forms of 'vagus nerve stimulation' to ensure we capture all relevant Chinese literature. These strategies are designed to be as inclusive as possible while maintaining specificity to our research question.” 3. In Section: 2.5 Risk of Bias Assessment: The manuscript outlines the use of the Cochrane risk of bias 2.0 tool effectively. However, it could benefit from a brief mention of how disagreements between raters will be handled. Response: Thank you for pointing out this oversight. We have added some sentences in the revised manuscript (page 8, lines 237-239) to address how disagreements between raters will be handled. Specifically, we have stated that in cases of disagreement, consensus will be reached through discussion, and if consensus cannot be achieved, a third reviewer will be consulted to make the final decision. This addition ensures transparency in our methodology for risk of bias assessment. 4.In Section: 2.6 Heterogeneity Analysis and Data Synthesis: Please add a brief sentence specifying some key clinical characteristics that will be considered when assessing clinical heterogeneity. Response: We appreciate this suggestion to provide more detail on our heterogeneity assessment. In the revised manuscript, we have added a sentence specifying key clinical characteristics that will be considered when assessing clinical heterogeneity. These include patient demographics (e.g., age, gender), insomnia severity and duration, comorbid conditions, specific ta-VNS protocols (e.g., stimulation parameters, treatment duration), and outcome measures used. This addition provides readers with a clearer understanding of how we will evaluate clinical heterogeneity across studies. For your earliest convenience, you can read the corresponding revisions in the revised manuscript (page 9, lines 243-247) as follows: “Nevertheless, the decision to pool these studies will also consider clinical heterogeneity., including variations in patient baseline characteristics and ta-VNS treatment protocols across the included RCTs. Key clinical characteristics that will be considered when assessing clinical heterogeneity include patient demographics (e.g., age, gender), insomnia severity and duration, comorbid conditions, and specific ta-VNS protocols (e.g., stimulation parameters, treatment duration).” 5.The Discussion provides a good foundation for the rationale and anticipated impact of the study but could benefit from adding a clear and concise summary of the primary efficacy outcomes or any significant statistical findings derived from the meta-analysis. Response: Thank you for this suggestion to enhance the Discussion section. We have added a paragraph that outlines our anticipated primary efficacy outcomes, focusing on changes in validated insomnia scales and objective sleep parameters. We have explained that we expect to conduct meta-analyses on these outcomes to provide quantitative estimates of the overall effect of ta-VNS on insomnia symptoms. We have also emphasized the importance of these findings in determining the clinical significance of ta-VNS as a treatment for insomnia. This addition provides a clearer picture of the expected outcomes and their potential impact. For your earliest convenience, you can read the corresponding revisions in the revised manuscript (page 11, lines 301-316) as follows: “Consequently, this protocol outlines the framework for a subsequent SR and meta-analysis designed to comprehensive evaluate the therapeutic effect and safety of ta-VNS for the treatment of insomnia. While this meta protocol does not present final results of meta-analyses, we anticipate that our primary efficacy outcomes will focus on changes in validated insomnia scales (such as the ISI or PSQI) and objective sleep parameters (such as total sleep time and sleep efficiency) following ta-VNS treatment. We expect to conduct meta-analyses on these outcomes, which will provide quantitative estimates of the overall effect of ta-VNS on insomnia symptoms. These findings will be crucial in determining the clinical significance of ta-VNS as a treatment for insomnia. Therefore, this SR and meta-analysis will yield findings that are significant for clinical practice and research. If ta-VNS is found to be beneficial and safe for the treatment of insomnia, it could provide a valuable alternative or complementary therapy for patients who do not respond to or cannot tolerate conventional treatments. The results may also guide future research by identifying optimal stimulation parameters and treatment durations, as well as highlighting potential subgroups of patients who may benefit most from ta-VNS.” 6.In the Limitations section please specify the minimum sample size considered acceptable. Response: We appreciate this suggestion to provide more specificity in our Limitations section. We have added a sentence stating that we will consider studies with a minimum sample size of 20 participants per group as acceptable. We have explained that this is generally considered the lower limit for meaningful statistical analysis in clinical trials, while acknowledging that larger sample sizes would provide more robust evidence. This addition provides clarity on our criteria for study inclusion and the potential limitations of smaller studies. 7.In the Limitation section Consider highlighting the need for future studies to include long-term follow-up to better understand the sustained effects and safety of ta-VNS. Response: Thank you for this important suggestion. We have added a paragraph in the Limitations section (page 11-12, lines 326-333) highlighting the need for future studies to include long-term follow-up assessments. We have acknowledged that the current literature on ta-VNS for insomnia predominantly focuses on short-term outcomes, and there is a lack of data on the sustained effects and long-term safety of this intervention. We have emphasized that this limitation highlights an important area for future research to address. This addition provides a more comprehensive discussion of the current limitations in the field and directions for future research. For your earliest convenience, you can read the corresponding revisions in the revised manuscript as follows: “First, the general quality of evidence may be impacted by factors such as small sample sizes in individual studies and potential risk of bias. Therefore, we will consider studies with a minimum sample size of 20 participants per group as acceptable, as this is generally considered the lower limit for meaningful statistical analysis in clinical trials. We also recognize the need for future studies to include long-term follow-up assessments. The current literature on ta-VNS for insomnia predominantly focuses on short-term outcomes, and there is a lack of data on the sustained effects and long-term safety of this intervention. This limitation highlights an important area for future research to address.” Point-by-point response to Reviewer 2's Comments 1. I would like to congratulate the authors for their work and study design. The methodology is sound and adheres to high standards. The protocol is well written. Response: We are deeply grateful for your positive and encouraging comments on our study protocol. We have put considerable effort into developing a robust methodology that adheres to high standards in systematic review protocols, and we are pleased that this is reflected in our writing. Your feedback affirms that we are on the right track with our approach. It motivates us to maintain this level of rigor throughout the execution of our systematic review and meta-analysis. We believe that a well-designed protocol is crucial for conducting a high-quality systematic review, and your comments reassure us that we have laid a strong foundation for our future study. ---------------------- We hope that our revisions and explanations adequately address the reviewers' insightful comments. Thank you again for considering our manuscript and providing such thoughtful feedback to improve the work. Yours Sincerely, Hantong Hu, M.D 18 Oct 2024 Is transcutaneous auricular vagus nerve stimulation effective and safe for primary insomnia? A PRISMA-compliant protocol for a systematic review and meta-analysis PONE-D-24-23880R1 Dear Dr. Hu, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Yung-Hsiang Chen, Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Congratulations on the acceptance of your manuscript, and thank you for your interest in submitting your work to PLOS ONE. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Does the manuscript provide a valid rationale for the proposed study, with clearly identified and justified research questions? The research question outlined is expected to address a valid academic problem or topic and contribute to the base of knowledge in the field. Reviewer #1: Yes ********** 2. Is the protocol technically sound and planned in a manner that will lead to a meaningful outcome and allow testing the stated hypotheses? The manuscript should describe the methods in sufficient detail to prevent undisclosed flexibility in the experimental procedure or analysis pipeline, including sufficient outcome-neutral conditions (e.g. necessary controls, absence of floor or ceiling effects) to test the proposed hypotheses and a statistical power analysis where applicable. As there may be aspects of the methodology and analysis which can only be refined once the work is undertaken, authors should outline potential assumptions and explicitly describe what aspects of the proposed analyses, if any, are exploratory. Reviewer #1: Yes ********** 3. Is the methodology feasible and described in sufficient detail to allow the work to be replicable? Descriptions of methods and materials in the protocol should be reported in sufficient detail for another researcher to reproduce all experiments and analyses. The protocol should describe the appropriate controls, sample size calculations, and replication needed to ensure that the data are robust and reproducible. Reviewer #1: Yes ********** 4. Have the authors described where all data underlying the findings will be made available when the study is complete? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception, at the time of publication. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above and, if applicable, provide comments about issues authors must address before this protocol can be accepted for publication. You may also include additional comments for the author, including concerns about research or publication ethics. You may also provide optional suggestions and comments to authors that they might find helpful in planning their study. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: After reviewing both the original and revised manuscripts, I am satisfied that the authors have thoroughly addressed all the key points raised. They have successfully incorporated a comparative analysis of ta-VNS with other non-invasive treatments, improved the clarity of the literature search strategy, and included details on risk of bias and clinical heterogeneity. The discussion now offers a clearer focus on primary outcomes, and the limitations section appropriately covers sample size considerations and the need for long-term follow-up. Overall, the revisions align well with the feedback provided ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Mohsin Raza ********** 29 Oct 2024 PONE-D-24-23880R1 PLOS ONE Dear Dr. Hu, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Yung-Hsiang Chen Academic Editor PLOS ONE