Developing a mobile application for gender‐affirming voice training: A community‐engaged approach Authors: Isaac L Alter, Keith A Chadwick, Katerina Andreadis, Rachel Coleman, Mary Pitti, Jerel M Ezell, Anaïs Rameau Published: 2024 ABSTRACT AbstractObjectivesTo date, there has yet to be a rigorous exploration of voice and communication modification training (VCMT) among transgender and gender‐nonconforming (TGNC) individuals using digital technology. We sought to evaluate and describe the iterative process of app development using a community‐based approach.MethodsAn interprofessional team of voice health care professionals, application developers, designers, and TGNC community members was assembled to conceive the functionality, content, and design of a mobile app to support VCMT for TGNC people. Six TGNC individuals, identified primarily by word of mouth, joined the development team as a Community Advisory Board (CAB). The CAB provided input on app content development, design choices, and user experience, with collaboration across disciplines and integration of TGNC community members throughout app development; the applicability of CBPR principles was evaluated throughout the development process.ResultsIterative cycles of content creation and feedback produced multiple substantial changes during the app's development, including added functionality, improved inclusivity and accessibility, and design and branding enhancements. Several successful outcomes from our approach were identified, including the recruitment of dedicated CAB members and interprofessional collaboration that included community members. Challenges included integration of multiple different approaches and levels of expertise, navigating TGNC individuals' participation without exploitation, and creating high‐quality content on a limited budget.ConclusionsOur process demonstrates the value of including a CAB in the design of a digital VCMT platform, and suggests a potential for community‐based participatory research (CBPR) in laryngology and speech language pathology, where uptake of this framework has remained limited.Level of EvidenceLevel 5.Keywords: communication modification, community‐based participatory research, gender‐affirming voice, mobile application development, speech language pathology, transgender voice INTRODUCTION Transgender and gender‐nonconforming (TGNC) people are individuals whose gender does not align with the sex they were assigned at birth. 1 A striking majority—as many as 96%—of TGNC individuals have experienced voice‐gender incongruence, which refers to self‐perceived discordance between one's gender and the perceived gender of one's voice. 2 Research has demonstrated the importance of voice in TGNC individuals' gender identity 3 and has highlighted the intricate effects of perceived voice masculinity or femininity on TGNC individuals' quality of life, with voice and gender congruence markedly improving measures of well‐being. 4 , 5 To this end, gender‐affirming voice and communication modification training (VCMT) has been introduced as a potential intervention for TGNC individuals seeking alteration of their voices. VCMT has been repeatedly demonstrated to be effective for TGNC people in improving both objective measures (such as pitch) and patient‐reported satisfaction with their voice, in combination (if desired) with hormone therapy and/or surgical interventions. 6 , 7 , 8 , 9 , 10 Notably, although differences in pitch are most commonly associated with perceived gender of the voice, many other factors—including syntax, word choice, and resonance, cultural associations, racial biases, and listener assumptions—affect perceived masculinity or femininity. 11 , 12 , 13 This highlights the importance of evidence‐based VCMT rather than simple pitch raising or lowering to improve voice‐gender congruence. However, TGNC individuals face barriers to health care at significantly higher rates than the general population. 14 This includes extremely limited access to gender‐affirming VCMT for many, despite the fact that nearly 70% of TGNC individuals would like to receive gender‐affirming voice care, 15 , 16 and access may be further diminished among racial minorities and possibly other intersectional identities. 17 Given the proven efficacy of VCMT, and the high demand among TGNC individuals, lessening barriers to this treatment should be a primary priority for voice care providers. One potential way to accomplish this could be to capitalize on the expansion of telehealth in voice and communication practice, leveraging technology to better reach individuals seeking care. However, considering the perspectives of TGNC individuals is extremely important when creating such treatment programs, as a one‐size‐fits‐all approach designed solely by clinicians may not address the actual needs and goals of individuals in the community. Community‐based participatory research (CBPR) is an important framework employed extensively in many fields but sparingly in otolaryngology. CBPR is designed to use equitable collaboration between researchers and individuals in a target research population to reduce health disparities and improve outcomes, especially among minoritized communities (e.g., racial/ethnic minorities, sexual and gender minorities, people with mental illness, substance use disorders, disabilities, etc.). 18 , 19 , 20 CBPR emphasizes involvement of community members in research through each phase of the process, including conception of study aims, data collection, and interpretation and dissemination of findings, to maximize benefits and minimize harms to the communities being studied. In otolaryngology, uptake of CBPR has remained extremely limited, with few peer‐reviewed articles utilizing CBPR concepts or strategies to reduce disparities in hearing health 21 , 22 or assessing attitudes toward the deaf community among medical providers. 23 , 24 However, there are essentially no other examples of the use of CBPR in the field. CBPR has been employed extensively in researching the needs of the LGBTQ+ community. 25 However, many studies using a CBPR approach include transgender individuals solely as members of the broader LGBTQ+ community, 26 , 27 not addressing the unique needs of the TGNC community as potentially distinct from LGB individuals. Furthermore, CBPR studies that focus specifically on the TGNC community often address only sexual health and prevention of sexually transmitted infections (STIs), 28 , 29 leaving the many other sources of marginalization and poor health outcomes in this community understudied, including higher prevalence of mental health disorders, increased experiences of violence, reduced rates of health insurance, and profound stigmatization, to name just a few. 30 , 31 , 32 Given that prior work with transgender individuals has been largely extractive and lacking collaboration with the community, 30 , 33 , 34 CBPR could prove uniquely valuable to strengthen inclusivity of studies to better serve this population, which currently numbers at 1.6 million Americans, though this is likely an underestimation. 35 Recent studies have begun to fill this gap. Ehlinger et al. used a CBPR approach to examine experiences of discrimination among TGNC college students, and these experiences' intersection with alcohol use. 36 In addition, Strang et al. developed a clinical model for treating neurodiverse TGNC adolescents, in collaboration with a group of these adolescents and their families. 37 Each of these studies primarily used qualitative, interview‐based methods to assess needs of community members and other stakeholders. However, to date, no studies have used a CBPR approach to assess needs and preferences for gender‐affirming VCMT among TGNC individuals. CBPR has been shown to increase engagement and satisfaction in the development of telehealth‐ and digital application (app)‐based interventions. 38 , 39 Furthermore, studies have suggested that CBPR approaches can be more cost‐effective than traditional experimental methods, which is of particular relevance for projects with substantial initial costs, including app development and alpha/beta testing. 40 A related but distinct concept is that of a community advisory board (CAB), which consists of members of a community who are consulted for their perspectives to tailor research and interventions that are most likely to benefit other community members. 41 Of note, a CAB can be employed in CBPR, but can also prove invaluable in the design of products or health interventions before formal research is undertaken, and is often used as a stepping‐stone to CBPR projects. 42 , 43 , 44 In the realm of mobile apps and other digital tools, a CAB falls within an approach known as user‐centered design (UCD), which has been shown repeatedly to have positive effects on not only the design process but also the ultimate final product. 45 The use of CABs also remains extremely limited in otolaryngology and speech language pathology, with very few studies published using this methodology. 46 , 47 Given the demonstrated efficacy and productivity of CBPR and UCD in digital health—and in limited studies collaborating with TGNC individuals—we seek to lessen barriers to gender‐affirming VCMT using a free mobile app; as a first step in this effort, we aimed to develop this app in collaboration with a community advisory board (CAB) comprised of TGNC individuals, with a goal of undertaking CBPR using the app in future endeavors. Our team has developed an open‐access mobile application— “Attuned”—for gender‐affirming VCMT, using evidence‐based treatment and standard‐of‐care practices. In this article, we describe the iterative process of app development with an interprofessional team including a TGNC CAB. METHODS This manuscript does not describe human subjects research and was deemed exempt by the Weill Cornell Medicine Institutional Review Board (24‐02027136‐01). An interprofessional team was assembled—including two laryngologists (A.R., K.A.C.), two speech language pathologists (SLPs) (M.P., R.C.), and one research coordinator (K.A.), as well as several application developers and designers, and six TGNC individuals—with the goal of designing and building a mobile application to provide gender‐affirming voice care for TGNC. A.R. is a fellowship‐trained laryngologist at the Sean Parker Institute for the Voice at the Weill Cornell Medical College, who completed her training at Stanford University and then at University of California, Davis. She is a cisgender member of the LGBTQ+ community and an ally of the TGNC community. K.A.C. is a fellowship‐trained laryngologist at Stony Brook Medicine specializing in LGBTQ+ care, who trained at Oregon Health & Science University and then at the Sean Parker Institute for the Voice. He is a cisgender member of the LGBTQ+ community and an ally of TGNC people. M.P. is an SLP who trained at Ithaca College and later returned to direct the speech language pathology clinic at the same institution. She is a cisgender woman and an LGBTQ+ ally. R.C. is a voice‐specialized SLP, focusing on care of the professional voice and gender‐affirming voice care (among other clinical specializations) at the Sean Parker Institute for the Voice who trained at the Massachusetts General Hospital Voice Center. She is a cisgender woman and an ally to the LGBTQ+ community. All four of these members of the team underwent cultural humility training prior to beginning the development process. TGNC individuals on the development team were identified via word‐of‐mouth; some initial TGNC team members had completed in‐person gender‐affirming VCMT with one of the co‐authors (M.P.). A member of the graphic design team was also a member of the TGNC community, and they reached out to several TGNC friends and colleagues, some of whom agreed to join the development team. The development process began in September 2018, with identification of collaborators for the project, and the initial development period ended in January 2021. The team was primarily based in New York City, with additional contributors from Ithaca, New York. The six TGNC individuals, who hailed from across the country, including rural Midwest and Northeast and urban Pacific Northwest settings, attended weekly virtual meetings with the rest of the development team, contributing to overall discussions regarding the direction of the application and the goals of the project. In an effort to accommodate all team members' schedules across multiple time zones, meeting times were carefully selected, and agendas were shared in advance to ensure full participation. Following each meeting, notes were distributed to keep the entire team aligned and informed. CAB members were also involved in testing the application, previewing video content, and editing and approving language for inclusion in the application, as a crucial part of the effort by the entire development team to maximize utility for the TGNC community and minimize potential harm. This iterative process is summarized visually in Figure 1. A schematic describing the iterative approach to development of the Attuned app and its content. Figure 2 describes the timeline of app development from inception to finalization of a pilot version of the app for further testing; TGNC community members were involved in each step following the receipt of grant funding in May 2019. Timeline of team assembly and application development. RESULTS Content was iterated with community member feedback in several phases, including the initial written script and the eventual production into instructional videos. The two SLPs on the interprofessional team (M.P., R.C.) were the primary authors of this content, which were reviewed for both content and language by TGNC team members; in this way, content was steered toward the requests and interests of community members while also ensuring that language was both accurate and nonoffensive, helping to remove unnecessarily gendered language and improve inclusivity. It bears emphasizing that TGNC team members were crucial arbiters of what type of content would be most relevant and useful for them and, to the best of their knowledge, fellow members of the community; thus, these individuals' input guided discussions regarding the overall direction and focus of the app's content and user experience. Multiple substantial changes were implemented at the suggestion of, and with the help of, TGNC individuals on the team. Perhaps the most central to the app's functionality was the addition of a pitch tracker, which allows app users to receive real‐time biofeedback about the pitch of their voice, represented as a numerical frequency and marked on a piano keyboard. This feature can be seen in Figure 3, which also previews the app's user experience and branding. Feedback and contributions from community members also influenced the increased use of written text and images incorporated into app content to maximize accessibility. Even factors such as incorporation of flags to represent the TGNC community were implemented with the help of community members, who also were directly involved in creating graphic design elements for the app's logo and animation. A sample of branding materials for Attuned, demonstrating aspects of the user experience including a keyboard‐based biofeedback tool. Substantial attention was also paid toward design elements of the app—with the interprofessional team, led by community members, favoring a gender‐neutral, welcoming color palette—and the app's name, for which discreetness and underlying meaning were priorities. The name “Attuned” was chosen based on its connotation of “bringing into harmony.” The animation of the Attuned logo was also designed to represent the journey of transitioning and of progressing through gender‐affirming VCMT. Members of the app creation team identified multiple successes in this process. First and foremost, the assembly of an interprofessional team, including community participation from inception, was a foundational step that allowed for a more productive and fruitful development process in which many different perspectives were incorporated. Along these lines, the ability to recruit dedicated team members who were each fully “bought‐in” was another success that laid the foundation for a productive and collaborative effort. With so many contributors to the process, the work of a dedicated research coordinator on tasks such as scheduling, organization, and effective communication also proved essential; leveraging various technological platforms, especially Zoom and Slack, across the whole team at all stages of the process also facilitated more efficient collaboration. In addition, the flexibility of all team members in creating app content, as well as branding and marketing materials, created space for iteration and ultimately an improved end result. Finally, the unforeseen COVID‐19 pandemic increased the app's relevance and applicability, as interest in electronic and remote delivery for a wide variety of health care services expanded rapidly. Team members also noted several challenges at various phases of the app development. Firstly, careful attention was paid to the recruitment of community members as collaborators in this process. Finding TGNC individuals—already a minoritized community with potentially negative views of the health care system—who were willing to commit to the relatively significant time commitment, while ensuring that there was not exploitation of these individuals, required striking a delicate balance. Some collaborators were interested in potentially being early users of the app and/or referring other TGNC friends to be a part of future studies involving the app, and thus navigating possible conflicts of interest when considering upcoming research was also an important challenge. We approached these challenges primarily by providing complete transparency with our TGNC collaborators. For example, at this early phase of development, there was no funding available to compensate community members; this was communicated early on, to ensure that the individuals who ultimately joined the team did so with a clear understanding of their role and the scope of the project from the outset. Finally, while providing the app free of charge was a central tenet from the outset of development, the team also grappled with potential methods to protect the intellectual property contained in the app content despite its open access availability. Furthermore, especially in early phases of the app's creation, generating professional‐level content with maximal utility while operating on a very limited budget proved difficult. While technology allowed for effective teamwork without potentially burdensome frequent in‐person meetings, remote collaboration is not without its drawbacks. For example, a lack of in‐person communication sometimes led to slower turnarounds and increased difficulty in bringing team members up to speed in disciplines in which they were not experts; however, these issues were addressed via as‐needed or on‐the‐fly Zoom meetings or phone calls with subsets of the interprofessional team, to continue forward progress and make sure knowledge and expertise were shared among all team members. DISCUSSION Our experience with a community‐engaged framework to collaborate with TGNC individuals in building a free mobile application delivering high‐quality gender‐affirming VCMT highlights several design advantages and challenges of this approach. Six TGNC individuals were incorporated into an interprofessional team including laryngologists, SLPs, and application developers, and were instrumental in many aspects of app development. They worked collaboratively with SLPs to include content and language that was most likely to be well‐received by, and useful for, the TGNC community at large, and provided ideas to improve the functionality and accessibility of the app. Thus, the app's content, user experience, visual design, and overall tone were substantially influenced and guided by these TGNC individuals. Despite the multiple strengths of this transdisciplinary approach, there were also challenges faced by our team throughout the design process, all of which are described above in the results section. The use of community‐engaged research, including CBPR and CABs, has well‐described benefits for both researchers and communities, 20 and the involvement of patients and communities in research was recently highly recommended by the revised Declaration of Helsinki. 48 However, these frameworks remain very rare among laryngology and speech language pathology scholarship. Some attention has been given to community‐engaged approaches in the context of reducing disparities and promoting equity for hearing health, 21 , 22 , 46 , 47 but otherwise, the literature remains scant. To our knowledge, our study is the first to integrate a CAB in digital product design within laryngology. We hope to begin to lay the groundwork for others to work collaboratively with community members to advance research and design interventions in a way that maximizes benefit to both researchers and communities in laryngology. Our work also builds upon existing efforts to leverage technology for better patient outcomes. Especially as digital health modalities gain steam, a number of mobile applications have emerged in the speech language pathology space. 49 Although some of these apps are developed by, or in collaboration with, SLPs, 49 many are designed for use by SLPs in collaboration with patients, rather than being delivered directly to patients themselves. 50 Given the substantial barriers faced by TGNC individuals in accessing health care generally, 14 let alone specialized services such as VCMT, our aim was to provide this community with an app that was directly accessible, and introduced VCMT concepts from the “ground floor,” so to speak. Although some online resources are available for individuals interested in gender‐affirming VCMT, Attuned is the first to incorporate evidence‐based education directly from medical professionals and biofeedback while remaining open source and free of charge. The app thus offers many of the benefits of working directly with voice health care providers without cost and other factors that have historically limited TGNC individuals' access to these services; this has remained a central part of our group's mission because of the advent of the development process. In addition, to our knowledge, we have developed the first app for gender‐affirming VCMT in collaboration with community members, although there was a previous effort called Project Spectra—whose development process has been previously described—that ultimately did not come to fruition. 51 The primary developer of Project Spectra had previously highlighted the potential harms perpetuated by existing apps which had not collaborated with TGNC individuals in their creation, 52 , 53 and sought to generate an entirely community‐based development process, whose goals ultimately collided with the academic framework under which the project also existed (as a graduate dissertation project). Of note, this effort was primarily undertaken by software developers with later involvement of, and input from, VCMT providers, whose recommendations were not uniformly well‐received by the development team. 51 Although app‐based interventions have begun to proliferate in otolaryngology, 54 , 55 literature demonstrating efficacy of apps focused specifically on the voice remains extremely limited. 49 This highlights the need for not only incorporation of clinicians with expertise in evidence‐based care into the app development process but also the undertaking of high‐quality trials to determine the effectiveness of digital health interventions. This represents a limitation to our app, which is still in development and thus is not yet available for use; we thus could not collect usability data or perform either qualitative or quantitative studies. This is a planned next step for our team. However, this description of our development process still represents an important contribution to otolaryngology and the larger space of digital health app development. Each of these fields includes examples of prior literature focused solely on the methodology of developing an intervention, 56 , 57 , 58 , 59 but neither area has to date adequately utilized community‐engaged approaches. This robust description of our collaboration with a CAB, though not following traditional scientific hypothesis and missing an a priori strategy for bias mitigation, still represents a critical jumping‐off point for others in the field to learn from and adapt such that community‐engaged research and intervention planning can become more widespread in otolaryngology and speech language pathology. Furthermore, we recognize that despite integrating multiple TGNC individuals into our development team as part of a CAB, we cannot adequately represent the entire TGNC community with just a community board, and may thus be missing important facets or unmet needs; this is especially relevant given that the TGNC individuals on the development team were identified through word of mouth rather than deliberate sampling of the community. A recent publication by our group highlighted the need for personalized care when providing gender‐affirming VCMT to non‐binary and genderqueer individuals, 9 and we anticipate that we will discover previously unaccounted‐for requests and suggestions from users as the app is tested by the broader community. To fully understand the diversity within the TGNC community, it is crucial to apply an intersectionality framework, recognizing that the interplay of various identity categories—such as age, race/ethnicity, disability status, and others—generates unique experiences and needs. Our goal is to explore these intersections via expanded recruitment of TGNC individuals, to ensure a more comprehensive understanding of the TGNC population with respect to their VCMT needs and preferences. In addition, it bears mentioning that although our TGNC team members participated in decisions around research and publications regarding Attuned, they were not included in the drafting of this work or plans for dissemination. This description of our app development approach is entirely retrospective, thus limiting our ability to include direct quotes or input from CAB members, or provide demographic information and socioeconomic positionality. Though our efforts described in this manuscript entail a community‐based approach, we note that additional incorporation of CBPR principles will be necessary moving forward, and our goal is to fully embrace a CBPR approach as we further develop the app and begin to undertake research regarding its usability and effectiveness. Although the voices of the TGNC individuals in the CAB were crucial in development of the Attuned prototype app, these voices should ideally be represented directly along with their intersectional and cultural perspectives when employing CBPR. Another aspect of CBPR that we aim to develop as we continue preparing Attuned for public use is a defined conflict resolution framework, to guide situations when community members disagree with clinicians and researchers on a particular point. While outright conflicts were absent in our development process, differences of opinion were largely settled informally through regular discussions but without a structured approach, which represents a limitation of our process that we will remedy moving forward. A similar formal structure will be necessary for avoidance of conflicts of interest among CAB members and other individuals involved in future research and development, which was not defined formally prior to this process. Our planned immediate next steps include further development of Attuned following CBPR methodology, and undertaking an initial qualitative study to assess for usability and perceived experience and benefit among community members, with the goal of incorporating the received feedback for improvement. We also plan to increase accessibility of the app by adding support for other languages, and to further expand functionality and features of the application experience. Finally, we hope to collaborate with other groups and medical centers to increase crowd‐sourcing of content and user recruitment. CONCLUSION Although its substantial benefits have been well‐documented, the use of community‐engaged research and development is rare in laryngology and speech language pathology. We describe our incorporation of a TGNC CAB in the development of a free app, with the ultimate goal of delivering high‐quality gender‐affirming VCMT to TGNC individuals. Though our app development with an interprofessional team was not without its challenges, our dedication to a collaborative process allowed for a final product that will likely be more in line with the goals and needs of the community we seek to serve. We hope to continue to build and strengthen our app and further incorporate CBPR principles in ongoing development and research, and likewise hope that this description of our process may advance the uptake of CABs and CBPR within laryngology and speech language pathology. FUNDING INFORMATION Funding Support Provided by the Weill Cornell Dean's Diversity and Healthcare Disparity Research Award. Recipient of the 2023 Dalio Center for Health Justice Research Grant. Anaïs Rameau was supported by a Paul B. Beeson Emerging Leaders Career Development Award in Aging (K76 AG079040) from the National Institute on Aging and by the Bridge2AI award (OT2 OD032720) from the NIH Common Fund. Anaïs Rameau owns equity of Perceptron Health, Inc. Anaïs Rameau is a medical advisor for Sound Health Systems, Inc. CONFLICT OF INTEREST STATEMENT The authors declare no conflicts of interest. Alter IL, Chadwick KA, Andreadis K, et al. Developing a mobile application for gender‐affirming voice training: A community‐engaged approach. Laryngoscope Investigative Otolaryngology. 2024;9(6):e70043. doi: 10.1002/lio2.70043 This work was previously presented as a poster at the Fall Voice 2020 Virtual Conference on October 23–24, 2020. REFERENCES