Patient awareness, involvement, and learning needs in health technology assessment – a survey of patients, caregivers, and patient advocates Authors: Sihui Zhou, Mabel Wan Chi Sim, Zann Sue Ting Foo, Dani Mothci, Sita Ratna Devi Duddi, Kok Hian Tan Published: 2025 ABSTRACT AbstractIntroductionPatient involvement in health technology assessment (HTA) is nascent globally especially in Asia. The aim was to assess patient awareness, involvement, and learning needs of HTA, particularly in Asia.MethodAn online survey assessed HTA awareness, involvement, and learning needs among patients and caregivers across 33 countries from October 2021 to July 2022.ResultsThe survey of 170 participants (127 Asians, 43 non-Asians) revealed that 52.3 percent (89 of 170) were unaware of HTA, only 14.1 percent (24 of 170) engaged in HTA, and only 9.3 percent (15 of 161) had received training. The Asian group exhibited significantly lower HTA awareness (mean score 24.6 vs. 30.4, p < 0.05) and had lower participation rates in HTA discussions (10.2 percent, 13 of 127) compared to the non-Asian group (25.6 percent, 11 of 43) (p < 0.05). Among participants without prior HTA training, 68.5 percent (100 of 146) expressed a learning need.ConclusionPatient awareness and involvement in HTA were low globally, particularly in Asia. There was a strong patient learning need for HTA globally.Keywords: Health Technology Assessment, Patient Involvement, Patient Awareness, Public Health, Global Health Introduction Health technology assessment (HTA) is a multidisciplinary process that uses explicit methods to determine the value of a health technology at different points in its lifecycle (1). It typically involves a critical review of the evidence related to the clinical effectiveness of a health technology and to the optimal standard of care. It may also involve an assessment of economic efficiency as well as social and ethical implications in the local healthcare system (2). Typically, HTA remains focused on identifying quantitative evidence of clinical and cost effectiveness, but there is an increasing interest in understanding patient experience and preferences (3). This presents an opportunity for patients and caregivers to make their voices heard (4;5). Patients’ input is becoming a standard requirement for some HTA evaluations (6–9). These include the National Institute for Health and Care Excellence (NICE) in England (10), the Scottish Medicines Consortium in Scotland (11), the Department of Health and Ageing in Australia (12), and the Canadian Agency for Drugs and Technologies in Health (CADTH) (13). Patients may have problems in their daily lives, such as fear of side effects or having difficulty taking their medicine, which can lead to poor compliance or even discontinuation of treatment (14–16). However, these issues might be downplayed by health professionals due to a perceived lack of clinical or economic significance. European Patients Forum (EPF) HTA survey found that patient involvement helps HTA agencies and decision-makers understand the real-life impact of technology and quality-of-life implications, aiding decisions that address patients’ needs (17). Many have argued the importance of the patient voice in the HTA process. Patient involvement can improve the quality, relevance, and value of HTA (18), promote transparency and fairness in the process (19), and help more accurately assess the value of health technologies (20). As the direct beneficiaries of health technology, patients are closely linked to the interests of HTA, and therefore, involving patients in the HTA process increases the acceptance of HTA and the feasibility of the resulting healthcare decisions (18). Besides, given the governmental requirement for patient-centered health care and informed patient choice, patients should undoubtedly be included in the “multidisciplinary” HTA process for political legitimacy (16;21). Patients are essential stakeholders in health technology assessment, but their involvement is quite limited (3). An observational study was conducted in New Zealand, South Korea, and Taiwan in September 2020. Findings suggested that less than half of the participants had knowledge or experience with HTA (22). The EPF also painted an extremely pessimistic picture in its report on the survey of patient involvement in HTA in Europe, indicating that patient involvement has had little or no impact on decision making regarding health technologies (17). In addition to financial resource constraints, the main challenge of HTA is identified as a lack of awareness and effective training and support (2;17;23). HTA is seen as a scientific method; it has traditionally excluded patients’ views because they were considered anecdotal or biased (24). Patients are either not involved at all or just marginally involved (17;25;26). Patient involvement in HTA is nascent globally especially in Asia (4;27;28). The expectation of patients being able to be involved in HTA has increased along with the demand for innovative and important medical treatments and services (5), but there are few practices on this (4). A good case in point is in Taiwan, where patients can report their views on an online platform, and the HTA agency then summarizes these views and incorporates them into the HTA report. Additionally, patient representatives are invited to participate in relevant HTA meetings (29). Global HTA development can be categorized into three phases: rising HTA, where systems are in early stages and impact on decision making remains unclear; advancing HTA, with evolving systems but limited impact, and mature HTA, where well-established systems significantly influence decisions (5). Most Asian countries are in the rising or advancing phases, while European and high-income countries are in the mature phase (30–32). Evaluation HTA progress in Asia is key to its growth, but a one-size-fits-all approach is not feasible due to regional differences (4). The primary objective of this study is to assess patient awareness, involvement, and learning needs of HTA and to provide insights for future HTA training. The secondary objective is to compare the differences between Asian and non-Asian regions. The hypothesis of this paper is that the level of patient awareness and involvement of HTA in Asia is low, but there is a learning need. Methods The study utilized an anonymous online survey designed by the SingHealth Duke-NUS Institute for Patient Safety & Quality (IPSQ) from 25 October 2021 to 24 April 2022, with an extension to 29 July 2022. The survey, consisting of 23 questions on patient awareness, involvement, and learning needs in HTA, targeted patients, caregivers, and patient advocates (see Supplementary Appendix A). It was disseminated by various patient organizations located around the world through email invites containing an online survey link and QR code (see Supplementary Appendix B). It was published in both Chinese and English versions. The eligible participants were patients, caregivers, and patient advocates. Patients in this survey were defined as those who were recently experiencing some medical disease or condition; caregivers were defined as both informal caregivers (relatives and friends) and formal caregivers (paid caregivers); patient advocates were defined as people who help guide a patient through the healthcare system. Responses were mandatory for most parts of the survey, ensuring data completeness among diverse participants, who consented electronically and could opt out anytime. Ethical approval was granted by Duke Kunshan University and SingHealth Centralised Institutional Review Board (CIRB). Demographics in the questionnaire were categorized by region, gender, age, education, and income level, with Asia differentiated from non-Asia based on United Nations Statistical Division (UNSD) classifications. Central Asia, Western Asia, Southern Asia, Eastern Asia, and South-eastern Asia were defined as the Asian region. Others were defined as non-Asian region (33). Age was categorized into seven groups: ≤20, 21–30, 31–40, 41–50, 51–60, 61–70, and ≥ 71 years. Education levels were classified as low (primary, secondary/high school, diploma), medium (undergraduate), or high (postgraduate). Income levels were initially based on World Bank criteria (34) and then consolidated into two groups: high-income countries and low- and middle-income countries (combining upper-middle, lower-middle, and low-income categories) for analysis simplification (Table 1). Table 1.Characteristics of participants (non-Asian group vs. Asian group)Participants, No. (%)CharacteristicsOverall (n = 170)Non-Asian group (n = 43)Asian group (n = 127) p-valueCountryAustralia (n = 5)Belgium (n = 1)Burundi (n = 1)Canada (n = 1)Chile (n = 1)Colombia (n = 6)Ecuador (n = 5)Egypt (n = 2)Ireland (n = 1)Kosovo (n = 1)Malawi (n = 1)Malta (n = 4)New Zealand (n = 1)Nigeria (1)Peru (n = 2)Poland (n = 1)Romania (n = 1)South Africa (n = 4)United States (n = 3)Zambia (n = 1)China (n = 57)Cyprus (n = 1)India (n = 8)Israel (n = 1)Malaysia (n = 6)Nepal (n = 1)Philippines (n = 16)Singapore (n = 24)South Korea (n = 2)Thailand (n = 3)United Arab Emirates (n = 7)Viet Nam (n = 1)Gender0.014 Male62 (36.5)9 (20.9)53 (41.7) Female108 (63.5)34 (79.1)74 (58.3)Age group, y0.016 ≤203 (1.8)0 (0.0)3 (2.4) 21–3039 (23.0)3 (7.0)36 (28.4) 31–4032 (18.8)10 (23.3)22 (17.3) 41–5045 (26.5)11 (25.6)34 (26.8) 51–6029 (17.1)9 (20.9)20 (15.8) 61–7013 (7.6)7 (16.3)6 (4.7) ≥719 (5.3)3 (7.0)6 (4.7)*Education level Low27 (16.4)14 (32.6)13 (10.2)0.000 Middle74 (44.8)9 (20.9)65 (51.2) High64 (38.8)16 (37.2)48 (37.8)Income level group0.002 High58 (34.1)23 (53.5)35 (27.5) Low and middle112 (65.9)20 (46.5)92 (72.5)*Primary role0.037 Patient71 (42.4)24 (55.9)47 (31.6) Caregiver97 (57.6)19 (44.2)78 (62.4) Note: p-values obtained from chi-squared test; *Education level: 5 missing data; *Primary role: 2 missing data. Characteristics of participants (non-Asian group vs. Asian group) Note: p-values obtained from chi-squared test; *Education level: 5 missing data; *Primary role: 2 missing data. Patient awareness was assessed using a familiarity scale covering 14 aspects of HTA (Q2: On a scale of 1–5, state how familiar you are in the following areas). Participation and learning needs were evaluated through two multipart questions (Q3: Have you been part of any HTA discussion or processes? Q4: Have you attended any HTA training?). All referenced questions are detailed in Supplementary Appendix A. Descriptive statistics were used for demographic data. Patient awareness was measured on a 5-point Likert scale (1 = not familiar at all, 5 = very familiar), with scores summed for total awareness. Two-sample t-tests compared mean awareness scores, while chi-squared tests compared patient involvement proportions. Analyses were conducted using Stata/SE version 16.0, with p < 0.05 considered significant. Microsoft Excel version 16.68 was used for data visualization. Responses marked “other” without description were treated as missing data. Results As of July 2022, 170 respondents from 33 countries across six continents participated in the survey. The majority (74.7 percent, 127 of 170) were from Asian regions. Respondents were predominantly from high-income (34.1 percent, 58 of 170) and upper-middle-income (47.6 percent, 81 of 170) countries. Significant regional differences (p < 0.05) were observed in gender, age, education, income level, and primary role distributions (Table 1). Key findings include higher female participation in non-Asian (79.1 percent, 34 of 43) versus Asian (58.3 percent, 74 of 127) regions and differing age concentrations (Asian: 21–50 years, 72.4 percent (92 of 127); non-Asian: 31–60 years, 69.8 percent (30 of 43)). Education levels were generally higher in the Asian group, with 89.0 percent (113 of 127) having undergraduate or higher education, while non-Asian education levels were more evenly distributed. The Asian group primarily comprised from low- and middle-income countries and caregivers, while the non-Asian group consisted primarily of patients, with roughly equal representation from high-income and low- and middle-income countries. Detailed participant characteristics are provided in Table 1. Patient awareness of health technology assessment (HTA) was generally low across all respondents. Over half of the participants (52.4 percent, 89 of 170) reported being “Not familiar at all/I don’t know” with HTA, and a similar proportion (55.9 percent, 95 of 170) were unfamiliar with the overall HTA process (Table 2). Table 2.Global patient awarenessVariableParticipants, No. (%)1 – Not familiar at all/I do not know2345 – Very familiarHealth technology assessment (HTA)89 (52.4)18 (10.6)25 (14.7)24 (14.1)14 (8.2)The overall process of HTA95 (55.9)17 (10.0)31 (18.2)19 (11.2)8 (4.7)Your influence/role in the HTA process102 (60.0)14 (8.2)32 (18.8)14 (8.2)8 (4.7)Implications of HTA decisions91 (53.5)15 (8.8)32 (18.8)22 (12.9)10 (5.9)Stakeholders’ involvement in HTA95 (55.9)23 (13.5)27 (15.9)16 (9.4)9 (5.3)Evidence requirements84 (49.4)25 (14.7)31 (18.2)17 (10.0)13 (7.7)Presence or absence of HTA in your country96 (56.5)14 (8.2)28 (16.5)18 (10.6)14 (8.2)Evaluation of medicines56 (32.9)33 (19.4)41 (24.1)21 (12.4)19 (11.2)Evaluation of medical devices69 (40.6)29 (17.1)44 (25.9)16 (9.4)12 (7.1)Evaluation of clinical interventions75 (44.1)27 (15.9)31 (18.2)24 (14.1)13 (7.7)Evaluation of vaccines62 (36.5)24 (14.1)41 (24.1)23 (13.5)20 (11.8)Evaluation of surgical interventions72 (42.4)37 (21.8)30 (17.7)20 (11.8)11 (6.5)Evaluation of service delivery models73 (42.9)30 (17.7)41 (24.1)16 (9.4)10 (5.9)Evaluation of population level health interventions77 (45.3)28 (16.5)32 (18.8)25 (14.7)8 (4.7) Global patient awareness The Asian group consistently demonstrated lower mean patient awareness scores compared to the overall sample. Further analysis revealed that the Asian group’s awareness scores were significantly lower than those of the high-income non-Asian group across almost all aspects of HTA. However, when compared to the low- and middle-income non-Asian group, the Asian group showed no significant differences in awareness levels (Table 3). Table 3.Comparison of patient awareness (non-Asian high-income group vs. Asian group vs. non-Asian low- and middle-income group)VariableMean ± SD p-value p-valueNon-Asian HI group (n = 23)Non-Asian LMI group (n = 20)Asian group (n = 127)Non-Asian HI group vs. Asian groupNon-Asian LMI group vs. Asian groupTotal patient awareness score34.4 ± 16.525.8 ± 16.124.6 ± 19.00.0150.782Health technology assessment (HTA)3.2 ± 1.52.1 ± 1.42.0 ± 1.70.0010.830The overall process of HTA2.9 ± 1.52.1 ± 1.41.8 ± 1.20.0030.488Your influence/role in the HTA process2.7 ± 1.42.1 ± 1.51.7 ± 1.10.0040.352Implications of HTA decisions3.1 ± .1.52.1 ± .1.31.9 ± 1.20.0020.667Stakeholders’ involvement in HTA3.0 ± 1.62.1 ± 1.41.7 ± 1.10.0010.352Evidence requirements3.3 ± 1.42.0 ± 1.31.9 ± 1.20.0000.801Presence or absence of HTA in your country3.1 ± 1.61.9 ± 1.31.9 ± 1.30.0020.974Evaluation of medicines3.5 ± 1.32.3 ± 1.32.4 ± 1.30.0010.886Evaluation of medical devices2.8 ± 1.52.4 ± 1.42.1 ± 1.20.0460.401Evaluation of clinical interventions2.9 ± 1.42.4 ± 1.42.1 ± 1.30.0150.390Evaluation of vaccines3.0 ± 1.32.7 ± 1.52.4 ± 1.40.0320.453Evaluation of surgical interventions2.6 ± 1.32.5 ± 1.52.1 ± 1.20.1030.284Evaluation of service delivery models2.9 ± 1.42.1 ± 1.12.1 ± 1.20.0140.889Evaluation of population level health interventions2.8 ± 1.42.2 ± 1.22.0 ± 1.20.0210.602 Note: p-values obtained from two-sample t test; HI = high income; LMI = low and middle income. Comparison of patient awareness (non-Asian high-income group vs. Asian group vs. non-Asian low- and middle-income group) Note: p-values obtained from two-sample t test; HI = high income; LMI = low and middle income. Patient involvement in HTA was notably low, but there was a strong interest in learning. Only 14.1 percent (24 of 170) of all respondents had participated in HTA discussions, and merely 9.3 percent (15 of 161) had attended HTA training. Among those who had not participated in HTA discussions, only 7.6 percent (11 of 145) knew how to get involved. However, of those who had not attended HTA training (90.7 percent, 146 of 170), a substantial 68.5 percent (100 of 146) expressed willingness to participate in relevant HTA courses. Regional comparisons revealed that the Asian group had significantly lower participation rates in HTA discussions (10.2 percent, 13 of 127) compared to the non-Asian group (25.6 percent, n = 11 of 43). Despite this, a majority of Asian respondents who had not attended HTA training (64.4 percent, 76 of 118) expressed willingness to participate, although this was lower than the non-Asian group (85.7 percent, 24 of 28). When comparing the Asian group with non-Asian subgroups, significant differences emerged. The Asian group was less likely to participate in HTA discussions (p = 0.016) and HTA training (p = 0.025) compared to the non-Asian high-income group. However, no significant differences were found between the Asian group and the non-Asian low- and middle-income group (p > 0.05) (Table 4). Table 4.Comparison of patient involvement and learning needs (non-Asian high-income group vs. Asian group vs. non-Asian low- and middle-income group)Participants, n (%) p-value p-valueOverall (n = 170)Non-Asian HI group (n = 23)Non-Asian LMI group (n = 20)Asian group (n = 127)Non-Asian HI group vs. Asian groupNon-Asian LMI group vs. Asian groupParticipate in HTA discussion0.0160.252 No146 (85.9)16 (69.6)16 (80.0)114 (89.8) Yes24 (14.1)7 (30.4)4 (20.0)13 (10.2)*If no, do you know how to participate (n = 144)0.6250.597 No134 (92.4)14 (87.5)15 (100.0)105 (92.1) Yes11 (7.6)2 (12.5)0 (0.0)9 (7.9)*Attend HTA training0.0251.000 No146 (90.7)15 (75.0)13 (92.9)118 (92.9) Yes15 (9.3)5 (25.0)1 (7.1)9 (7.1)If no, would you like to attend the course (n = 145)0.2620.059 No46 (31.5)3 (20.0)1 (7.7)42 (35.6) Yes100 ((68.5)12 (80.0)12 (92.3)76 (64.4) Note: p-values obtained from chi-squared test; *know how to participate = 1 missing data; *attend HTA training = 9 missing data; HI = high income; LMI = low and middle income. Comparison of patient involvement and learning needs (non-Asian high-income group vs. Asian group vs. non-Asian low- and middle-income group) Note: p-values obtained from chi-squared test; *know how to participate = 1 missing data; *attend HTA training = 9 missing data; HI = high income; LMI = low and middle income. Discussion Our study confirmed that patient awareness of HTA was generally weak in Asia. This situation in Asia was similar to that of low- and middle-income countries in non-Asian regions, with most not knowing what HTA is or how to participate in it. Lack of knowledge about HTA is one of the main burdens preventing patients from participating in HTA (22). The European Patients’ Academy on Therapeutic Innovation (EUPATI) had recommended that education and training be provided to patients to improve their ability to participate in HTA in a meaningful way (2). Providing patients and patient organizations with the opportunity to participate in training is also one of Health Technology Assessment International (HTAi) quality standard (35). For patients, specific training should include five areas: the purpose of HTA, local HTA processes, collecting and reporting patient information that is most likely to impact HTAs, presenting at committee meeting, and communicating HTA recommendations (18). Considering the relatively low awareness of all aspects of HTA in the Asian group, as shown in our study, future patient education of HTA in Asia should focus more on the basic and be more widespread. The results of our study indicated that patient involvement in HTA was lacking in Asia, which were consistent with previous country-based surveys (17;28;36). This was the same as in non-Asian low- and middle-income countries, with the majority neither participating in HTA discussions nor attending HTA trainings. This may be partly due to the lack of knowledge of HTA among patients who did not know how to participate, thus resulting in a low participation percentage. Another possible explanation for the low participation rate in HTA training among Chinese individuals, who comprised the largest Asian group (56 out of 127 or 44.1 percent), is their general reluctance to attend. This may be attributed to multilayered institutional, sociocultural, and individual determinants in China. Structurally, insufficient policy frameworks beyond perfunctory informed consent, coupled with significant urban–rural institutional disparities and eroded trust between doctors and patients under marketization, systematically constrain engagement. Culturally, reliance on state guidance and collective decision making suppresses autonomous initiative. Individually, variables such as age, health status, insurance type, and social capital further modulate participation behavior (37;38). Hopefully, among the Asian group who had not received HTA training, a majority of 64.4 percent (76 out of 118) expressed a willingness to participate, which is a positive development. Additionally, an even higher percentage of the non-Asian group (85.7 percent; 24 out of 28) was willing to participate, indicating a strong desire to learn and engage with HTA. These findings bode well for the future of HTA. Considering the above factors and the strong learning needs, the intervention of an experienced patient advocacy or patient organization may be a good solution. There are some good practices. For instance, in Hong Kong, patient organizations collaborate with health professionals through participatory workshops and consensus meetings, enabling patients to contribute directly to the development of HTA evaluation criteria and priority setting within the public health system. In Australia, Rare Cancers Australia facilitates systematic patient input into bodies such as the Pharmaceutical Benefits Advisory Committee (PBAC) by coordinating patient testimony sessions and submitting consolidated evidence on treatment impacts from the patient perspective (18). In these practices, patient involvement is embedded in an organization’s political system to ensure effective patient involvement in the HTA process. Second, policy makers should recognize the critical role of patient advocates and patient organizations in promoting patient involvement in HTA. These groups are more likely to be familiar with HTA and have a greater ability to influence the process. Previous surveys have indicated that most patients are involved in the HTA process through patient organizations (22;28). A randomized controlled trial has also demonstrated the value of patient advocates and organizations as influential members of the public and professional organizations (39). Therefore, policy makers should integrate patient involvement into the political and educational system of the organization to ensure effective patient participation in the HTA process. In the past, patient views were often excluded from HTA as they were deemed biased or anecdotal (24). Fortunately, there is now recognition of the importance of involving patients in HTA for a comprehensive evaluation. HTA must, therefore, expand its research to encompass a wider range of patient-based evidence and acknowledge patients and patient advocates as “experience-based experts” with the right to participate in the HTA process. Given our study’s findings of low levels of patient awareness and participation in HTA, as well as the strong need for patient education on HTA, research on barriers to patient involvement in HTA and effective methods of patient engagement is imperative. Furthermore, it is crucial to conduct research on the effectiveness of HTA training after it has been implemented. Limitations This is the first global baseline survey to explore patient awareness, involvement, and learning needs in HTA, as well as the first to examine patient education preferences. Unlike previous studies that were limited to individual countries, our study provided a valuable opportunity to compare and contrast differences between regions. However, our study had some limitations. First, the sample size was relatively small for a global survey, and the composition of the Asian sample was mixed, with an uneven distribution across countries and a concentration of responses from East and Southeast Asia. The average number of responses from each country was relatively low, which may not be fully representative. This limitation confines the analysis to descriptive statistics and limits generalizable conclusions. Second, the questionnaire design may lead to anchoring bias and low-quality responses. It was observed that participants tended to choose the first option in ranking questions and there were inconsistent responses to the questions. Third, our study used convenience sampling – primarily conducted online and through patient organizations – which may have resulted in significant selection bias. This recruitment strategy likely attracted respondents who were more engaged and health literate, thereby failing to adequately represent the broader patient population. Therefore, our findings may underestimate the poor awareness and involvement of patients in HTA, particularly among the lay population. Furthermore, the questionnaire was only available in Chinese and English, which created a language barrier that limited participation from those who speak other languages. Future studies could use stratified sampling and multilingual instruments to ensure broader representation across Asian subregions. Conclusion In Asia, patient awareness and involvement in HTA were low. Comparatively, the awareness and involvement level were even lower in Asian region than in non-Asian high-income regions. Despite the lack of engagement in HTA, the majority of patients expressed a desire to participate, indicating a strong need for education and potential for increased involvement in the future. To promote patient involvement in HTA, it is crucial to leverage the role of patient advocacy or organization and design effective training programs. Supporting information Zhou et al. supplementary material Zhou et al. supplementary material Supplementary material The supplementary material for this article can be found at http://doi.org/10.1017/S0266462325103346. Funding statement This research received no specific grant from any funding agency, commercial, or not-for-profit sectors. Competing interests The authors declare none. References Associated Data Supplementary Materials Zhou et al. supplementary material Zhou et al. supplementary material