Developing and validating a culturally tailored questionnaire to assess COVID-19 vaccine hesitancy in Israel’s ultraorthodox Jewish population Authors: Imanuel Ber, Wasef Na’amnih, Saritte Perlman, Ben Kasstan, Yehuda Lerman, Khitam Muhsen Published: 2024 ABSTRACT ABSTRACTAddressing vaccine hesitancy requires culturally adaptable tools. This study aimed to provide a better understanding of COVID-19 vaccine hesitancy in Israel’s ultraorthodox Jewish community, where vaccine hesitancy is prevalent. We developed and validated a COVID-19 vaccine hesitancy questionnaire and explored correlates of intention to receive the fourth dose of the COVID-19 vaccine in this population. A mixed-methods study employing an exploratory sequential design was conducted in May-September 2022. Building on qualitative data, a questionnaire was developed and validated in a cross-sectional study when the fourth dose was recommended to all adults. Thematic analysis identified several factors influencing COVID-19 vaccine decision-making, predominantly religious authority alongside health information sources, perceived vaccine safety, effectiveness, and trust in state authorities. In the cross-sectional study, 96/106 (90.6%) participants were vaccinated against COVID-19; 5.2%, 25.0%, 65.6%, and 4.2% received 1, 2, 3, and 4 doses, respectively. Intention to receive the fourth dose (yes/maybe) was reported by 46%. A factor analysis yielded several scales expressing perceptions regarding COVID-19, with Cronbach’s Alpha mostly between 0.689 and 0.887. Correlates of intention to receive the fourth dose were age ≥ 50 years: OR = 12.45 (95% CI 1.42–108.93), male-sex: 4.97 (1.47–16.81), perceiving the vaccine as important/effective and safe: 4.11 (1.29–13.13), utilizing ultraorthodox communication channels: 5.86 (1.58–21.73), and the number of previously received doses: 3.14 (1.31–7.53). Complementary evidence emphasized the role of religious authority and information sources (ultraorthodox communication channels) and balancing perceived vaccine safety and effectiveness and disease risk in COVID-19 vaccine hesitancy in Israel’s ultraorthodox Jewish population. Introduction COVID-19 vaccines were instrumental in preventing severe disease and deaths, and controlling the COVID-19 pandemic.1–6 Vaccination with booster doses was recommended to address the emergence of new variants and waning immunity.7–12 Israel’s COVID-19 vaccination program was introduced on December 19, 2020, using the mRNA BNT162b2 COVID-19 vaccine (BioNTech- Pfizer),13–15 with high uptake,15,16 reaching 53.2% and 38.8% of the population within three months for the first and second doses, respectively.17 As of February 2023, approximately 48% of Israel’s population received the third dose of the COVID-19 vaccine, and 9.1% received the fourth dose, exceeding 50% in the ≥70-year-olds.18 However, vaccine uptake was lower among Arab and ultraorthodox Jewish populations in Israel.16,17,19 Socio-demographics, conspiracy beliefs, low-risk perceptions, and distrust in decision-makers were associated with COVID-19 vaccine hesitancy.20–22 Confidence in vaccine safety and efficacy, hope, and the ‘green pass’ policy positively correlated with vaccine acceptance.22–27 Studies from Israel showed that COVID-19 vaccine acceptance increased with age, social resilience, concerns about the pandemic, and higher income.28–31 Vaccine hesitancy was more common in the Arab ethnic minority and individuals with higher religiosity levels, lower education, history of COVID-19, and influenza vaccination hesitancy.28–31 Most of these studies were undertaken early during the vaccination campaign and focused on the general population28–30 rather than on sub-population groups with a higher likelihood of vaccine hesitancy, such as the ultraorthodox (Haredi) Jewish population.15–17,32–35 Some studies enrolled participants via the internet,28,30 which limits their generalizability. Given these gaps, our study aimed to understand the COVID-19 vaccine hesitancy among the culturally unique ultraorthodox population. This population comprises 13.8% of Israel’s population. In the ultraorthodox Jewish population, life revolves around prayer and studying the Torah, and rabbis serve as spiritual guides, educators, and often as legal authorities in matters of Jewish law. Compared to the general Jewish population, the ultraorthodox population has a younger median age, lower socioeconomic status, higher fertility rate, and household density.36–39 Existing scales measuring vaccination hesitancy, such as the Vaccination Confidence Scale, focused on parents’ confidence about adolescent and young children’s vaccination, perceptions of the benefits and harms of vaccination, and trust in healthcare providers.40–42 The Vaccine Hesitancy Scale43 demonstrated a two-factor structure: “lack of confidence” and “risks.” These scales were used only in quantitative research and targeted routine vaccination programs in non-pandemic times. Therefore, their scope and generalizability to culturally unique populations and COVID-19 vaccination hesitancy is likely limited. The burden of COVID-19 in Israel was higher, and the COVID-19 vaccine uptake was lower in the ultraorthodox Jewish population than the general Jewish population.16–17,44–46 However, the correlates of COVID-19 vaccine hesitancy in the ultraorthodox population remain unclear. The uptake of seasonal influenza and routine childhood vaccines is lower in the ultraorthodox Jewish population than in the general Jewish population with frequent vaccine-preventable diseases outbreaks. 34,47–49 Community leaders and trust in the Ministry of Health were reported as significant factors affecting vaccine uptake.33,34 However, the role of the rabbi was not consistently found to be the primary influence on vaccine decision-making.49 A culturally tailored tool is essential for better assimilation of the causes of vaccine hesitancy in this population. Accordingly, we aimed to provide a better understanding of COVID-19 vaccine hesitancy among the ultraorthodox Jewish community in Israel, specifically to develop and validate a culturally tailored questionnaire to assess COVID-19 vaccine hesitancy in this unique population, utilizing both qualitative and quantitative approaches and explore the correlates of intention to receive the fourth dose (second booster) of the COVID-19 vaccine. Methods Study population and design This was a mixed-method study with an exploratory sequential two-phase design50 (Figure 1) conducted among adults from Israel’s ultraorthodox population. The rationale for using the mixed methods is to provide a better understanding of COVID-19 vaccine hesitancy in this population while utilizing various methodologies and perspectives, counterbalancing the limitations of solely using quantitative and qualitative study designs and providing complementary evidence by each study design. 50 Figure 1.Study design. Study design. The first phase comprised an exploratory qualitative study, which explored perceptions of the COVID-19 vaccines among adults from the ultraorthodox Jewish population. The second phase included a quantitative (cross-sectional) study aiming at validating a newly developed questionnaire and assessing potential correlates of intention to receive the fourth dose (second booster) of the COVID-19 vaccine in this community. The integration between the qualitative and quantitative studies relied on “building data,”50 namely, using findings from the qualitative study to develop a new questionnaire to assess COVID-19 vaccine hesitancy, which we used in data collection in the cross-sectional study. The integration occurred via Zoom discussions conducted by the main researchers (IB, YL, KM). The integration also occurred in interpreting the results, where findings from the qualitative study contributed to explaining the results of the cross-sectional study. The studies were reported following the STROBE checklist for the cross-sectional study and the Journal Article Reporting Standards for the qualitative and mixed studies. 49,51 Sampling method The inclusion criteria in qualitative and quantitative studies were age ≥18 years and willingness to participate. In the qualitative study, we employed a purposive sampling complemented by snowball sampling, aiming to include vaccinated and unvaccinated individuals of various ages and genders. Participants were recruited via the social networks of the research team (IB). The final sample size was determined when additional participants provided no new information (saturation).52 We approached 19 individuals, and six (31.5%) agreed to participate; four men and two women aged 30–70 years. The quantitative study used a convenience sampling approach supplemented by snowball sampling. We ensured diversity regarding gender, ethnic origin (e.g., Ashkenazi, Sephardi), and geographic region. Participants of the qualitative study were not included in the quantitative study. Data collection and analysis - qualitative study We developed a semi-structured questionnaire with 15 items for the qualitative study based on a literature review,27,33,40–43,53 which ‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬was ‬‬refined in consultation with experts in vaccinology, public health, and health behavior within the ultraorthodox population. The questionnaire covered topics such as the perception of the COVID-19 vaccine’s effectiveness and safety and factors affecting vaccine uptake (Supplementary Material 1). Data were collected in May 2022 via face-to-face interviews conducted in participants’ homes, each taking 45–60 minutes. The interviews were not recorded to increase trust and compliance with the study. Instead, the interviewers took detailed notes of the participants’ responses to all questions. Three researchers (IB, SP, KM) analyzed the qualitative data independently, using line-by-line coding and following a thematic approach to identify common themes and concepts that emerged frequently. The researchers read and organized the data in a table that divided the ideas into coding categories with illustrative quotations.54 The researchers discussed the results in virtual meetings to compare and link similar codes into overarching themes. Cross-sectional study A cross-sectional study was undertaken from June to September 2022 in ultraorthodox-majority cities such as Bnei Brak and Elad and neighborhoods/communities in ‘mixed’ cities such as Ahisamakh, Telzstone, Jerusalem, and Tel Aviv. Data collection Using findings from the qualitative study, a questionnaire with closed-ended questions was developed (Supplementary Material 2). The quantitative questionnaire’s face, content, and consensual validity were evaluated by the study team and leading experts and researchers in public health, vaccinology, and health behavior within the ultraorthodox population. Our pilot study included face-to-face interviews with 17 participants, showing good compliance and acceptability of the questionnaire. A preliminary analysis showed the existence of constructs in the data that can generate reliable scales, such as perceived vaccine safety, efficacy, and disease risk, with Cronbach’s alpha values of 0.630–0.856. Two trained interviewers from the ultraorthodox community collected the data via face-to-face interviews, one male and one female, to ensure cultural sensitivity with same-sex interviews. The definition of the study variables is presented in Supplementary Material 3. The questionnaire included sociodemographic questions, history of SARS-CoV-2 infection, COVID-19 vaccine uptake, and intention to receive the fourth vaccine dose for participants who received less than four doses. During the study period, the fourth vaccine dose was recommended for adults of all ages and not only for high-risk groups. The questionnaire also included questions on the sources of information on COVID-19 vaccines, perceptions and attitudes regarding COVID-19 risk, COVID-19 vaccine effectiveness, and safety, the influence of the rabbi and community, professional recommendations, and family members on the decision to receive the COVID-19 vaccine, trust in various entities, history of influenza vaccination and having a supplementary health insurance as markers for utilization of health services.‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬ Statistical analysis Descriptive statistics were used. An exploratory factor analysis, a dimensionality reduction method,55–57 was performed to identify underlying constructs and build scales to measure the perceptions and attitudes. The constructed scales’ internal consistency (reliability) was assessed using Cronbach’s Alpha index., with values > 0.6 considered acceptable. Perceptions and attitudes were defined using summative scales according to the participant’s replies and scores on the scale items. The participant’s agreement with each attitude was classified as “agree” if scoring the median or higher or “disagree” if scoring below the median (Supplementary Material 3). We examined the correlates of intention to receive the fourth vaccine dose (the dependent variable); participants who replied “yes” or”’maybe” were grouped into one category (yes) versus those who replied “no.” The independent variables were sociodemographics, perceptions, and attitudes regarding COVID-19 and the COVID-19 vaccines. We used the chi-square test, or Fisher’s exact test as needed, for categorical variables and the Mann-Whitney test for variables with skewed distribution. Multivariable logistic regression models were fitted, yielding odds ratios (OR) and 95% confidence intervals (CI) for each independent variable. Variables associated with the outcome in bivariate analysis with p < .1 were considered in the model.58 The final model was selected based on model fit parameters. p value < .05 was considered statistically significant. Data were complete for all variables except for the covariates of maternal employment status and the number of rooms in the household (missing data for one and 16 participants, respectively). We used the complete-case analysis. Data was analyzed using IBM-SPSS version 28 (Armonk, NY: IBM Corp). Sample size The preplanned sample size was calculated according to the main aim of the cross-sectional study of assessing the questionnaire’s reliability.59,60 We assumed a Cronbach’s Alpha of 0.65–0.70, precision of 0.1, 95% confidence level, and a scale of 5–10 questions, which yielded a sample size of 92–110 participants. Ethical approvals The study protocol was approved by the Ethics Committee of Tel Aviv University (Protocol numbers 0002720–2 and 0003372–1). Individuals were given a detailed study description, and those who provided informed consent were enrolled. Data were collected anonymously. Results Qualitative study Supplementary Material 4 presents the demographics of qualitative study participants. We identified five main themes and 15 sub-themes, suggesting multiple influential factors on COVID-19 vaccine hesitancy. These factors affected the individual’s perceptions regarding COVID-19 vaccine safety and effectiveness, and perceived disease risk. Dominant influences on vaccine decision-making included rabbinic authorities, although family, friends, and the medical community also had notable impact. Perceived vaccine safety, effectiveness, and disease risk were diverse and dynamic, and weighting these considerations occurred continuously while integrating new knowledge. Altogether, these factors affected individual decision-making regarding vaccination, alongside mistrust in state institutional authorities, e.g., the Ministry of Health. The role of the rabbi and religious authority The rabbi played a noteworthy role in the individual’s decision concerning COVID-19 vaccination One participant stated: “We usually consult with the Rebbe or the community rabbi; I assume they consulted with the medical authority.“Another participant said: “I received the COVID-19 vaccine following consultation with the rabbi, asking if it is mandatory or allowed at all.” This theme emerged from Ashkenazi (Lithuanian) and Hasidic participants. The reason for relying on religious authority was the perceived discrepancies among the medical community One participant explained: “Among doctors, there were many disagreements surrounding COVID-19 vaccination, so I could not follow their guidelines. Instead, I turned to my community’s religious authority.“ The interaction with the environment The medical community seemed to play a role alongside the rabbi For example, one participant stated: “Since COVID-19 emerged suddenly into our lives, we did not have norms on how to behave, so I consulted both my family doctor and the community rabbi“. Another described: “I heard diverse opinions, mainly from professionals and rabbis“. As one participant described, the medical community also influenced vaccine hesitancy due to discrepancies among community doctors. Others’ experiences were also important One vaccinated participant mentioned: “I was not among the first vaccine recipients. I relied on experts’ opinions and mainly on the cumulative experience of prior vaccinees.” Family and friends also had some impact. One participant stated: “I got the vaccine following the Torah ruling; family and friends had little impact.” Another mentioned: “We were against vaccination, but we received the vaccine because of family pressure.” Weighting personal and others’ experiences and circumstances One participant mentioned: “We forwent vaccination since we got infected early during the pandemic, and the disease was mild.” Another stated, “We got vaccinated since we have relatives at high risk.” Another participant reported that the restrictions and the desire to return to life strongly affected his decision to receive the vaccine. The decision on COVID-19 vaccination was dynamic One participant stated: “My opinion about the vaccine was positive throughout the period, but I did not take the fourth dose because I had already been sick, and the intensity of the Ministry of Health’s advertising regarding vaccination has declined.” Confidence, perceived safety, and effectiveness of the COVID-19 vaccines The perceived safety of the COVID-19 vaccine was a main concern One participant described: “The fear of side effects and the fact that some people became sick despite being vaccinated compared to unvaccinated people were the reasons for which I declined vaccination.” Another explained: “These vaccines are neither safe nor effective. They cause side effects, miscarriages, sterilization, and more.” The fact that it is a new vaccine seemed to fuel the safety concern. Other participants reported that they did not doubt the vaccine’s safety. However. Perception of safety concerns varied, as one participant described: “There were many stories around the vaccines, but I did not believe them, especially when I saw the behavior of anti-vaxxers.” There was a build-up in the vaccine confidence with time One participant described: “The vaccine had proven itself (‘Itmach chisunah’) in others; I saw that months passed after people got vaccinated, and no significant side effects developed.” Another said: “As time passed and there were no serious side effects, my willingness to get vaccinated increased.” Learning from others’ experiences to mitigate safety concerns also emerged. Some participants reported concerns about the vaccine’s side effects. Thus, others’ experiences became pivotal in their decision regarding vaccination. Change in the opposite direction was also evident; one participant claimed: “My trust in the vaccine deteriorated over time.” Weighting the risk of perceived safety versus the effectiveness of the vaccine Skepticism about the vaccine, even in vaccinated individuals, was evident. One participant stated that he got vaccinated since “the harm is less than the benefit, but trust in the vaccine declined given the concealment of the vaccine side effects by the Ministry of Health.” Integrating new inputs and re-assessment Most participants reported changes in their perception of the COVID-19 vaccine’s effectiveness, safety, and disease risk thus reconsidering their vaccination decision. One participant declined the fourth dose: “Because I analyzed the situation; in my opinion, it was unnecessary, given the balance of effectiveness versus side effects.” Diversity in the perceived vaccine effectiveness Half of the participants reported believing the vaccine was effective, while three others mentioned limited experience with the vaccine. One participant said, “I did not doubt the vaccine effectiveness, as seen from the drop in illness and death rates.” Balancing between the perceived safety concerns and disease severity Vaccine hesitancy was dynamic, related to perceived disease severity throughout the waves and waning immunity. Some perceived COVID-19 as a mild flu, thus diminishing the need for vaccination. One participant initially considered getting vaccinated but changed his mind, explaining that:”COVID in young people is like a mild flu, and vaccine had side effects. Additionally, some people got sick despite being vaccinated.” One participant stated: “Once we saw that COVID was weakening, and side effects were reported, I declined the fourth vaccine dose.” Others emphasized that COVID-19 vaccination should be offered mainly to high-risk individuals. For example, one participant explained:”I believe that for older people, the benefits outweigh the risks, but for young people, there is no point in vaccinating.” The focus on the high-risk groups was stable over time, as one participant stated: “The Rebbe instructed from the beginning that high-risk populations should get vaccinated, and that remained the case throughout.” Information sources Participants reported using various information sources on COVID-19 vaccines, primarily religious sources One participant reported: “I have no access to medical literature, so my information sources were halachic rulings over the years and the rabbi’s words in my community.” Another noted that the media he consumed barely mentioned the virus: “What the rabbi said… there was hardly any mention in the media.” About half of the participants relied on internal sectoral press and general press. Trust in the ministry of health Negative attitudes toward the ministry of health were expressed regarding the COVID-19 pandemic management One participant described: “I have no trust in the official/state institutions.” The perceived lack of transparency about the vaccine side effects dominated as the reason for the mistrust, alongside the conspiracy theory. One participant described: “As the rumors about side effects grew and the Ministry of Health denied them while continuing to direct people to get vaccinated, this reduced my trust.” Another stated: “Besides the lack of transparency, it was obvious that the Ministry of Health was exploiting the media attention, and not all their decisions were based on medical grounds.” Another reported: “… it was clear they were trying in every way to market the vaccines.” Trust in the medical and professional teams was maintained One participant described:“The professional teams were very reliable all along the way, as they succeeded in convincing the rabbis and most of the public to receive the vaccine.” Cross-sectional study Overall, 106 (62.3% males) individuals agreed to participate in the cross-sectional study out of 360 who were offered participation (response rate = 29.4%). Most participants were young; 41.5% and 42.5% were aged 20–34 and 35–49 years, respectively. Most participants (67.0%) belonged to the Lithuanian stream (Table 1).Table 1.Demographic characteristics of the cross-sectional study participants.VariableCategoryNumber (Percentage)Total Participants 106 (100.0)SexMale66 (62.3)Female40 (37.7)Age, in years20-3444 (41.5)35-4945 (42.5)50+17 (16.1)Employment status of the husbandEmployed72 (67.9)Part-time employed7 (6.6)Tora-related work learner/Kollel student13 (12.3)Unemployed14 (13.2)Employment status of the wifeEmployed68 (64.2)Part-time employed19 (17.9)Unemployed15 (14.2)Previously employed4 (3.8)Education levelElementary school14 (13.2)High school11 (10.4)Certificate studies20 (18.9)Academic degree61 (57.5)Residential environmentOrthodox63 (59.4)Mixed8 (7.5)Religious28 (26.4)Secular7 (6.6)Stream affiliationSephardi11 (10.4)Hasidic22 (20.8)Ashkenazi (Lithuanian)71 (67.0)Haredi National-religious/Modern2 (1.9)Self-definition of “type of religiosity”Ultraorthodox27 (25.5)Open Orthodox42 (39.6)Modern Orthodox26 (24.5)National Religious-Orthodox8 (7.5)Not connected to definitions3 (2.8)Educational framework of the offspringHaredi ultraorthodox (Haider/Beit Yaakov)42 (39.6)Unofficial recognized16 (15.1)Ultraorthodox State15 (14.2)Other33 (31.1) Table 1.Demographic characteristics of the cross-sectional study participants.VariableCategoryNumber (Percentage)Total Participants 106 (100.0)SexMale66 (62.3)Female40 (37.7)Age, in years20-3444 (41.5)35-4945 (42.5)50+17 (16.1)Employment status of the husbandEmployed72 (67.9)Part-time employed7 (6.6)Tora-related work learner/Kollel student13 (12.3)Unemployed14 (13.2)Employment status of the wifeEmployed68 (64.2)Part-time employed19 (17.9)Unemployed15 (14.2)Previously employed4 (3.8)Education levelElementary school14 (13.2)High school11 (10.4)Certificate studies20 (18.9)Academic degree61 (57.5)Residential environmentOrthodox63 (59.4)Mixed8 (7.5)Religious28 (26.4)Secular7 (6.6)Stream affiliationSephardi11 (10.4)Hasidic22 (20.8)Ashkenazi (Lithuanian)71 (67.0)Haredi National-religious/Modern2 (1.9)Self-definition of “type of religiosity”Ultraorthodox27 (25.5)Open Orthodox42 (39.6)Modern Orthodox26 (24.5)National Religious-Orthodox8 (7.5)Not connected to definitions3 (2.8)Educational framework of the offspringHaredi ultraorthodox (Haider/Beit Yaakov)42 (39.6)Unofficial recognized16 (15.1)Ultraorthodox State15 (14.2)Other33 (31.1) Demographic characteristics of the cross-sectional study participants. Sixty-seven participants (63.2%) reported a history of SARS-CoV-2 infection, and 96 (90.6%) reported receiving the COVID-19 vaccine, with 65.6% and 4.2% receiving three and four doses, respectively. Nine (8.8%) participants reported intention to receive the fourth vaccine dose, 38 (37.2%) were undecided, and 55 (53.9%) declined to receive a fourth dose (Table 2).Table 2.History of COVID-19 and COVID-19 vaccination in the study sample*.VariableCategoryNumber (%)Total participants 106 (100.0)History of SARS-CoV-2 infection**Yes67 (63.2)No39 (36.8)Number of SARS-CoV-2 infections (out of 67)151 (76.1)2+16 (23.9)SARS-CoV-2 infection in family membersYes87 (82.1)No19 (17.9)Number of family members who had COVID-19 (out of 87)1-228 (32.2)3-428 (32.2)5+31 (35.6)Received COVID-19 vaccination, at least one doseYes96 (90.6)No10 (9.4)Number of COVID-19 vaccine doses received (out of 96 vaccinated participants)15 (5.2)224 (25.0)363 (65.6)44 (4.2)Intention to receive the fourth dose of the vaccine (second booster) (for those who received < 4 doses) (out of 102, who did not receive 4 doses)Yes9 (8.8)No55 (53.9)Maybe38 (37.2)*The variables were defined by self-reporting.**Defined as self-report on testing positive by PCR or antigen detection assay. Table 2.History of COVID-19 and COVID-19 vaccination in the study sample*.VariableCategoryNumber (%)Total participants 106 (100.0)History of SARS-CoV-2 infection**Yes67 (63.2)No39 (36.8)Number of SARS-CoV-2 infections (out of 67)151 (76.1)2+16 (23.9)SARS-CoV-2 infection in family membersYes87 (82.1)No19 (17.9)Number of family members who had COVID-19 (out of 87)1-228 (32.2)3-428 (32.2)5+31 (35.6)Received COVID-19 vaccination, at least one doseYes96 (90.6)No10 (9.4)Number of COVID-19 vaccine doses received (out of 96 vaccinated participants)15 (5.2)224 (25.0)363 (65.6)44 (4.2)Intention to receive the fourth dose of the vaccine (second booster) (for those who received < 4 doses) (out of 102, who did not receive 4 doses)Yes9 (8.8)No55 (53.9)Maybe38 (37.2)*The variables were defined by self-reporting.**Defined as self-report on testing positive by PCR or antigen detection assay. History of COVID-19 and COVID-19 vaccination in the study sample*. *The variables were defined by self-reporting. **Defined as self-report on testing positive by PCR or antigen detection assay. Factor analysis An exploratory factor analysis that included 24 items (questions 9–32 in supplementary material 2) yielded a Kaiser-Meyer-Olkin measure of 0.752, p < .001 on Bartlett’s test of Sphericity and seven factors with an Eigenvalue > 1, explaining 69.4% of the variance. These factors suggested the following perception and attitudes “importance, efficacy, and safety of the COVID-19 vaccine,” and the influence of the following factors on the COVID-19 vaccine uptake: “rabbi and community,” “family members,” “professional recommendations,” “explanations about COVID-19 vaccine,””community,” “COVID-19 restrictions” and “perceived risk of COVID-19.” The Cronbach’s alpha of scales using these factors ranged from 0.498 to 0.789. Cronbach’s alpha increased from 0.789 to 0.887 in factor 1 and from 0.698 to 0.713 in factor 2 following the removal of one item in each, thus we used the reduced scales (Table 3).Table 3.Factors analysis- attitudes and perceptions toward COVID-19 vaccination and the COVID-19 pandemic.FactorsVariance ExplainedCronbach’s AlphaMean (SD)Min-MaxMedian (25th-75th percentilesFactor 1: Importance, efficacy, and safety of the COVID-19 vaccine *25.7%0.789 (0.887)26.8 (5.3)13-3727.0 (24.8-30.0)The risk of COVID-19 vaccines is low COVID-19 spread more quickly in the Haredi population Information about vaccine safety is unreliable Vaccines approved by the Ministry of Health are safe People who refuse to get vaccinated against COVID-19 are taking risk COVID-19 vaccines are effective I rely on the knowledge and judgment of the Ministry of Health regarding COVID-19 vaccines My trust in the Ministry of Health has strengthened during the pandemic My confidence in vaccine efficacy increased over time My feeling regarding the vaccine effectiveness eased over time Factor 2: Influence of rabbis and community on COVID-19 vaccine uptake **13.0%0.698 (0.713)8.9 (2.9)4-169.0 (7.0-11.0)My trust in my Rabbi has strengthened during the COVID-19 pandemic My decision regarding the COVID-19 vaccine changed positively during the pandemic My community played a significant role in the decision to vaccinate against COVID-19 My Rabbi played a main role in my decision to get vaccinated Factor 3: Perceptions and attitudes related to COVID-19 risk7.8%0.6899.1 (2.7)4-169.0 (7.0-11.0)The COVID-19 pandemic negatively affected my physical health The COVID-19 pandemic negatively affected my mental health I am afraid of additional variants of SARS-CoV2 COVID-19 is a severe disease Factor 4: Influence of professional recommendations on the decision regarding COVID-19 vaccination7.1%0.4986.9 (2.1)3-127.0 (5.8-8.0)My decision regarding COVID-19 vaccination changed positively during the pandemic My physician played a main role in the decision whether to receive the COVID-19 vaccine Public health and HMOs announcements played a main role in the decision whether to get vaccinated Factor 5: Community influence on COVID-19 vaccine uptake6.4%0.5386.2 (1.9)3-126.0 (5.0-7.0)COVID-19 pandemic spread more quickly in the Haredi population It was difficult for me to get avaccine appointment near my residence The community played asignificant role in the decision to vaccinate against COVID-19 Factor 6: The influence of family, community, and communication of COVID-19 vaccine information on vaccine uptake4.9%0.6107.3 (2.2)3-127.0 (6.0-9.0)Communicating information on COVID-19 vaccines to the Haredi sector was problematic My family played amain role in my decision to get vaccinated My community played asignificant role in the decision whether to vaccinate against COVID-19 Factor 7: Impact of restrictions on COVID-19 vaccine uptake4.3%NA2.2 (0.9)1-42.0 (1.0-3.0)The restrictions on unvaccinated people played amain role in my decision to get vaccinated Table 3.Factors analysis- attitudes and perceptions toward COVID-19 vaccination and the COVID-19 pandemic.FactorsVariance ExplainedCronbach’s AlphaMean (SD)Min-MaxMedian (25th-75th percentilesFactor 1: Importance, efficacy, and safety of the COVID-19 vaccine *25.7%0.789 (0.887)26.8 (5.3)13-3727.0 (24.8-30.0)The risk of COVID-19 vaccines is low COVID-19 spread more quickly in the Haredi population Information about vaccine safety is unreliable Vaccines approved by the Ministry of Health are safe People who refuse to get vaccinated against COVID-19 are taking risk COVID-19 vaccines are effective I rely on the knowledge and judgment of the Ministry of Health regarding COVID-19 vaccines My trust in the Ministry of Health has strengthened during the pandemic My confidence in vaccine efficacy increased over time My feeling regarding the vaccine effectiveness eased over time Factor 2: Influence of rabbis and community on COVID-19 vaccine uptake **13.0%0.698 (0.713)8.9 (2.9)4-169.0 (7.0-11.0)My trust in my Rabbi has strengthened during the COVID-19 pandemic My decision regarding the COVID-19 vaccine changed positively during the pandemic My community played a significant role in the decision to vaccinate against COVID-19 My Rabbi played a main role in my decision to get vaccinated Factor 3: Perceptions and attitudes related to COVID-19 risk7.8%0.6899.1 (2.7)4-169.0 (7.0-11.0)The COVID-19 pandemic negatively affected my physical health The COVID-19 pandemic negatively affected my mental health I am afraid of additional variants of SARS-CoV2 COVID-19 is a severe disease Factor 4: Influence of professional recommendations on the decision regarding COVID-19 vaccination7.1%0.4986.9 (2.1)3-127.0 (5.8-8.0)My decision regarding COVID-19 vaccination changed positively during the pandemic My physician played a main role in the decision whether to receive the COVID-19 vaccine Public health and HMOs announcements played a main role in the decision whether to get vaccinated Factor 5: Community influence on COVID-19 vaccine uptake6.4%0.5386.2 (1.9)3-126.0 (5.0-7.0)COVID-19 pandemic spread more quickly in the Haredi population It was difficult for me to get avaccine appointment near my residence The community played asignificant role in the decision to vaccinate against COVID-19 Factor 6: The influence of family, community, and communication of COVID-19 vaccine information on vaccine uptake4.9%0.6107.3 (2.2)3-127.0 (6.0-9.0)Communicating information on COVID-19 vaccines to the Haredi sector was problematic My family played amain role in my decision to get vaccinated My community played asignificant role in the decision whether to vaccinate against COVID-19 Factor 7: Impact of restrictions on COVID-19 vaccine uptake4.3%NA2.2 (0.9)1-42.0 (1.0-3.0)The restrictions on unvaccinated people played amain role in my decision to get vaccinated Factors analysis- attitudes and perceptions toward COVID-19 vaccination and the COVID-19 pandemic. *In factor 1, removing the question “information about vaccine safety is unreliable” increased Cronbach’s alpha to 0.887. **In factor 2, removing the question “the decision regarding the COVID-19 vaccine has changed positively during the pandemic” raised Cronbach’s alpha 0.713. Correlates of intention to receive the fourth COVID-19 vaccine dose The percentage of participants aged 50 years or older was higher among those who reported intention to receive the fourth vaccine dose than those who did not (23.4% versus 5.5%, p = .002), as well as the percentage of males (72.3% versus 54.5%), but the difference was not significant (p = .06). Utilizing the Haredi communication channels as the primary information source on COVID-19 was more common in the former group (51.5% versus 25.5%, p = .008), and the median number of previously received COVID-19 doses was higher 3 versus 2 (p < .001). The perception of the COVID-19 vaccine as important, effective, and safe was more common among participants who intended to receive the fourth vaccine dose than those who did not 72.3% and 32.7%, respectively (p < .001), as well as being influenced by professional recommendations on COVID-19 vaccination: (68.1% versus 49.1%) but the difference was not significant (p = .053). No significant differences were found between the groups in other sociodemographic factors, perceptions, and attitudes (Table 4).Table 4.Correlates of intention to receive the fourth dose of the COVID-19 vaccine – bivariate analysis.VariableIntention to receive the fourth dose No (N=55)Yes (N=47) SexNumber (%)Number (%)PMale30 (54.5)34 (72.3).064Female25 (45.5)13 (27.7) Age, years .00220-3431 (56.4)12 (25.5) 35-4921 (38.2)24 (51.1) ≥503 (5.5)11 (23.4) Affiliation stream Lithuanian33 (60.0)34 (72.3).06Hasidic11 (20.0)11 (23.4) Other11 (20.0)2 (4.3) Household density*, Median (IQR)1.0 (0.33)1.0 (0.67.9Education level Academic Degree30 (54.5)27 (57.4).8No Academic Degree25 (45.5)20 (42.6) Employment status of the husband Employed35 (63.6)34 (72.3).3Unemployed20 (36.4)13 (27.7) Employment status of the wife Employed45 (83.3)38 (80.9).5Unemployed9 (16.7)9 (19.1) History of SARS-CoV-2 infection Yes38 (69.1)27 (57.4).2No17 (30.9)20 (42.6) SARS-CoV-2 infection among family members Yes43 (78.2)42 (89.4).1No12 (21.8)5 (10.6) Number of family members with a history of SARS-CoV-2 infection, median (IQR)3 (4)4 (3)0.3Number of previously received COVID-19 vaccine doses, median (IQR)2 (1)3 (0)<.001Having supplementary health insurance Yes46 (83.6)45 (95.7)0.06No9 (16.4)2 (4.3) History of receiving an influenza vaccine Yes, according to the recommendations of the Ministry of Health9 (16.4)10 (21.3).5Yes, yearly vaccination until the pre-COVID-19 period5 (9.1)5 (10.6) Yes, since the COVID-19 pandemic1 (1.8)1 (2.1) No40 (72.7)31 (66.0) The COVID-19 vaccines are important, effective, and safe ≥27 (Agree)18 (32.7)34 (72.3)<.00126 or less (Disagree)37 (67.3)13 (27.7) Influence of rabbi and community on COVID-19 vaccine uptake ≥9 (Agree)30 (54.5)29 (61.7).58 or less (Disagree)25 (45.5)18 (38.3) Perception of COVID-19 risk ≥9 (Agree)29 (52.7)28 (59.6).58 or less (Disagree)26 (47.3)19 (40.4) Influence of professional recommendation on COVID-19 vaccine uptake ≥7 (Agree)27 (49.1)32 (68.1).0536 or less (Disagree)28 (50.9)15 (31.9) Community influence on COVID-19 vaccine uptake ≥6 (Agree)34 (61.8)32 (68.1).55 or less (Disagree)21 (38.2)15 (31.9) Family members and environmental influence on COVID-19 vaccine uptake ≥7 (Agree)40 (72.7)32 (68.1)0.66 or less (Disagree)15 (27.3)15 (31.9) Restrictions influence on COVID-19 vaccine uptake 2 (Agree)37 (67.3)35 (74.5).41 (Disagree)18 (32.7)12 (25.5) Haredi communication channels is a primary source of information on COVID-19 Yes14 (25.5)24 (51.1).008No41 (74.5)23 (48.9) * The household density index was calculated as the number of people living in the household divided by the number of rooms in the household. Table 4.Correlates of intention to receive the fourth dose of the COVID-19 vaccine – bivariate analysis.VariableIntention to receive the fourth dose No (N=55)Yes (N=47) SexNumber (%)Number (%)PMale30 (54.5)34 (72.3).064Female25 (45.5)13 (27.7) Age, years .00220-3431 (56.4)12 (25.5) 35-4921 (38.2)24 (51.1) ≥503 (5.5)11 (23.4) Affiliation stream Lithuanian33 (60.0)34 (72.3).06Hasidic11 (20.0)11 (23.4) Other11 (20.0)2 (4.3) Household density*, Median (IQR)1.0 (0.33)1.0 (0.67.9Education level Academic Degree30 (54.5)27 (57.4).8No Academic Degree25 (45.5)20 (42.6) Employment status of the husband Employed35 (63.6)34 (72.3).3Unemployed20 (36.4)13 (27.7) Employment status of the wife Employed45 (83.3)38 (80.9).5Unemployed9 (16.7)9 (19.1) History of SARS-CoV-2 infection Yes38 (69.1)27 (57.4).2No17 (30.9)20 (42.6) SARS-CoV-2 infection among family members Yes43 (78.2)42 (89.4).1No12 (21.8)5 (10.6) Number of family members with a history of SARS-CoV-2 infection, median (IQR)3 (4)4 (3)0.3Number of previously received COVID-19 vaccine doses, median (IQR)2 (1)3 (0)<.001Having supplementary health insurance Yes46 (83.6)45 (95.7)0.06No9 (16.4)2 (4.3) History of receiving an influenza vaccine Yes, according to the recommendations of the Ministry of Health9 (16.4)10 (21.3).5Yes, yearly vaccination until the pre-COVID-19 period5 (9.1)5 (10.6) Yes, since the COVID-19 pandemic1 (1.8)1 (2.1) No40 (72.7)31 (66.0) The COVID-19 vaccines are important, effective, and safe ≥27 (Agree)18 (32.7)34 (72.3)<.00126 or less (Disagree)37 (67.3)13 (27.7) Influence of rabbi and community on COVID-19 vaccine uptake ≥9 (Agree)30 (54.5)29 (61.7).58 or less (Disagree)25 (45.5)18 (38.3) Perception of COVID-19 risk ≥9 (Agree)29 (52.7)28 (59.6).58 or less (Disagree)26 (47.3)19 (40.4) Influence of professional recommendation on COVID-19 vaccine uptake ≥7 (Agree)27 (49.1)32 (68.1).0536 or less (Disagree)28 (50.9)15 (31.9) Community influence on COVID-19 vaccine uptake ≥6 (Agree)34 (61.8)32 (68.1).55 or less (Disagree)21 (38.2)15 (31.9) Family members and environmental influence on COVID-19 vaccine uptake ≥7 (Agree)40 (72.7)32 (68.1)0.66 or less (Disagree)15 (27.3)15 (31.9) Restrictions influence on COVID-19 vaccine uptake 2 (Agree)37 (67.3)35 (74.5).41 (Disagree)18 (32.7)12 (25.5) Haredi communication channels is a primary source of information on COVID-19 Yes14 (25.5)24 (51.1).008No41 (74.5)23 (48.9) * The household density index was calculated as the number of people living in the household divided by the number of rooms in the household. Correlates of intention to receive the fourth dose of the COVID-19 vaccine – bivariate analysis. * The household density index was calculated as the number of people living in the household divided by the number of rooms in the household. A multivariable model showed that participants aged ≥50 years were more likely to report the intention to receive the fourth vaccine dose than those aged 20–34 years and males versus females. Using the Haredi communication channels as the primary information source on COVID-19, the number of previously received COVID-19 vaccine doses and perceiving the COVID-19 vaccine as important, effective, and safe were positively related to reporting intention to receive the fourth vaccine dose (Table 5).Table 5.Multivariable logistic regression model of factors associated with intention to receive the fourth dose (second booster) of the COVID-19 vaccine among ultraorthodox Jewish adults – Israel.VariableUnadjusted OR (95% CI)P valueAdjusted OR(95% CI)P valueAge, yearsdf = 2.003df = 2.05620-34Reference Reference 35-492.95 (1.21-7.17).0172.76 (0.78-9.75).11450+9.47 (2.24-39.98).00212.45 (1.42-108.93).023Sex Male2.18 (0.95-5.00).0664.97 (1.47-16.815).010FemaleReference Reference Haredi communication channels is a primary source of information on COVID-19 Agree3.05 (1.32-7.03).0095.86 (1.58-21.73).008DisagreeReference Reference The COVID-19 vaccine is important, effective and safe Agree5.37 (2.29-12.60)<.0014.11 (1.29-13.13).017DisagreeReference Reference Influence of professional recommendation on vaccine uptake Agree2.21 (0.98-4.97).0551.33 (0.04-4.28).630DisagreeReference Reference Having supplementary health insurance Yes4.40 (0.90-21.50).0673.40 (0.40-28.92).262NoReference Reference Affiliation streamdf = 2.096df = 2.372Lithuanian5.67 (1.17- 27.53).0323.42 (0.29-39.53).324Hasidic5.50 (0.98-30.80).0526.91 (0.43-109.38).170OtherReference Reference Number of vaccine doses received(0-4 discrete variable)2.71 (1.47-4.97).0013.14 (1.31-7.53).010 Table 5.Multivariable logistic regression model of factors associated with intention to receive the fourth dose (second booster) of the COVID-19 vaccine among ultraorthodox Jewish adults – Israel.VariableUnadjusted OR (95% CI)P valueAdjusted OR(95% CI)P valueAge, yearsdf = 2.003df = 2.05620-34Reference Reference 35-492.95 (1.21-7.17).0172.76 (0.78-9.75).11450+9.47 (2.24-39.98).00212.45 (1.42-108.93).023Sex Male2.18 (0.95-5.00).0664.97 (1.47-16.815).010FemaleReference Reference Haredi communication channels is a primary source of information on COVID-19 Agree3.05 (1.32-7.03).0095.86 (1.58-21.73).008DisagreeReference Reference The COVID-19 vaccine is important, effective and safe Agree5.37 (2.29-12.60)<.0014.11 (1.29-13.13).017DisagreeReference Reference Influence of professional recommendation on vaccine uptake Agree2.21 (0.98-4.97).0551.33 (0.04-4.28).630DisagreeReference Reference Having supplementary health insurance Yes4.40 (0.90-21.50).0673.40 (0.40-28.92).262NoReference Reference Affiliation streamdf = 2.096df = 2.372Lithuanian5.67 (1.17- 27.53).0323.42 (0.29-39.53).324Hasidic5.50 (0.98-30.80).0526.91 (0.43-109.38).170OtherReference Reference Number of vaccine doses received(0-4 discrete variable)2.71 (1.47-4.97).0013.14 (1.31-7.53).010 Multivariable logistic regression model of factors associated with intention to receive the fourth dose (second booster) of the COVID-19 vaccine among ultraorthodox Jewish adults – Israel. Discussion We provided new insights regarding COVID-19 vaccine hesitancy among the ultraorthodox Jewish community in Israel. Combining qualitative and quantitative approaches, we developed and validated a culturally tailored questionnaire that evaluated COVID-19 vaccine hesitancy in this special population. We also examined the correlates of intention to receive the fourth vaccine dose. The mixed-methods design enabled a thorough investigation and yielded complementary evidence, surpassing the use of separate qualitative or quantitative approaches. Findings from the qualitative study informed the construction of a questionnaire for the cross-sectional study. The quantitative analysis complemented and reinforced the findings from the qualitative phase. For example, the qualitative study revealed the pivotal role of the rabbi and religious authority in the individual’s decision regarding COVID-19 vaccinations, alongside additional determinants, including family, friends, physicians, and information sources on COVID-19 vaccines. Moreover, the qualitative study demonstrated the complex and dynamic process of the individual’s decision-making regarding vaccination, balancing between perceived vaccine safety concerns and effectiveness and the disease risk and severity while integrating the changes in the disease epidemiology, personal and others’ experiences. These themes went beyond the topics covered in existing vaccine hesitancy scales40–43 and were incorporated in the new questionnaire targeting COVID-19 vaccine hesitancy in the ultraorthodox Jewish population. The qualitative and cross-sectional investigations emphasized the role of perceived vaccine importance, safety, effectiveness, and utilization of Haredi communication channels as the primary information source on COVID-19 vaccine hesitancy in this population. Conversely, some elements found in the qualitative study, namely the role of the rabbi and religious authority, family members and environmental influence, the impact of professional recommendations, and perceived disease risk, were not significantly associated with intentions to receive the fourth vaccine dose in the cross-sectional study; likely due to homogeneous study population. In these circumstances, in-depth interviews are advantageous. The cross-sectional study addressed the role of demographics and healthcare utilization patterns beyond perceptions, thus deciphering the relative importance of diverse correlates. Collectively, these findings highlight the benefits of using mixed methods to enhance the understanding of COVID-19 vaccine hesitancy in this population. Both the qualitative and cross-sectional studies concluded that the individual’s decision regarding COVID-19 vaccine uptake was related to perceptions of the vaccine’s importance, safety, effectiveness, and information sources used to explore COVID-19-related topics. However, additional factors affected COVID-19 vaccine hesitancy, as revealed by the qualitative study, such as culture-specific factors, i.e., the rabbi, and pan-culture cognitive elements and shared mental framework involving critical thinking, learning from others’ experiences, balancing the disease risk, integrating new knowledge and environmental pressure/influence. Distrust in the Ministry of Health regarding the pandemic management and perceived lack of transparency also emerged in the qualitative study. A review of qualitative studies conducted among ethnic minorities revealed that COVID-19 vaccine hesitancy was affected by institutional distrust, beliefs about financial motivations, concerns regarding vaccine safety, effectiveness, development process, and underrepresentation of minorities in trials, misinformation, and limited access to accurate and culturally tailored information.61 Some of these factors are common to our qualitative findings. A qualitative study of ethnic minorities in San Francisco, including Black/African Americans, Latinx, and Chinese Americans, demonstrated the role of misinformation, mistrust of government and health institutions, and access barriers in COVID-19 vaccine hesitancy, concurrent with trust in community-based and faith-based organizations and clinics.62 Another qualitative study of religious leaders from Christian, Jewish, and Muslim communities in the USA showed that they supported their communities’ responses to the COVID-19 pandemic, adapted religious and social activities, and used faith and religious doctrines to encourage compliance with health recommendations.63 These and our findings emphasize the need to build and maintain trust in health institutional authorities and collaborate with community-based entities. In the cross-sectional study, the factor analysis yielded seven factors with good reliability which were used to construct scales to measure perceptions and attitudes related to COVID-19 vaccine hesitancy in this population. In this study, 90.6% of the participants reported receiving the COVID-19 vaccine, 65.6% received three doses, 4.2% received four doses, and most (53.9%) stated they would not complete the four doses. This low acceptance rate of the fourth vaccine dose was surprising, given the high vaccine uptake of three doses, availability, and enhanced access to COVID-19 vaccines in Israel. We found that participants aged 50 years or older were more likely to report the intention to receive the fourth dose of the vaccine compared to those aged 20–34 years, which is consistent with national data18 and previous reports from Israel and elsewhere.28,29,31,64-66 During the study, vaccination with the second booster was recommended and available for all age groups. Therefore, this finding might reflect individual risk assessment since COVID-19 is a less severe illness in young people than in older ones. Indeed, this explanation was supported by our qualitative findings. Males were more likely to report the intention to receive the fourth vaccine dose than females, similar to previous reports.66–68 An interesting finding in our study is that using the Haredi communication channels as the primary information source on COVID-19 was positively related to reporting intention to receive the fourth dose of the vaccine. This likely reflects the strong and effective collaboration between the Ministry of Health and ultraorthodox Jewish leaders in Israel regarding COVID-19 management in this population, which was coordinated via a specific task force that worked closely with these communities to assess the population’s needs and implemented a culturally tailored vaccination campaign, engaging community leaders and cultural motives. Moreover, we found that perceiving the COVID-19 vaccine as “important, effective, and safe” was positively associated with receiving the fourth dose, similar to findings from other studies,22,25,26,66 including in the ultraorthodox community67 emphasizing the importance of reinforcing these messages to the public. Other studies showed that distrust in decision-makers and perception of the COVID-19 risk influenced vaccine intention, particularly in the Arab and Haredi communities in Israel.20,29,69,70 A cross-sectional study conducted among the New York Haredi-Orthodox Jewish community, which was profoundly affected by COVID-19,70 demonstrated high COVID-19 vaccine hesitancy. The correlates of vaccine hesitancy in this population included believing naturally-acquired immunity is better than vaccine-induced immunity, that prior infection paves the way toward resuming communal life, and pandemic-related decline in trust in physicians.70 An online survey on COVID-19 vaccine uptake in Israel’s ultraorthodox Jewish population was conducted nearly six months after the beginning of the vaccination campaign before introducing a booster vaccination.67 It showed differences across ultraorthodox subgroups.67 In our study, vaccine hesitancy regarding receiving the fourth vaccine dose varied slightly according to stream affiliation. However, this difference was not significant in the multivariable models. Perceived vaccine safety concerns and preference for naturally-induced immunity contributed to vaccine refusal,67 confirming Carmody’s et al. results70. Our study has limitations. We relied on a convenience sample; thus, the generalizability of our findings might be limited. The response rate to participate in the study was ~ 30%; we cannot rule out the possibility that more unvaccinated individuals were among those who refused to participate. However, despite these limitations, we captured substantial hesitancy regarding the intention to receive the fourth vaccine dose. We also used self-reported data on vaccination, which might have resulted in reporting bias toward higher vaccine uptake. Nonetheless, the reported vaccine uptake of each dose in our study was consistent with national vaccine uptake levels. Information bias might exist concerning other variables, e.g., socio-demographics. However, the sociodemographic characteristics of the study sample were consistent with those of the ultraorthodox Jewish population in Israel. The small sample size yielded wide confidence intervals and limited precision. The comprehensive approach of integrating diverse research methodologies, including qualitative and cross-sectional studies, constitutes a key strength of the study. The questionnaire was designed to collect information on numerous items, relying on existing literature, input from specialists in vaccinology and public health, and, importantly, using qualitative findings. The collaboration with experts from the ultraorthodox community ensured the questionnaire’s adaptation to participants, fostering increased responsiveness. The interviews were conducted by trusted individuals from the community, which enhanced cooperation and underscored the significance of the research. Furthermore, the study included a good representation of diverse societal streams within the ultraorthodox community. Conclusions In this mixed-methods study, we developed and validated a culturally tailored questionnaire for assessing COVID-19 vaccine hesitancy in the ultraorthodox Jewish population. Our comprehensive findings enhanced the understanding of this phenomenon in the ultraorthodox Jewish population, including influential factors on perceptions and vaccine uptake via complementary evidence from the quantitative and qualitative investigations. Aged ≥50 years, male sex, and relying on Haredi communication channels as the main information source on COVID-19 and perceived the COVID-19 vaccine as “important, effective, and safe” were significantly related to intention to receive the fourth vaccine. The qualitative study captured the pivotal role of the rabbi and religious authority in decision-making regarding COVID-19 vaccinations and, to a lesser degree, the influence of family, friends, and physicians and the evolving nature of decision-making regarding vaccination. These findings are important for enhancing vaccine acceptance in this population. Supplementary Material Supplementary material 4.docx Supplementary material 3.docx Supplementary Material 2.docx Supplementary Material 1.docx