Advances of computational methods enhance the development of multi-epitope vaccines Authors: Yiwen Wei, Tianyi Qiu, Yisi Ai, Yuxi Zhang, Junting Xie, Dong Zhang, Xiaochuan Luo, Xiulan Sun, Xin Wang, Jingxuan Qiu Published: 2025 ABSTRACT AbstractVaccine development is one of the most promising fields, and multi-epitope vaccine, which does not need laborious culture processes, is an attractive alternative to classical vaccines with the advantage of safety, and efficiency. The rapid development of algorithms and the accumulation of immune data have facilitated the advancement of computer-aided vaccine design. Here we systemically reviewed the in silico data and algorithms resource, for different steps of computational vaccine design, including immunogen selection, epitope prediction, vaccine construction, optimization, and evaluation. The performance of different available tools on epitope prediction and immunogenicity evaluation was tested and compared on benchmark datasets. Finally, we discuss the future research direction for the construction of a multiepitope vaccine. Introduction Vaccination is the most cost-effective intervention for the prevention and treatment of disease, which could save over 2.5 million people in estimation each year [1], and vaccination is seen as one of the most important medical achievements of the past two centuries [2]. The development and publicize of multiple specific-disease vaccines have greatly decreased the morbidity and mortality rates, as well as lightened the social health burden. Typical examples such as the mortality and incidence rate of tetanus, measles, mumps, and other similar diseases have been dramatically reduced by 99% or even eradicated to the popularity of related vaccines [3]. More recent examples of COVID-19 vaccines can quickly control the devastating coronavirus outbreak, demonstrating the power of vaccines. The successful development of therapeutic vaccines for prostate cancer and multivalent vaccines for pneumococcus indicates that the effect of vaccines has been extended to the prevention and treatment of cancer and other diseases with high antigen variability [3]. The clinical trial result of mRNA vaccines against melanoma exhibited the potential and promise of personalized cancer vaccines [4]. A vaccine is a biological product that must contain antigenic components derived from the pathogen or produced synthetically to represent the pathogen [5]. Vaccines could effectively control the spread of infectious disease outbreaks, the faster a vaccine is deployed, the faster an outbreak can be controlled [6]. However, it would take almost 5-10 years to develop a traditional live-attenuated vaccine or inactivated vaccine [6], the time–cost and tedious experiment process makes classical vaccines not suitable for the prevention and control of emergent epidemics. In addition, the attenuated or killed part of pathogens may return to its virulent state which would lose the ability to protect and may even cause damage to the human body [7]. Besides classical live-attenuated and inactivated vaccines, there are several platforms including subunit vaccines, nucleic acid-based vaccines, viral vectors, and virus-like particles have been developed over the past few decades [5]. The subunit vaccines and other platforms could eliminate the risk of ‘return to virulent state’, meanwhile subunit vaccines are more controllable, which are defined as a vaccine that recognizes and utilizes only the antigenic components of the whole pathogen as the novel antigens [8]. Subunit vaccines are mostly composed of one or multiple protein antigens [9], and this composition would not introduce non-antigenic components like classical vaccination using whole organisms which could improve safety, while the recombinant protein-based subunit vaccines would face the questions as high-cost, low stability and difficult to purify and the risk of autoimmune responses [9, 10]. The use of epitopes for the development of subunit vaccines is considered an attractive solution since the epitope-based vaccine can be produced easily and economically with high effectiveness and minimal side effects. The antigenic epitope is the particular part of an antigen that would be recognized by receptors and the basic unit that could elicit an adaptive immune response [11]. The multi-epitope vaccine is a promising strategy for the prophylactic and therapeutic against tumors and viral infections [12], meanwhile, an epitope-based strategy also plays an important role in assisting mRNA vaccine design [13], mRNA vaccine is one of the technologies leading the development of COVID-19 vaccines. Currently, there are 102 multi-epitope vaccines targeting various diseases at different stages of clinical trials, 10 of which are against COVID-19. (https://clinicaltrials.gov/) (20,240,803). With the explosion of immune-related information and the development of technology, classical immunology has been overtaken by a high-efficiency in silico approach, termed Reverse Vaccinology (RV) (i.e. genomic-based rather than pathogen itself approaches to develop vaccines) [14, 15]. Other in silico processes such as subtractive genomics, proteomics, computational vaccinology, and immunoinformatics, have been proposed and integrated with RV to make the development of vaccines from conventional methods to rational design based on the knowledge of whole genome sequence, host-pathogen interaction, immunological data, omics technologies, and computational tools [16–18]. The advancement of computational methodologies has significantly facilitated vaccine development. For instance, RV-related technologies can be employed to modify virulence gene fragments in pathogens for attenuated vaccines. For nucleic acid vaccines, the antigen sequences can be screened through data resources and be optimized by the property calculation. The stability and immunogenicity of VLPs can be assessed through structural modeling and in silico prediction. In terms of subunit vaccines, especially for multi-epitope vaccines, different algorithms could be applied in the process of vaccine development, including rapid screening of candidate antigens, high-throughput prediction of core epitopes, vaccine optimization, and immunogenicity prediction. Most computational tools are easy to use, open source, and user friendly, and have paved the way to the rational development of multi-epitope vaccines. In this review, we summarized the critical steps of rational development of multi-epitope vaccines and the advances in relevant computational tools and immune databases, we also discussed the current strategies and widely used bioinformatics tools of each step for the development of multi-epitope vaccines on the basis of the relative literature. Further, we designed three benchmark validations on T-cell epitope predictors, B-cell epitope predictors, and immunogenicity predictors for real-world vaccine sequences. While there is still room for improvement in prediction performance, the benchmark test and real-world successful cases illustrated that in-silico methods have broad potential for vaccine development. The pipeline of design epitope vaccines and related information resources The development of multi-epitope vaccines is a multi-step process, and the computational design of vaccines is mainly focused on four aspects (Fig. 1). (a) Determination of potential vaccine antigen candidates and predicting epitopes with desired ability to evoke immune response. The immunogen is the core element of rational multi-epitope vaccines and determines the immune target and specificity. Identification of appropriate epitopes is the key part of epitope vaccines, which would influence immune efficiency and coverage [13]. (b) Computationally construction of vaccines with the aid of adjuvant, linker, and other functional peptides, helps maintain the immunogenicity and stability of vaccines. (c) Optimizing designed vaccines through in silico codon optimization could improve expression efficiency [10]. (d) Immunological testing and validation. A series of evaluations for vaccines should be taken to screen the ideal vaccine with the ability to induce a robust immune response, non-allergic and non-toxic to humans, and could provide broad protection. In silico evaluation could help reduce the time of experimental validation. The necessity and significance of each step will be discussed in the corresponding section of this review. Steps of rational in silico design a multi-epitope vaccine. The process could be divided into four parts: A. Immunogen design, the designed multi-epitope vaccine is expected to protect humans against most strains of the targeted pathogen which is related to the selection of representative antigens and the prediction of epitopes at first. Appropriate identification of antigen and epitope is the core step of development of vaccines which determines the efficiency and specificity of the induced immune response. B. Vaccine construction, the vaccine candidates could be constructed with the aid of adjuvant, linker, and other functional peptides after the determination of antigenic epitopes. The application of them is to increase the immunity of vaccines. C. Vaccine optimization, to achieve the maximal expression of designed vaccines in heterologous hosts, the codon optimization of constructed vaccines should be performed using bioinformatics tools. D. in silico evaluation, the designed vaccine candidates should be verified by a series of computational evaluations before the experiments which could reduce the number of experiments and save unnecessary losses. The accurate selection of appropriate antigens and their immunodominant epitopes is the first key and selective step for the development of the multi-epitope vaccine [12]. With the development of relevant technologies and a deeper understanding of related knowledge of immunity, the bioinformatics-based methods for protein antigen selection have taken over classical vaccinology which is laborious and time-consuming conventional approaches that require pathogen cultivation. There are many related immunological databases and analytical tools have been created by researchers for vaccine design in the past few decades, the type of information has almost covered all fields and reliable. The detailed description of these databases such as the amount and type of stored data are listed in Table 1. The integrated approaches were proposed to accelerate the progress of filtering and determining the antigen proteins, there are several computational pipelines for the identification of potential vaccine candidates (PVCs) have been developed, taking the genomes or proteomes of pathogens as input, the final output is the predicted or created PVC of the whole data which could be used for further study. The description of typical tools can be found in the ‘Supplementary Pipelines for PVCs’ part. Table 1List of immune-related databasesNameApplicationExternal toolsManual curationExperiment validationData (20240726)URLRefDatabase for comprehensive informationVIOLINVarious vaccine-associated research data>10 relatively independent programsYY4708 vaccines or vaccine candidates for 219 pathogens, 24,345 vaccine-related abstracts, and 10,317 full-text documents https://violinet.org/ [19]IEDBImmune epitope data related to all species and includes antibody, T cell, and MHC binding contextsEpitope prediction tools, epitope analysis toolsYY1,619,740 peptidic epitopes, 3188 non-peptidic epitopes, 537,708 T cell assays, 1,406,296 B cell assays, 4,879,777 MHC ligand assays, 4520 epitope source organisms, 1011 restricting MHC alleles, and 24,982 references https://www.iedb.org/ [20]CEDARA companion site of IEDB, providing cancer-specific epitope and receptor dataEpitope prediction tools, epitope analysis toolsYY1305,154 peptidic epitopes, 87 non-peptidic epitopes, 151,618 T cell assays, 131,693 B cell assays, 4,057,203 MHC ligand assays, 1663 epitope source organisms, 662 restricting MHC alleles, and 5264 references https://cedar.iedb.org/home_v3.php [21]IMGTGenes, sequence, and structure information of immunoglobulin and T cell receptor of vertebrates.17 online tools of genes, sequences and structuresNNcomprises 7 databases, 17 online tools, and > 20,000 pages of web resources. https://www.imgt.org/ [22]AntigenDBantigens with basic information and additional informationEpitope search; peptide mapping; antigenic blast;NYan extensive collection of proteins, glycoproteins, and lipoproteins (>500), extracted from 44 important pathogenic species http://www.imtech.res.in/raghava/antigendb/ [23]Databases for immunogenic/antigenic peptides and proteinsAntiJen v2.0continuous quantitative data on immunological molecular interactions, data from position-specific peptide libraries, and biophysical dataa nucleotide and a peptide BLAST searchNYover 24,000 entries from published experimentally determined data https://www.ddg-pharmfac.net/antijen/AntiJen/antijenhomepage.htm [24]PIRDproject information, sample information, raw sequencing data, annotated TCR or BCR repertoires, and TBAdbData analysis tools, data visualization toolsNNContain 3 projects: ~3657 samples, ~11,395,649,000 sequences, ~3657 locus information https://db.cngb.org/pird/ [25]AgAbDbstructure and derived data of antigen–antibody interactions; can be used as benchmark dataset of B-cell epitopesJmol visualized program; a tool for predicting epitopesNY427 antigen–antibody complexes contain 289 protein-Ab complexes and 138 peptide-Ab complexes http://bioinfo.net.in/AgAbDb [26]BcipepComprehensive information about linear B-cell epitopes, including related monoclonal or polyclonal antibodies, and neutralization potential of anti-peptide antibodypeptide mapping and antigenic BLAST;NY3031 entries that include 763 immunodominant, 1797 immunogenic, and 471 null-immunogenic epitopes http://www.imtech.res.in/raghava/bcipep [27]EPIMHCMHC-binding peptides and T-cell epitopes that are observed in real proteinsNANN4875 distinct MHC-binding peptides, of which 2224 are T cell epitopes (1267 MHCI-restricted targeted 226 MHCI and 957 MHCII-restricted targeted 226 MHCII), including 84 epitopes derived from tumor-associated antigens http://bio.med.ucm.es/epimhc/ [28]TANTIGEN2.0Information on human tumor antigens that contain T cell epitopes and HLA ligands, and information on validated TCR moleculesBlast, MAFFT, HLA binding prediction tools, visualization toolsYY4296 antigen variants from 403 unique tumor antigens and more than 1500 T cell epitopes and HLA ligands http://projects.met-hilab.org/tadb/ [29]Protegenprotective antigens and associated informationBLAST programYY1631 protective antigens http://www.violinet.org/protegen [30]Epitomeall known antigen/ antibody complex structures and detailed information of interaction residuesJmol visualized program; BLAST searchNY142 antigens from protein–antibody complex structures with a current total of 10,180 antigenic interactions http://www.rostlab.org/services/epitome/ [31]CEDconformational epitopes and related informationvisualization toolYY225 entries http://web.kuicr.kyoto-u.ac.jp/~ced [32]SEDB3D structure of epitopes and its interaction with antigens and antibodies; B-cell, T-cell, and MHC binding proteinsGene-Ontology, MolProbity, epitope visualization tool; blast toolNY299 MHC-binding epitopes, 272 B-cell epitopes, 419 linear epitopes, 49 T-cell epitopes, 64 non-peptidic epitopes, and 126 discontinuous epitopes, among them 614 epitopes are determined by X-Ray http://sedb.bicpu.edu.in/ [33]Database for immune-related molecules, such as MHC, TCR,ATLASinformation on affinities, structures, and experimental details for TCRs, peptides, and MHCsModeling software (Rosetta program)YY694 measured binding affinities of TCR-pMHC complexes https://zlab.umassmed.edu/atlas/web [34]STCRDabTCR structure data with annotations; a resource that automatically collects and curates TCR structure data from PDBModeling toolYY618 PDB entries with a TCR structure, 851 αβTCRs, 18 γδ TCRs, 680 TCRs complexed to MHC/MHC-like molecules, also contains 37 CDR clusters cover 6 types https://opig.stats.ox.ac.uk/webapps/stcrdab-stcrpred/ [35]TBAdbdeposited in PIRD; Antigen-specific TCRs and BCRs informationNAYN52,287 sequences with 71 diseases https://db.cngb.org/pird/ [25]TCRdbhuman TCR beta chain sequences associated with specific tissue/clinical condition/cell typeNAYN131 TCR-Seq projects, 8265 TCR-Seq samples, and 277,439,349 TCR CDR3 sequences https://guolab.wchscu.cn/TCRdb/#/ [36]SYFPEITHIMHC ligands and peptide motifs of humans and other speciesEpitope prediction toolNN> 7000 peptide sequences known to bind class I and class II MHC molecules http://www.syfpeithi.de/ [37]McPAS-TCRDetailed information on pathology-associated TCR sequences;NAYYAbout 40,000 TCR information http://friedmanlab.weizmann.ac.il/McPAS-TCR/ [38]VDJdbKnown antigen-specific TCR sequencesan epitope-centric approach to TCR annotationYYAbout over 80,000 TCR records, over 2000 unique epitopes, and over 500 studies https://vdjdb.cdr3.net/ [39]MPID-T2Sequence–structure–function information on pMHC and TR/pMHC interactionsNAYY415 entries from five MHC sources, spanning 56 alleles; 353 pMHC structures, 62 TR/pMHC complexes; 352 MHC class I complexes, and 63 MHC class II structures http://biolinfo.org/mpid-t2/ [40]MHCBNSequence and structure data of MHC binding and non-binding peptidesmapping of peptide on query sequence; creation of data sets; blastNY19,777 entries including 17,129 MHC binders and 2648 MHC non-binders for >400 MHC molecules http://crdd.osdd.net/raghava/mhcbn/ [41]Other immunological repositoriesPRRDBComprehensive information about pattern-recognition receptors (PRRs) and their ligandsBLAST and Smith-Waterman algorithmYYextensive information about 467 unique PRRs and 827 ligands from ~600 research articles https://webs.iiitd.edu.in/raghava/prrdb2/ [42]InnateDBMolecular interactions and pathway annotations of relevance to all mammalian cellular systemsvisualization tool; data analysis toolsYY18,780 interactions https://www.innatedb.com/ [43]AFNDfrequency data on the polymorphisms of several immune-related genesvisualization tools; analysis toolsNN1801 population studies, 1785 gene/allele data, 683 haplotype data, and 192 genotype data http://www.allelefrequencies.net/ [44]DEGcurrently available essential gene records among prokaryotes and eukaryotesblast tool; essential-gene analysis toolsNY~35,000 genes records for prokaryotes, ~50,000 genes records for eukaryotes http://origin.tubic.org/deg/public/index.php [45]ViPRinformation for several human pathogenic viruses; supported by NIAIDanalytical and visualization toolsNNInformation for over 50,000 virus strains from 912 species belonging to 70 genera and 14 families www.ViPRbrc.org [46]Database for specific diseases required for designing subunit vaccines.MycobacRVknown mycobacterial vaccines; epitope information for predicted adhesins; Allergen data; epitope conservation data;analysis toolsNN25 Mycobacterial strains and species, a list of 742 adhesin and adhesin-like proteins having extracellular and cell surface localization, and a list of 233 non-redundant most probable adhesin vaccine candidates https://mycobacteriarv.igib.res.in/ –FungalRVimmunoinformatics data on predicted adhesins and adhesin like proteins; known fungal vaccines; epitope information for predicted adhesins; Allergen data;Adhesin predictor; analysis toolsNNpredicted 307 adhesin and adhesin-like proteins and known vaccine candidates https://fungalrv.igib.res.in/ [47]HPVdbantigen entries derived from high/low-risk HPV genotypes, T cell epitopes, and HLA ligandsBasic and specialized analysis toolsYY2781 curated antigen entries of antigenic proteins derived from both 18 genotypes of high-risk HPV and low-risk HPV, 191 verified T cell epitopes, and 45 verified HLA ligands http://cvc.dfci.harvard.edu/hpv/ [48]HIV DATABASESdata on HIV genetic sequences and immunological epitopesanalysis tool and visualization toolNN4287 antibodies, >150,000 antibody neutralization assay IC50 values, 2058 unique immunogenic CD8+ CTL epitopes, 725 unique immunogenic CD4+ T helper epitopes https://www.hiv.lanl.gov/content/index –dbEBVEBV genomic variation landscape; global frequency and relationship with human health of each variantevolutionary tree building; visualization toolNNcurated 942 EBV genomes with 109,893 variant loci from different tissues or cell lines in 24 countries http://dbebv.omicsbio.info/ [49]EBVdbInformation on EBV antigens, verified T cell epitopes, and HLA ligandsAnalysis tools; Visualization toolYY2622 curated EBV antigenic proteins, 610 verified T cell epitopes, 26 verified HLA ligands http://projects.met-hilab.org/ebv/ [50]FLAVIdBinformation on protein sequences, immunological data, and structural data of flavivirusAnalysis tools; Visualization toolYY12,858 entries of flavivirus antigen sequences, 184 verified T-cell epitopes, 201 verified B-cell epitopes, and 4 representative molecular structures of the dengue virus envelope proteincvc.dfci.harvard.edu/flavi/[51]FluKBcurated immunological data and protein sequence data of influenzaanalytical tools; Visualization toolYNOver 400,000 influenza protein sequences, 357 verified T-cell epitopes, 685 HLA binders, 16 naturally processed MHC ligands, and a collection of 28 influenza antibodies and their structurally defined B-cell epitopes http://research4.dfci.harvard.edu/cvc/flukb/ [52]ViralZonegraphics describing virion organization, genome transcription, and translation strategies; fact sheets on all known virus families/generaClustalW alignment softwareYN879 Virus description pages: 158 families, 711 genera, 8 individual species, 352 viral molecular biology pages https://viralzone.expasy.org/ [53]SDAPSequence, structure, IgE epitopes, and binding data of allergenic proteinsModeling tools; analysis toolsNN1908 allergens and isoallergens, 1628 Protein sequences for allergens and isoallergens, 109 Allergens with PDB structures, 378 3D models for allergens and isoallergens, 30 Allergens with IgE epitope sets, 233 new Pfam allergen classes http://fermi.utmb.edu/SDAP/ [54]The built-in tools such as searching and browsing are included by all database, thus not listed in external tools column.Key for application and data column: pMHC = peptide-major histocompatibility complex molecules, TR/TCR = T-cell receptors, CDR = complementary-determining region 3. List of immune-related databases The built-in tools such as searching and browsing are included by all database, thus not listed in external tools column. Key for application and data column: pMHC = peptide-major histocompatibility complex molecules, TR/TCR = T-cell receptors, CDR = complementary-determining region 3. Immunogen design An ideal multi-epitope vaccine should composed of various B cell epitopes and T cell epitopes that could elicit cytotoxic T cell (CTL), helper T cell (Th), and B cells, and induce an effective immune response against target pathogens [11]. The traditional way to determine epitopes is laboratory-based which is a time-consuming process and obtains limited results, so the sight of predicted epitopes turned to computational methods. The epitopes could be classified as B cell epitopes (BCEs) and T cell epitopes (TCEs), and their generation processes are different, this review will discuss BCEs and TCEs separately below. T-cell epitope prediction An antigen usually goes through three processes for eliciting an adaptive immune response of hosts: (i) antigen processing and presentation, (ii) peptide binds to MHC molecules and is presented by MHC, and (iii) T-cell receptor recognizes the peptide–MHC complex [55]. The detailed illustration of three processes of endogenous antigen and exogenous antigen can be found in the ‘Supplementary Endogenous/exogenous processing of antigens’ part. MHC class I molecules consist of a single chain and the binding groove is closed, so the short peptides of 8-11 amino acids are preferred to bind to MHC class I [56]. The binding groove of MHC class II molecules is open, so the MHC II-bound peptide length would range from 11 to 25 residues, while only the core of nine residues sits in the binding groove [57]. The difference in structure between MHC class I molecules and MHC class II molecules makes the difficulty level of prediction of the binder different. The detailed diagrammatic presentation can be seen in Fig. 2. Based on the processing of antigens, the epitopes prediction tools could be divided into four categories: prediction of antigen processing and presentation, prediction of pMHC binding, prediction of T cell recognition of pMHC complexes, and miscellaneous methods. The paper mainly introduces the characteristics of the above four types of methods, widely used tools, and promising tools currently developed. The feature, claimed prediction performance and other information of typical tools of each category can be seen in Table 2. Diagrammatic presentation of endogenous processing of antigens and exogenous processing of antigens. A. Presents the endogenous processing of antigens. B. Presents the exogenous processing of antigens. From left to right is the process of antigen processing and presentation, peptides bind to MHC molecules, p-MHC complexes are transported to and recognized by TCR molecules. (i)-(iv) represent different tool types. The differences in processing details and tools can be seen below. Table 2The list of in silico tools for predicting T-cell epitopesRelated process Method namefeatureTraining datasetMHC classPan-/specific-Performance measureyearRef Acc (%)AUCMCCSens (%)Spec (%) Prediction of Antigen Processing and PresentationNetChop v2.0NN-based model for predicting proteasome cleavage motifsMHC I ligand dataset: 458 cleavage sites determined by MHC-I ligands of 188 human protein; In vitro degradation dataset: 184 distinct sitesI–0.530.800.882002[58]TAPPredsequence-based SVM or cascade SVM model for predicting TAP ligands431 peptides, including 409 bind to TAP with varying affinity, and 22 peptides have negligible or no binding affinityI––––––2003[59]ProPred1matrix-based method for predicting MHC binders with proteasomal cleavage site–I–0.80––0.810.672003[60]RANKPEPHybrid method using PSSMs or profiles for predicting MHC binders, statistical language models for predicting proteasomal cleavageTraining sets for statistical modeling: C-terminus and flanking regions of 332 antigens restricted by human MHC-II, II––>0.8–––2004[61]NetChop v3.1NN-based model using new sequence encoding schemes for predicting proteasome cleavageMHC I ligand dataset: 746 cleavage sites; In vitro degradation dataset: 164 cleavage sitesI––0.850.48––2005[62]PcleavageSVM-based model for predicting constitutive proteasome and immunoproteasome cleavage sitesin vitro digested dataa, 506 MHC ligandsb from over 250 proteinsI–70.0a 76.7b0.805a 0.615b0.43a 0.54b84.6a 84.3b55.6a 68.0b2005[56]NetCTL 1.2Hybrid model integrates MHC class I binding, proteasomal cleavage, and TAP transport efficiency863 epitope-protein pairs, all 9 mer peptides contained in the source protein sequences with no annotated are seen as negative peptidesI12 MHC-I supertypes>0.722007[63]TAPregSVM-based model for predicting affinity of peptides to TAP613 nonamer peptides with various TAP affinities,I––––––2009[64]TAP HunterSVM-based model using sequence local description for predicting variable-length TAP ligands276 TAP binding and 94 non-binding nonamer peptidesI–0.880.882010[57]Prediction of Peptide–MHC BindingSequence-basedBIMASquantitative matrices-based model using linear regression on the measured half-life of HLA-A2 complexes with bound peptide–I––––––1994[65]MOTIFMotif-based–I–1995[66]SYFPEITHIdatabase for MHC ligands and peptide motifs, also provide prediction of epitope based on motif–I, II–1999[37]TEPITOPEMethod combines virtual matrices and DNA microarray technology–IIpan1999[67]SVMHCSVM-based model for MHC-I binders, and matrices-based method for MHC-II bindersSYFPEITHI data: 3500 sequences that are natural ligands to T-cell epitopesI, II–0.850.902002[68, 69]Udaka et al.A query learning algorithm based on HMM model329 binding peptidesI–0.842002[70]NetMHCquantitative ANN model400 9mer peptides with various binding affinities, 65 QBC-selected peptides for binding to HLA-A*0204I–2003[71]PEPVACPSSM-based model combined with a dynamic algorithm, also can predict proteasome cleavage using probabilistic language models–ISupertypes, A2, A3, B7, A24 and B15>0.82005[72]MULTIPREDMethod provides HMM or ANN model for predicting9mer peptide sequences: 3050 (664 binders and 2386 non-binders) related to 15 variants of A2 supertype, 2216 (680 binders and 1536 non-binders) related to 8 variants of A3 supertype and 2396 (448 binders and 1948 non-binders) related to 6 DR variantsI, IISupertypes, class I A2, A3, and class II DR>0.82005[73]NetMHCIISMM-align methodquantitative MHC–peptide binding data: 5147 peptides covering 14 HLA-DR and three H2-IA allelesII–0.7562007[74]NetMHCpanANN-based model37,384 unique peptide-HLA interactions, 26,503 interactions covering 24 HLA-A alleles, 10,881 interactions covering 18 HLA-B allelesIpan0.950.742007[75]NetMHCIIpanANN-based model using SMM-align method14,607 unique peptide-HLA interactions, 7839 positive binders, and 6768 negative samplesIIpan0.7872008[76]MULTIPRED2System using NetMHCpan 2.0 and NetMHCIIpan 1.0 as prediction engines for individual or combination of alleles, or supertypes–I, IIsupertypes, 13 class I and 13 class II–––––2010[77]NetMHC4.0a sequence alignment method based on pan-length ANNIEDB dataset covering 118 MHC class I alleles and each allele with over 20 binders as positive, 100 random natural peptides as negativesI–>0.882016[78]MixMHCpredMHC-I ligand predictor using an unsupervised way to annotate motifs based on co-occurrence of HLA-I allelesHLA peptidomics data (58 alleles in total)Ipan0.9792017[79]HLAthenaModel with three single-layer neural networks trained on mass spectrometry data and different peptide encoding.186,464 eluted peptides from 95 allelesIpan2019[80]MixMHC2predMHC-II ligand predictor using a motif deconvolution algorithm combines unbiased mass spectrometry to train models99,265 unique peptides eluted from HLA-II moleculesIIpan0.832019[81]NetMHCpan-4.1ANN-based model using NNAlign_MA framework to train data13,245,212 data covering 250 distinct MHC class I moleculesIpan>0.985*2020[82]NetMHCIIpan-4.0ANN-based model using NNAlign_MA framework to train data4,086,230 data covering a total of 116 distinct MHC class II moleculesIIpan>0.975*2020[83]MHCflurry 2.0Integrated predictor which combined models for MHC I binding and antigen processing75,378 entries from 56 samplesIpan>0.912020[84]RBM-MHCMethod combines a Restricted Boltzmann Machine based model and a semi-supervised HLA-I classifierThe data is from mass spectrometry and binding affinity assays available in IEDBIpan0.972021[85]TransPHLAtransformer-based model using self-attention112 HLA-I alleles, 359,166 positive data (pHLA binders) and 1,795,830 negative data (non-binding pHLAs)Ipan>0.9>0.9>0.8––2022[86]MixMHC2pred v2.02 successive blocks of NNs with distinct tasks based on the binding motifs and peptide sequence featuresHLA peptidomics dataset of 627,013 unique MHC-II ligands and derive motifs for 88 MHC-II allelesIIpan0.9452023[87]BigMHCModel comprise an ensemble of seven deep neural networks, offering two models: ELa and IMb259,298 EL and 15,065,287 negative instancesa; 1407 antigens and 4778 negativebIpan0.9733a 0.7767b2023[88]TripHLApanModel integrates triple coding matrix, BiGRU+Attention models, and transfer learning strategy2,788,602 HLA-I peptides (464,767 positive sample); 963,186 HLA-II peptides (160,531 positive samples)I, IIpan–0.979–––2024[89]MixMHCpred 3.02 blocks of NNs based on the binding motifs and peptide length distributionsHLA peptidomics dataset of 511,553 ligands interacting with 143 MHC-I allelesIpan>0.982024[90]ConvNeXt-MHCMethod using degenerate coding approach and ConvNeXt model, which combines transfer learning and semi-supervised learning methodsmass spectrometry training seta: 206,515 positive data points and 842,060 negative data points; pMHC affinity training setb: 210,509 positive data points and 38,633 negative data points.Ipan0.964a 0.9048b–0.886a’0.8143b––2024[91]ImmuneAppAn interpretable, attention-based hybrid deep learning framework, offering ImmuneApp-Neo for immunogenicity prediciton349,650 ligandsIpan0.96502024[92]Structure-based MethodEpiDockMethod based on homology modeling and docking score-based quantitative matrix–II–0.832013[93]MHCfoldConsist of a CNN-based modeling module and a transformer’s encoder-based specificity module390 pMHCI structures; 3,459,753pMHCI pairsI–0.942022[94]Fine-tuned AlphaFold 2a simple classification module on top of the AlphaFold network and fine-tuning the combined network parameters for predicting MHC binderstraining set consisting of 10,340 pMHC examples, 203 structurally characterized and 5102 modeled pMHC binder examples, and 5035 non-binder examples, distributed across 68 Class I alleles and 39 Class II allele pairs.Ia, IIb–0.97a 0.93b2023[95]Prediction of T cell recognition of pMHC complexessequence-basedNetTCR-1.0CNN-based model9012 positive and 66,102 negative TCR-peptide combinations, spanning 91 peptides and 8920 TCR sequencesI–0.7272018[96]ImRexa CNN with the combined representation of sequences of epitopes and TCR CDR3Mixed chain dataset: 19,842 unique TCR CDR3 alpha/beta sequences-epitope pairs, 120 epitopes; alpha chain dataset: 5654 sequences, 60 epitopes; beta chain dataset: 14,188 sequences, 118 epitopesI–0.682021[97]structure-based models hybrid approachesTCRdockPipeline consists of a specialized version for TCR-pMHC modeling of AlphaFold and matric-based score function279 total training examplesI–0.822023[98]RACERa coarse-grained, chemically accurate energy model relies on known TCR–peptide structures and experimental dataconsist of three TCRs pre-identified strong-binding peptides and decoy peptides with randomized sequencesI–0.892021[99]NetTCR 2.2CNN-based model combining pan- and peptide-specific training, loss-scaling, and sequence similarity integration6353 TCR sequences across 26 peptides as positive set, negatives were generated by swapping the TCRs for a given peptide with TCRs binding to other peptides, IMMREP 2022 datasetIpan0.84762023[100]CATCRsystem using CNN model extract structure features and a transformer to encode segment-based coded sequence features65,069 CDR3β–epitope pairsI0.8480.892024[101]Miscellaneous methodsCTLpredMethod based on QMa, ANNb, and SVMc model for predicting CTL epitopes, also provides consensusd and combinede approaches1137 CTL epitopes, 1134 non-epitopesI–0.700a 0.722b0.752c 0.776d 0.758e0.652a 0.732b 0.738c 0.669d 0.797e0.749a 0.712b 0.770c 0.884d 0.719e2004[102]IL4predSystem provides SVM-based modela and hybrid approachb for predicting IL4 inducing peptides904 experimentally validated IL4-inducing and 742 non-inducing MHC class II bindersII–0.6908a 0.7576b–0.38a 0.51b0.7058a 0.7876b0.6725a 0.721b2013[103]IFNepitopeSystem provides motif tool, SVM-based modelb, and hybrid approachc h for predicting IFN-γ inducing peptidesmain dataset: 3705 IFN-γ inducing and 6728 non-IFN-γ inducing MHC class II binders; IFNgOnly dataset: 4483 IFN-γ inducing epitopes and 2160 epitopes that induce other cytokine except IFN-γII–0.7954b 0.8210c0.55b 0.62c0.665b 0.7798c0.8671b 0.8436c2013[104]CD4episcoreSystem provides an ANN-based model for immunogenicity predictionb, 7-allele method for HLA binding predictionsa, and combine methodcTraining dataset consists of two sets: experimental data (1032 positive epitopes and 5739 negative peptides), tetramer data (124 positives and 5319 negative peptides)II–0.703a 0.702b 0.725c2018[105]Key for feature: NN = neural network; SVM = support vector machine; HMM = Hidden Markov Models; PSSM = position-specific scoring matrix; ANN = artificial neural network; SMM-align = stabilization matrix alignment method; CNN = Convolutional Neural Networks; QM = quantitative matrix. EL = eluted ligands. BA = binding affinity. Key for Performance measure: Acc (%) = accuracy; AUC = Area Under the ROC Curve; MCC = Matthew’s correlation coefficient; Sens (%) = sensitivity; Spec (%) = specificity. *: This value represents the averaged AUC value of multiple HLA molecules reported in this paper. The list of in silico tools for predicting T-cell epitopes Key for feature: NN = neural network; SVM = support vector machine; HMM = Hidden Markov Models; PSSM = position-specific scoring matrix; ANN = artificial neural network; SMM-align = stabilization matrix alignment method; CNN = Convolutional Neural Networks; QM = quantitative matrix. EL = eluted ligands. BA = binding affinity. Key for Performance measure: Acc (%) = accuracy; AUC = Area Under the ROC Curve; MCC = Matthew’s correlation coefficient; Sens (%) = sensitivity; Spec (%) = specificity. *: This value represents the averaged AUC value of multiple HLA molecules reported in this paper. Prediction of antigen processing and presentation Natural processing by cellular antigen processing machinery is a necessary step for peptides that would be presented on MHC class I molecules. The first step is the antigen protein was cleaved by the proteasome and the potential epitopes were generated [106]. The prediction of the cleavage site of the proteasome is vital for the identification of potential immunogenic regions in a pathogen protein and the step also shows some degree of specificity. Based on this theory, computational methods such as NetChop [58] and Pcleavage [56] have been developed. The proteasomal fragments were translocation into the endoplasmic reticulum by TAP, and the efficiency of TAP-mediated translocation of peptides has been shown to be proportional to its TAP binding affinity [107]. Studying the selectivity and specificity of TAP may contribute significantly to predicting CTL epitopes. Several in silico methods have been proposed to test whether peptides are capable of binding TAP, such as TAPPred [59], TAP Hunter [57], and TAPreg [64]. There are also hybrid approaches have also been proposed, such as ProPred1 [60] and RANKPEP [61] tools combine the proteasomal cleavage with the process of MHC binding to peptides, and the NetCTL 1.2 [63] tool increases the transfer efficiency of TAP on top of these two processes. Nevertheless, these strategies have limited improvement in performance, the reason might be the insufficient specificity of both proteasomal cleavage and TAP transport predictors, which makes the most predicted binders cannot be identified and presented to MHC class I molecules successfully [107]. For MHC-II molecules, the antigen process has been studied in several researches but related computational approaches have not been widely developed yet [108]. The mentioned approaches have been concluded in Table 2. Prediction of peptide–MHC binding The binding of peptide and MHC molecule is the most selective step [109], numerous predictors have been developed which aim to solve three questions: (i) distinguish MHC binders from nonbinders, (ii) predict the binding affinity of peptides to MHC molecules, and (iii) deal with human leukocyte antigens (HLAs) polymorphism (i.e. MHC molecules are known as HLA in humans). The frequency of HLA alleles can vary greatly in different ethnicities and HLA alleles bind distinct sets of peptides, specific epitopes focused on different ethnicities could be predicted by the research of HLA alleles and specific multi-epitope vaccines could be developed [55]. For well-studied HLAs, the determination of binders and calculating the binding affinity can be achieved by most of prediction tools. However, for the less-studied HLAs which are the majority, the traditional approach that generated large data sets of each HLA allele is unfeasible [110], thus the solution of HLA polymorphism is an important difficulty of design of epitope predicted tools to be considered. The first approach to solve the problem which is the extreme polymorphism of the MHC is to define HLA supertypes. Some researchers found out that different HLA molecules could bind to similar peptides and developed methods to cluster HLA molecules with similar peptide binding specificity as HLA supertypes [110]. In 1999, Sette et al. defined nine HLA Class I supertypes and proved that these nine supertypes could cover almost all known binding properties of HLA class I molecules [111]. Thus, the epitope of unseen HLA molecules could be obtained by predicting the affinity of the peptide with a single MHC molecule representing the corresponding supertype, and this could achieve the population-wide epitope discovery. The following similar approaches such as PEPVAC [72], MULTIPRED [73], MULTIPRED2 [77], and others also exhibited the effectiveness of methods based on supertypes for both HLA-I and HLA-II alleles. However, the methods of supertype are oversimplified for some specific therapies or requirements [110], some researchers proposed pan-specific prediction methods to solve the question, the main advantage is that it could predict the binding of any HLA alleles to any peptides even without any binding information of the query HLA [108]. TEPITOPE [67] is the first pan-specific method that could predict binding to 51 prevalent HLA-DR alleles. NetMHCpan [75] is the first and most commonly used pan-specific prediction tool for MHC-I molecules, which generates a quantitative prediction of the affinity of any peptide-HLA-I interaction. The bioinformatics tools developed for the prediction of peptide–MHC binding could be divided into two main categories: sequence-based methods rely on sequence information of known binders and HLA molecules, and structure-based methods generally rely on the information of pMHC structures. The typical methods of the two categories have been summarized by year of issue in Table 2. Sequence-based method relies on sequence information of known binders and HLA molecules According to the course of development, the sequence-based methods could be divided into two types: simple motif-based models and other heuristic approaches, which are focus on the contribution of each or specific residue to the binding; and machine learning-based methods which are introduced to improve the predictive performance of motif-based approaches. Among machine learning (ML)-based methods, the fundamental processes are first to collect a comprehensive epitope dataset; then, extract the feature vectors from various sources, including propensity scales, protein sequences, and 3D structures; and finally, obtain a trained model by using ML algorithms to train on the collected sample dataset. The progress of algorithms greatly improves the prediction accuracy and promoted the development of epitope prediction in-silico, the average AUC values over 0.9 which means excellent performance of prediction tools. The applications of semi-supervised model and unsupervised model also pave the way of the development of pan-specific methods. The detailed description of both two kinds of method can be seen in the ‘Supplementary Sequence-based method of pMHC binding’ part. Structure-based method relies on the information of pMHC structures The structure-based methods depend on the biochemical properties of amino acids involved in pMHC interactions, while only a few molecules obtained 3D structures by experiments, and most of the molecules still need to be modeled [112]. The most structure-based methods would produce various potential docking conformations of given peptides with a given receptor (i.e. sampling), the generated conformations would be ranked and screened to select the suitable binders with binding affinity of given receptors by scoring functions [113]. The prediction performance of the method would be greatly influenced by the quality of both the sampling algorithms and the scoring functions [113]. Since the unsatisfactory performance and high computing costs of computational modeling, the application of structure-based methods is far less than that of sequence-based methods. EpiDock [93] is the first structure-based approach for predicting MHC binders which utilized homology modeling and rigid docking as sampling algorithm and quantitative matrixes-based score function. The method could apply to 23 most frequent HLA II molecules and almost cover over 95% of the human population with an overall accuracy of 83%. With the remarkable performance of AlphaFold which could provide atomic-level information for modeling, several AlphaFold-based tools for have been proposed, such as Fine-tuned AlphaFold 2 [95]. The deep learning (DL)-based methods also show great potential, such as MHCfold [94]. Both methods exhibit impressive superior performance which is comparable to the overall performance of the state-of-the-art NetMHCpan-4.1 and NetMHCIIpan-4.0. The application of structure-based methods is limited by their long computation times and limited coverage of diverse MHC alleles, and most methods are not as user-friendly as sequence-based methods [114], the great performance and limitations of structure-based methods show that there are still a lot of space to explore and robust potential to apply. Prediction of T cell recognition of pMHC complexes The above in silico methods are the prediction for MHC class I/II binders, TAP binders, and protease cleavage, which in essence is by reducing the number of potential epitope candidates by constructing a powerful filter [115]. However, most of the predicted binders do not induce an immune response actually because they do not evoke TCR-specific recognition by the T cell. Therefore, efforts were devoted to the development of TCR-pMHC specific interaction prediction methods for studying the initiation and effectiveness of adaptive immune response [116]. In addition to considering antigen processing to develop tools, some interesting ideas have been proposed, such as using real epitopes as datasets to train prediction models and determine whether peptides can trigger cytokines to screen epitopes. The detailed discussion of these two categories can be found in the ‘Supplementary Prediction of TCR-pMHC complexes’ part and ‘Supplementary Miscellaneous methods’ part. Benchmark dataset generation for T-cell epitope prediction The MHC-I and MHC-II peptides were derived from IEDB [20]. For a fair comparison, we only involve peptides included in the IEDB database after the year 2024, which can be considered as the completely independent testing dataset for model comparison. The benchmark dataset for T-cell epitope involving 1323 experimentally validated positive peptides and 1305 negative peptides were listed in Supplementary Table S1. Among them, two major pathogens including bacteria and viruses were derived for validation on the pathogens level, which included 53 positive peptides and four negative peptides for bacteria, and 1215 positive peptides and 1278 negative peptides for viruses (Supplementary Table S1). Moreover, the top two abundant species of SARS-CoV-2 and influenza virus for MHC-I peptides, as well as the top two abundant species of SARS-CoV-2 and hepatitis E virus (HEV) for MHC-II peptides were selected for validation on species level (Supplementary Table S2). The detailed information on how to prepare benchmark datasets and the selection of models can be seen in the ‘Supplementary Benchmark dataset generation for T cell epitope predictors’. Model comparison for MHC-I T-cell epitope prediction For model evaluation, we selected eight MHC-I T-cell epitope prediction tools and four MHC-II T-cell epitope prediction tools for comparison, including both the classical and latest SOTA approaches (Table 3 and Table 7). As a typical binary classification issue, we selected accuracy, precision, F1-score, sensitivity, specificity, and Matthews correlation coefficient (MCC) for comparison. Table 3The average performance of each of the MHC-I epitope predictors on the benchmark datasetYearMethod nameAvailabilityInput datapeptide length(mer)OutputTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymcc2024TripHLApanGitHub codespeptide, HLA<=14probability8936535983860.61110.59890.64480.69820.52200.2238ImmuneAppwebserverpeptide, HLA> = 8score, rank, label, slide window9074168854120.50500.50610.58310.68760.31980.0080MixMHCpred (v3.0)GitHub codespeptide, HLA8 ~ 14score, %rank8857225253900.63720.62770.65920.69410.57900.27502023BigMHC-ELGitHub codespeptide, HLA> = 8score46010362658590.57100.63450.45010.34870.79630.1621BigMHC-IMGitHub codespeptide, HLA> = 8score318112817310010.55190.64770.35140.24110.86700.13852022TransPHLAwebserver; GitHub codespeptide, HLA, HLA sequence> = 8, the sequence over 15 will be cutProbability, label, slide window114716911321720.50230.50330.63760.86960.1299−0.00072020NetMHCpan-4.1-ELwebserverpeptide, HLA> = 8score, %rank, slide window10813229792380.53550.52480.63980.81960.24750.0818NetMHCpan-4.1-BAwebserverpeptide, HLA> = 8score, %rank, slide window10394009012800.54920.53560.63760.78770.30750.1085MHCflurry 2.0GitHub codespeptide, HLA<16score, %rank10136556002670.65800.62800.70030.79140.52190.32562017HLAthenawebserverpeptide, HLA> = 8score, prank, slide window251110419710680.51720.56030.28410.19030.84860.0516 The average performance of each of the MHC-I epitope predictors on the benchmark dataset The overall prediction performance of eight tools showed comparable performance in accuracy (0.50 to 0.66) and precision (0.50 to 0.65), but illustrated different performances on other indicators including F1-score (0.28 to 0.70), sensitivity (0.20 to 0.87), specificity (0.13 to 0.87) and MCC (−0.00 to 0.33). It should be noted that the applicable range of each tool is slightly different. For example, several tools limited the length interval of input peptides, commonly 8-mer to 14 or 15-mer, while other tools limited the longest or shortest peptides as input. Thus, users need to choose suitable tools for their research targets based on the application range of different methods. In fact, we did an extra validation on the consistent testing dataset, which illustrated similar performance (Table 4). Table 4The average performance of each of the MHC-I epitope predictors on the consistent datasetYearMethod nameTPTNFPFNaccuracyprecisionf1_scoresensitivityspecificitymcc2024TripHLApan8916515963840.61140.59920.64520.69880.52210.2245ImmuneApp8883898583870.50630.50860.58790.69650.31190.0091MixMHCpred (v3.0)8857225253900.63720.62770.65920.69410.57900.27502023BigMHC-EL4609822658150.57180.63450.46000.36080.78750.1638BigMHC-IM31810741739570.55190.64770.36010.24940.86130.13982022TransPHLA111614211051590.49880.50250.63840.87530.1139−0.01672020NetMHCpan-4.1—EL10552859622200.53130.52310.64090.82750.22850.0700NetMHCpan-4.1—BA10163608872590.54560.53390.63940.79690.28870.0994MHCflurry 2.010126485992630.65820.62810.70130.79370.51960.32622017HLAthena250105019710250.51550.55930.29040.19610.84200.0499 The average performance of each of the MHC-I epitope predictors on the consistent dataset Further, we evaluated the performance of the above MHC-I T-cell epitope prediction tools on bacteria. Results showed that TransPHLA could achieve the best accuracy of 0.8070 and precision of 0.9200, followed by NetMHCpan-4.1, MHCflurry and MixMHCpred (v3.0), which all achieved an accuracy over 0.7 and were higher than the remaining tools (Table 5). Meanwhile, the validation on viruses illustrated that MHCflurry 2.0 achieved the best prediction accuracy of 0.6592, followed by MixMHCpred (v3.0) of 0.6393. It can be found that the above tools showed a large difference in performance on bacteria, whereas presented similar performance on viruses. This might be caused by the following results: (i) The validated number of bacteria is relatively small, which cannot reflect the performance of different algorithms, and (ii) The dataset of viruses contains a large amount of SARS-CoV-2, which was rarely included in the training dataset of the above models and led to a decrease in the overall prediction performance. Table 5Performance of each HLA-I epitope predictors on the virus dataset and bacteria dataset bacteriavirus TPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymccTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymccTripHLApan3104220.54390.88570.70450.58490.0000−0.21788286485763430.61630.58970.64310.70710.52940.2400ImmuneApp3004230.52630.88240.68970.56600.0000−0.22608474108643640.50580.49500.57970.69940.32180.0229MixMHCpred (v3.0)4004130.70180.90910.82470.75470.0000−0.14938107165043570.63930.61640.65300.69410.58690.2823BigMHC-EL2304300.40350.85190.57500.43400.0000−0.289642010272477910.58230.62970.44730.34680.80610.1725BigMHC-IM1122420.22810.84620.33330.20750.5000−0.178029811091659130.56620.64360.35600.24610.87050.1496TransPHLA460470.80700.92000.89320.86790.0000−0.1028105816711071530.49300.48870.62680.87370.13110.0071NetMHCpan-4.1—EL4104120.71930.91110.83670.77360.0000−0.14199993199552120.53040.51130.63130.82490.25040.0919NetMHCpan-4.1—BA4204110.73680.91300.84850.79250.0000−0.13439583978772530.54530.52210.62900.79110.31160.1168MHCflurry 2.04104120.71930.91110.83670.77360.0000−0.14199316515772410.65920.61740.69480.79440.53010.3357HLAthena1331400.28070.92860.38810.24530.7500−0.0028230127409810.60521.00000.31920.18991.00000.3276 Performance of each HLA-I epitope predictors on the virus dataset and bacteria dataset Moreover, two major viruses of SARS-CoV-2 and influenza virus were evaluated to perform the comparison on the species level. It can be found that the prediction accuracy of compared tools on the influenza virus was around 0.49 to 0.55 with similar precision (0.56 to 0.63), while with variable sensitivity (0.17 to 0.93) and specificity (0.08 to 0.88). The Results on SARS-CoV-2 illustrated different phenomena, in which the latest SOTA tools such as MHCflurry 2.0 could give an accuracy of 0.8676 with a precision of 0.7811. Meanwhile, the classical NetMHCpan-4.1 could only achieve an accuracy of 0.5077 and a precision of 0.3653. This might be due to the fact that for SARS-CoV-2, some of the methods do not incorporate enough data for training purposes (Table 6). Table 6Performance of each HLA-I epitope predictor on the different virus datasetsMethod nameSource OrganismSpeciesNegativePositiveTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymccTripHLApanInfluenza A virusInfluenza A virus13716913530107340.53920.55790.65690.79880.21900.0218Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2544234144438106900.74810.57600.59500.61540.80510.4130ImmuneAppInfluenza A virusInfluenza A virus1371691254196440.54250.56560.64100.73960.29930.0432Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2544234175154390590.42290.30970.43800.74790.28310.0318MixMHCpred (v3.0)Influenza A virusInfluenza A virus1371691165087530.54250.57140.62370.68640.36500.0540Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 254423414449648900.82260.75000.67610.61540.91180.5607BigMHC-ELInfluenza A virusInfluenza A virus13716955100371140.50650.59780.42150.32540.72990.0600Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 254423466520241680.75320.73330.40740.28210.95590.3412BigMHC-IMInfluenza A virusInfluenza A virus13716929120171400.48690.63040.26980.17160.87590.0661Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 254423444534101900.74290.81480.30560.18800.98160.3061TransPHLAInfluenza A virusInfluenza A virus13716915811126110.55230.55630.69760.93490.08030.0293Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 254423421544500190.33290.30070.45310.91880.0809−0.0005NetMHCpan-4.1—ELInfluenza A virusInfluenza A virus13716914424113250.54900.56030.67610.85210.17520.0370Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2544234220135409140.45630.34980.50980.94020.24820.2195NetMHCpan-4.1—BAInfluenza A virusInfluenza A virus13716914326111260.55230.56300.67610.84620.18980.0476Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2544234202193351320.50770.36530.51330.86320.35480.2205MHCflurry 2.0Influenza A virusInfluenza A virus13716913433104350.54560.56300.65850.79290.24090.0404Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 254423418249351520.86760.78110.77940.77780.90630.6849HLAthenaInfluenza A virusInfluenza A virus13716939110271300.48690.59090.33190.23080.80290.0407Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 254423443470741910.65940.36750.24500.18380.86400.0612 Performance of each HLA-I epitope predictor on the different virus datasets For MHC-II T-cell epitope predictors, we selected four tools for evaluation on the benchmark dataset. Among them, CD4episcore achieves the best prediction performance on benchmark testing datasets (Table 7) as well as the consistent datasets (Table 8). Studies on two major viruses illustrated that the above tools perform better on SARS-CoV-2 than those on HEV (Table 9). Considering both datasets are relatively small, the performance of those tools on emerging pathogens may require further validation when more data is accumulated. Table 7The average performance of each of the benchmarked HLA-II epitope predictors on the benchmark datasetYearMethod nameAvailabilityInput datapeptide length(mer)OutputTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymcc2024TripHLApanIIGitHub codesPeptide, HLA–probability861323780.49500.78900.63000.52440.3611−0.08832023MixMHC2pred-2.0GitHub codesPeptide, HLA12 ~ 21score, rank, slide window242881400.26000.75000.24490.14630.7778−0.07952020NetMHCIIpan-4.0-ELwebserverPeptide, HLA>14score, rank, slide window602210990.42930.85710.52400.37740.68750.0503NetMHCIIpan-4.0-BAwebserverPeptide, HLA>14score, rank1071814520.65450.88430.76430.67300.56250.18252018CD4episcorewebserverPeptide>14Peptide over the cut-off1111715480.67020.88100.77890.69810.53130.1808 The average performance of each of the benchmarked HLA-II epitope predictors on the benchmark dataset Table 8The average performance of each of the benchmarked HLA-II epitope predictors on the consistent datasetYearMethod nameTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymcc2024TripHLApan821319770.49740.81190.63080.51570.4063−0.05842023MixMHC2pred-2.0232481360.24610.74190.24210.14470.7500−0.10672020NetMHCIIpan-4.0-EL602210990.42930.85710.52400.37740.68750.0503NetMHCIIpan-4.0-BA1071814520.65450.88430.76430.67300.56250.18252018CD4episcore1111715480.67020.88100.77890.69810.53130.1808 The average performance of each of the benchmarked HLA-II epitope predictors on the consistent dataset Table 9Performance of each HLA-II epitope predictor on the different virus datasetsMethod nameSource OrganismSpeciesNegativePositiveTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymccTripHLApanHepatitis E virusHepatitis E virus2476251113510.36000.67590.43860.32890.4583−0.2127Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2416141320.75000.82350.84850.87500.25000.1400MixMHC2pred-2.0Hepatitis E virusHepatitis E virus24769231670.32000.90000.20930.11840.95830.1093Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2416111350.60000.78570.73330.68750.2500−0.0546NetMHCIIpan-4.0-ELHepatitis E virusHepatitis E virus207250128220.67390.86210.76920.69440.60000.2516Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 241583170.57890.88890.66670.53330.75000.2313NetMHCIIpan-4.0-BAHepatitis E virusHepatitis E virus207224155480.42390.82760.47520.33330.75000.0740Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 241574080.57891.00000.63640.46671.00000.3944CD4episcoreHepatitis E virusHepatitis E virus207257128150.750.87690.83210.79170.60000.3548Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2415140410.73680.77780.84850.93330.0000−0.1217 Performance of each HLA-II epitope predictor on the different virus datasets In general, we evaluated the performance of current SOTA T-cell epitope predictors, the performance illustrated that each tool may have different emphases, some focusing on filtering out as many positives as possible, while others concentrate on ensuring that the predicted positives are as reliable as possible. The users can choose different tools based on benchmark validation for their research purposes. B-cell epitope prediction Another important part of adaptive immune response is B cell-induced humoral immunity, B cells mediate humoral adaptive immunity by the production and secretion of different forms of antibodies [55]. The activation of B-cells could be classified into two pathways based on the usage of T-cells. The illustration of B cell activation pathways can be seen in Fig. 3, the description can be seen in the ‘Supplementary B cell activation pathways’ part. The binding parts of BCR (i.e. B-cell epitopes) with antigens could be divided into linear epitopes that is short linear peptides and discontinuous epitopes that is produced by folded protein structures based on their spatial structures [117]. The computational approaches for predicting B-cell epitopes are classified as tools for predicting linear epitopes and tools for predicting conformation epitopes. This review will focus on the features and widely used tools of each class, the input information, features, training dataset and claimed prediction performance, and other typical tools have been summarized in Table 10. The schematic illustration of B cell activation pathways. A. Represents the B cell activation pathways, the right parts mean the T cell-dependent pathway, and the left parts mean the T cell-independent pathway. B. Is the simple example of linear B-cell epitopes. C. Is the simple example of conformational B-cell epitopes. Table 10The list of in silico tools for predicting linear and conformational B-cell epitopesType MethodFeatureTraining datasetInputPerformance measureYearRef Acc (%)AUCMCCSens (%)Spec (%) LinearPREDITOPamino acid propensity scales-based–propensity scale, query sequence, a journal file~0.6––––1993[115]PEOPLEamino acid propensity scales-based combined method–––––––1999[116]BcePredCombination of amino acid propensity scales-based–protein sequence, properties, threshold0.58700.560.612004[118]ABCpredANN-based700 B-cell epitopes and 700 random peptides as positive and negative datasetprotein sequence, epitope length, threshold0.65930.31870.67140.64712006[119]BepiPredHMM model combined with propensity scale method127 protein sequences with not fully annotated, 0.08 epitope density–0.6712006[120]AlgPredmodel for mapping lgE epitopes and other functions178 IgE epitopesprotein sequences–––0.17470.98142006[121]BCPREDSVM-based model using string kernels701 linear B-cell epitopes, 701 non-epitopes as positive and negative datasetAntigen sequence, predicted method, epitope length, threshold0.67900.7580.72610.6322008[122]IgPreddipeptide composition-based SVM model for predicting antibody class-specific B-cell epitopes14,725 B-cell epitopes include 11,981 IgGa, 2341 IgEb, 403 IgAc specific epitopes, and 22,835 non-B-cell, 80% sequence as training datasetamino acid sequence of peptides0.7173a 0.8496b 0.7228c0.77a 0.90b 0.78c0.44a 0.70b 0.45c––2013[123]BCIgEpredA dual-layer model for predicting lgE epitopes1273 IgE epitopes, 4226 non-IgE epitopesprotein sequences0.7430.8330.480.7260.7582018[124]iBCE-ELAn ensemble method fusion extremely randomized tree and gradient boosting classifiers4440 BCEs and 5485 non-BCEsprotein sequences0.7320.7890.4630.7420.7242018[125]SPADEpipeline for the localization of cross-reactive lgE-epitopes based on the structural–Structures of the query protein and a cross-reactive second allergen–––0.570.712019[126]AlgPred2ensemble approach for mapping lgE epitopes and other functions10,451 IgE epitopes, 307,866 non-IgE epitopesprotein sequences–––0.7299–2020[127]DLBEpitopefeedforward deep neural network-based ensemble model25,884 linear B-cell epitopes and 214,679 non-epitopes as positive and negative sample, then extent the dataset to 20,000 positive and 20,000 negative samples for each lengthNA0.95682020[128]AbCPEmulti-label method for prediction of antibody class(es) for B-cell epitopes10,744 epitope sequences, covering 4 specific antibody classes and 7 classes of combination of different antibodiesepitope sequences–––––2021[129]BepiPred-3.0protein language model358 antigens and 5011 epitope residuesprotein sequence, threshold, top epitope percentage cutoff0.6880.7620.3092022[130]DeepLBCEPredA Bi-LSTM and multi-scale CNN-based DL method555 sequences of BCEs and 555 sequences without BCEsprotein sequences0.770.540.780.752023[131]epitope1DAn explainable ML method leveraging two new descriptors: graph-based signatures and organism identification20,638 epitopes and 6-times negative samplespeptides or whole protein sequences, desired window size, organism taxonomy0.9350.6132023[132]ConformationalGeneric antigenic region-based MethodCEPMethod using accessibility of residues and spatial distance cut-off–3D structure of antigens0.752005[133]DiscoTopeMethod using a combination of amino acid statistics, spatial information, and surface exposurediscontinuous epitopes from 76 X-ray structures of antibody/antigen protein complexes3D structure of antigens0.1550.952006[134]ElliProtool based on the geometrical properties of protein structure–protein sequence or structure0.8400.732–0.6012008[135]SEPPAMethod based on the residual context and the spatial compactness of neighboring residues82 Ab-Ag complexes, contained 84 unique epitopes3D protein structure0.7420.5800.7072009[136]CBTOPESVM-based model using composition profile of patterns in a protein sequence187 antigens, 2261 positive patterns (Ab interacting residues of B-cell epitopes), 107,414 negative patterns (non-Ab interacting residues of B-cell epitopes)NA0.86590.730.83130.90062010[137]BESTa sliding window-based SVM predictor utilizes Ag sequences701 B-cell epitopes 20-mers and 701 non-B-cell epitopes 20-mersamino acid sequence0.7450.8110.530.5610.9292012[138]CBEPSVM-based model adopts cost-sensitive ensemble classifiers and spatial clusteringRubinstein’s bound structure dataseta; Liang’s unbound structure datasetb;amino acid sequence0.721a 0.703b2014[139]SEPIaMethod based on sequence-based features and a voting algorithm combines two ML classifiers85 Ab-Ag complexes, 1667 conformational B-cell epitope residues, and 16,780 other residuesamino acid sequence–0.65–––2017[140]SEPPA 3.0logistic regression model added two critical glycosylation parameters, and final calibration based on neighboring antigenicity767 protein antigens (520 with N-glycosylation sites), including 16,544 epitope residues as positive set and 172,975 non-epitope residues as negative set.3D protein structure, subcellular localization of protein antigen, and species of immune host0.6650.7492019[141]DiscoTope-3.0tool that employs inverse folding structure representations and a positive-unlabelled learning strategy, adapted for both AlphaFold predicteda or solvedb structures582 Ab-Ag complexes, covering 1466 antigen chains, epitopes are defined as the set of residues within 4 Å of any antibody heavy atom3D structure of antigens0.783a 0.795b0.227a 0.214b2024[142]Antibody-specific epitope-based MethodPEASERF model predicting Ab-specific epitopes from antibody sequence120 Ab-Ag complexesAg structure, Ab sequence, Ag sequence (optional, when the 3D structure of Ag is a computational model)–––––2014[143]EpiPredGlobal docking-based model combines geometric matching and specific scores of Ab-Ag structures148 Ab-Ag complex structures, 30 of which were randomly chosen as test set, the rest as training datasetstructure of an antibody and an antigen–––––2014[144]SEPPA-mAbtool for predicting mAb-specific epitopes, consists of a SEPPA 3.0 model and a fingerprint-based patch model860 representative Ab-Ag complexes3D structure of Ab-Ag pair, subcellular localization of protein antigen, and species of immune host (optional)0.8732023[145]Mimotope-based MethodMIMOXMimotope-based method for phage display based epitope mapping–Sequence and 3D structure of antigen, a set of mimotope sequences–––––2006[146]PepitopeMimotope-based ensemble method for epitope mapping based on affinity-selected peptides–a set of affinity-selected peptide sequences and a PDB identifier of the antigen—––––2007[147]Pep-3D-SearchMimotope-based method using Ant Colony Optimization algorithm–3D structure of an antigen and a set of mimotopes or a motif0.17580.36422008[148]Sun et alensemble method that combines structure-based method and mimotope-based method150 Ag-Ab complexes with only one antigen chainantigen structure and mimotopes0.790.140.580.812015[149]Key for feature: ANN = artificial neural network; SMM-align = stabilization matrix alignment method; HMM = Hidden Markov Models; ML = machine learning; DL = deep learning; RF = random forest; Ab-Ag = antibody–antigen. Key for Performance measure: Acc (%) = accuracy; AUC = Area Under the ROC Curve; MCC = Matthew’s correlation coefficient; Sens (%) = sensitivity; Spec (%) = specificity. The list of in silico tools for predicting linear and conformational B-cell epitopes Key for feature: ANN = artificial neural network; SMM-align = stabilization matrix alignment method; HMM = Hidden Markov Models; ML = machine learning; DL = deep learning; RF = random forest; Ab-Ag = antibody–antigen. Key for Performance measure: Acc (%) = accuracy; AUC = Area Under the ROC Curve; MCC = Matthew’s correlation coefficient; Sens (%) = sensitivity; Spec (%) = specificity. Prediction of linear B-cell epitopes Linear B cell epitopes were continuous in sequence, and though the percentage of linear epitopes is small, the predicted tools still received major attention. The early tools were based on sequence and based on simple AA propensity scales depicting physicochemical features of B-cell epitopes, as some qualities such as hydrophilicity, accessibility, and mobility could be used to predict which region of protein can provide antigenic peptides. To improve the poor performance of the amino acid propensity scale-based tools, ML models were introduced. The common tools like ABCpred [119] is an ANN-based method that achieved a prediction accuracy of 65.93%, and BCPRED [122] is an SVM-based method with an AUC value of 0.758. After the phase of propensity scales-based semiempirical methods and the following phase of initial ML methods, the current generation of epitope prediction methods has integrated with emerging technology resources or the recent advances in existing knowledge resources. DLBEpitope [128] is the first effort that designed prediction models for linear B-cell epitopes using DL methods, scored an impressive 0.95 AUC on the IEDB dataset, significantly outperforming the other methods. In addition, novel techniques and advances such as fuzzy-Artmap Artificial Neural Networks, feature maps, and advanced protein language model have also been used in developing prediction tools [150]. The above methods were proposed to predict the antigenic region or B-cell epitopes that can induce B-cell response, there are some predictive tools at another level which can distinguish the predicted epitopes that could induce which class of antibody [129]. The ‘Supplementary B linear epitopes’ part has listed a more detailed description of each phase. Prediction of conformational B-cell epitopes Approximately 90% of the BCEs are discontinuous in nature, however, because of the insufficient of available antibody–antigen complex structures, the degree of the development of discontinuous epitopes is limited [129]. Existing methods for conformational epitope prediction can be broadly classified into three categories: generic antigenic region-based methods, mimotope-based methods, and antibody-based methods. According to the kind of input data as antigen primary sequence or tertiary structure, the generic antigenic region-based methods could be divided into sequence-based methods and structure-based methods. The first predicted method CEP [133] was developed based on the solvent-accessibility character of residues and spatial distance cut-off to predict potential epitope regions from the 3D structure of antigens. CBTOPE [137] is the first attempt in this area to develop a B-cell conformational epitope prediction tool based only on the antigen’s primary sequence. However, the available structure-based methods are heavily dependent on the number and quality of currently available antigen 3D structure data [151], and the main downside of sequence-based methods is that the predicted epitope residues are not grouped into the corresponding epitopes and the prediction performance is far from satisfactory [152]. Antibody-specific epitope predictors are the new trend in the field, which could deal with a more constrained and tractable task as opposed to generic epitope prediction, but it is antibody-dependent, and the number and knowledge of the subsistent antibodies limited the usage [151]. The other category of the predicted method is the mimotope-based approach, the peptides that could mimic epitopes are called mimotopes [153]. The core idea of the approach is to map the mimotope sequences that are obtained from a random phage display library [154]. The 3D structure of antigen and antibody affinity-selected peptides both needed to be input. The high false positive or false negative rate is the main disadvantage of the mimotope-based method, since the complexity of the screening process [155]. The size and data diversity of the phage display library would also greatly affect the performance [156]. The description of typical methods of each category has been summarized by year of issue in Table 10, and the detailed record of typical tools of each category can be found in the ‘Supplementary B conformation’ part. The above tools have brought pioneering progress in the development of epitope prediction, which greatly promotes the process of the fields and brings inspiration to the development of novel prediction methods with high performance. However, one drawback exhibited in most tools is the instability of predictions [117]. Cia and co-workers [157] constructed a large and well-curated dataset that contains over 250 antibody–antigen structures in 2023 to verify the performance of nine commonly conformational B-cell epitope predictors. According to the assessment, each models output different prediction performance on the benchmark dataset, which reflects the instability of predictions and the effect of different data sets on predictions. The nine methods tested above are divided into generic and antibody-specific methods, the other research indicated that the performance of mimotope-based approaches was also not as good as expected, so there is still urgency to develop a new method to predict conformation B-cell epitopes that could have high performance in most proteins. Benchmark dataset generation for linear B-cell epitope prediction The linear B-cell epitopes were derived from IEDB [20] with key words of linear peptide, human host, and positive/negative, and we only involve peptides included in the IEDB database after 2023, which can be considered as the completely independent testing dataset for model comparison. The benchmark dataset for B-cell epitope involving 2158 experimentally validated positive peptides and 2240 negative peptides were listed in Supplementary Table S1. Among them, two major pathogens including bacteria and viruses were derived for validation on the pathogens level, which included 233 positive peptides and 767 negative peptides for bacteria, and 837 positive peptides and 708 negative peptides for viruses (Supplementary Table S1). Moreover, the epitopes from the top two abundant species of Norwalk virus and SARS-CoV-2 were selected for validation on the species level (Supplementary Table S2). The detailed information on how to prepare benchmark datasets and the selection of models can be seen in the ‘Supplementary Benchmark dataset generation for B cell epitope predictors’. Model comparison for B-cell epitope predictors The performance of SOTA spatial B-cell epitope predictors including Bepipred2 [158], CBTOPE [137], SEPPA 3.0 [141], DiscoTope 2.0 [159], ElliPro [135], EPSVR [160], BEpro [161], epitope3D [162], and EpiPred [144] were systemically reviewed in Cabriel’s work [157] . By four specifically designed matrices, Cabriel’s benchmark test showed that DiscoTope2, EPSVR, and BEpro are significantly better than random procedure and random patches procedure across all metrics. BepiPred 2, SEPPA 3.0, ElliPro, and EpiPred are significantly better for some of the metrics, while CBTOPE and epitope3D are no better than random across all metrics [157]. Moreover, Cabriel’s work evaluated the performance of SARS-CoV-2 spike protein and showed that EPSVR achieved the best ROC-AUC of 0.75, followed by ElliPro of 0.66 and BepiPred2 of 0.64. Meanwhile, the other three tested tools of CBTOPE (ROC-AUC = 0.51), DiscoTope2 (ROC-AUC = 0.60), and epitope3D (ROC-AUC = 0.38) show no better than random [157]. Besides spatial B-cell epitope prediction, we evaluated the performance of linear-epitope prediction tools on the benchmark dataset (Table 11). Among all four tools, iBCE-EL seems to achieve the best accuracy of 0.6157, and epitope1D achieves the best precision of 0.6791. For balanced metrics such as balanced accuracy and MCC, iBCE-EL could outperform all others (Table 12). The validation on pathogens level (Table 13) and species level (Table 14) illustrated similar results, while iBCE-EL could outperform all other three on the benchmark dataset. Note that all tools performed better on the Norwalk virus than SARS-CoV-2, it is expected that as a newly emerging pathogen, previous tools may fail to predict the real epitope peptides. This might be enhanced when enough data for new pathogens accumulated for model training. Table 11Average performance of each of the benchmarked B cell linear epitope predictors on the benchmark datasetYearMethod nameAvailabilityInput datapeptide length(mer)OutputTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymcc2023DeepLBCEPredwebserverpeptidelabel892135788312660.51140.50250.45390.41330.60580.01952023epitope1Dwebserverpeptide>5, over 25 will be cutScore, label9121954320530.52170.67910.07990.04240.98080.06742022BepiPred-3.0webserverpeptide>9Analysis result of each sequence, uppercase letters are epitopes165010521104140.41010.43880.56660.79940.0474−0.23452018iBCE-ELwebserverpeptideProbability, label1154155468610040.61570.62720.57730.53480.69380.2316 Average performance of each of the benchmarked B cell linear epitope predictors on the benchmark dataset Table 12Average performance of each of the benchmarked B cell linear epitope predictors on the consistent datasetYearMethod nameTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymcc2023DeepLBCEPred805135586012590.50480.48350.43180.39000.61170.00182023epitope1D8421773819800.52840.68850.07690.04070.98280.07072022BepiPred-3.0165010521104140.41010.43880.56660.79940.0474−0.23452018iBCE-EL106815506659960.61180.61630.56250.51740.69980.2211 Average performance of each of the benchmarked B cell linear epitope predictors on the consistent dataset Table 13Performance of each B cell linear epitope predictors on the virus dataset and bacteria dataset bacteriavirus TPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymccTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymccDeepLBCEPred1094842831240.59300.27810.34880.46780.63100.08562964852235410.50550.57030.43660.35360.68500.0408epitope1D176612320.76700.50000.00850.00430.99870.028337698107940.47760.78720.08430.04450.98590.0881BepiPred-3.0227875140.23740.23210.37550.98270.0105−0.0262597356732050.41850.47010.57630.74440.0494−0.2814iBCE-EL706491181630.71900.37230.33250.30040.84620.15865234902183140.65570.70580.66290.62490.69210.3161 Performance of each B cell linear epitope predictors on the virus dataset and bacteria dataset Table 14Performance of each B cell linear epitope predictor on the different virus datasetsMethod nameSource OrganismSpeciesPositiveNegativeTPTNFPFNAccuracyprecisionf1_scoresensitivityspecificitymccDeepLBCEPredNorovirus GIINorwalk virus157910901470.11451.00.11980.06371.00000.0606Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 23975401553951452420.58700.51670.44480.39040.73150.1291epitope1DNorovirus GIINorwalk virus157916901410.15061.00.18500.10191.00000.0782Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2391540453733870.58110.57140.02010.01020.99440.0267BepiPred-3.0Norovirus GIINorwalk virus15599609590.58540.91430.73850.61930.0000−0.1806Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 2370540263225181070.31320.33670.45700.71080.0407−0.3499iBCE-ELNorovirus GIINorwalk virus157910209550.61450.91890.76120.64970.0000−0.1685Severe acute respiratory syndrome coronavirus 2Severe acute respiratory syndrome coronavirus 23975402474321081500.72470.69580.65690.62220.80000.4300 Performance of each B cell linear epitope predictor on the different virus datasets Vaccine construction and optimization In the general construction of a multi-epitope vaccine, an adjuvant would be added to the N-terminal with a suitable linker, and following the linker, PADRE sequence is appended which could be seen as an additional adjuvant to increase the immunogenicity, then connected to epitopes with linkers and there is no fixed sort of placing the epitopes, finally, other functional peptides could be appended to the vaccine’s C-terminal or not. Codon adaptation is an important process before in silico cloning of the vaccine construct, which aims to adjust the codon of the vaccine to fit the codon usage preference of hosts to achieve a high expression rate by tools. In real-world applications, in-silico tools already illustrated a strong ability to in assist the design of vaccine pathogens. For example, a personalized neoantigen vaccine targeted melanoma constructed based on the epitopes identified by NetMHCpan version 2.4 tool, which has already passed the clinical I phase trial and confirmed that in vaccinated four years later, still can provide the body with durable anti-tumor ability [163]. Similarly, neoantigen vaccine targeting glioblastoma, also developed based on target epitopes identified by NetMHCpan version 2.4 tool, has shown great immune ability in phase Ib trial and could generate circulating polyfunctional neoantigen-specific CD4 and CD8 T cell responses [164]. These success paradigms demonstrate the feasibility of the computational design of epitope-based vaccines and the significant contribution of bioinformatics methods especially epitope prediction tools to the development of multi-epitope vaccine candidates. These studies also exhibited the potential of the development of a personalized precision vaccine. The commonly used literature of predicted tools, linkers, adjuvants, functional peptides, and codon optimization tools can be seen in Table 15, which summarizes the main studies of the development of a multi-epitope vaccine based on bioinformatics tools in 2019-2024. Table 15Main studies of multi-epitope vaccine design using bioinformatics tools against different pathogensTarget pathogenPre-PVCFeatureEpitope prediction toolAdjuvantLinkerFunctional peptidescodon optimizationExperimental VerificationYearsRef Acinetobacter baumannii 32 protein candidatesSelected from a literature reviewCTL, HTL, B: EigenBio’s proprietary epitope prediction softwareAddaS03EAAAK, GPGPG, KK,6-His Tag, thioredoxin proteinGenScriptY2024[165] Haemophilius parainfluenzae two proteins that are essential and non-homologous protein with highest antigenicityentire proteome is retrieved from UniProt, screened by several filtersCTL: CTLPredB: ABCPred (for linear); ElliPro (for discontinuous)cholera enterotoxin subunit BEAAAK, AAY, GPGPG, KKNAJCatN2024[166]Bluetongue virus (BTV)3 full-length amino acid sequences of BTV NS proteinsDownload form available genomes of 24 serotypes of BTV of NCBI databaseCTL: ‘NetMHCpan BA 4.1’ module of IEDB; IEDB-AR serverHTL: ‘MHCIIpan 4.0 BA’ module of IEDB; NetBoLAIIPan 1.0 toolbeta-defensin 2, or 50S ribosomal subunitEAAAK, AAY, GPGPGNAJCatN2024[167]Epstein–Barr virus (EBV)EBVpoly recombinant proteinAn engineered recombinant polyprotein that is formed by linking 20 CD8 + T cell epitopes from several EBV proteinsCTL: literatureAmphiphile-modified CpG DNA adjuvantproteasome liberation amino acid sequenceEBV gp350 proteinexperimentY2023[168]SARS-CoV-2A surface glycoprotein (ID: QHO62112.1)retrieved from the NCBI databaseCTL: NETCTL_1.2; MHC-NP tool; IEDB MHC-I binding predictions tool; MHC-NPHTL: IEDB MHC-II binding predictionsB: Bepipred 2.0, Chou & Fasman Beta-Turn Prediction, Emini Surface Accessibility Prediction, Karplus & Schulz Flexibility Prediction, Kolaskar & Tongaonkar Antigenicity and Parker Hydrophilicity PredictionNANANANAN2020[169] Mycoplasma synoviae 5 proteins of strain rSC0200These proteins have been regarded as promising PVCs in earlier studiesCTL: NetMHCcons 1.1HTL: NetMHCIIpan 4.0B: BCpredβ-defensinEAAK, AAY, GPGPG, KKNAExperiment, replacement of TGA by TGGY2023[170]Group B streptococcus (GBS)15 proteinsexperimentally proven protection against GBSCTL: TEPITOOLHTL: TEPITOOLB: ABCpred; BcpredNAGPPGPG, LRMKLPKSNAJCatY2022[171]monkeypox virus176 gene-coding peptide sequenceswhole genome and all 176 genome-encoded proteins has been studiedT: IEDB v2.24 webserverB: Bepipred 2.0CTxBEAAAK, AAY, GPGPG, KKPADRENAN2022[172]monkeypox virus139 epitopes sequencesexperimentally determined epitopes, obtained from ViPR database–β-defensin 3, 50S ribosomal protein L7/L12, Heparin-binding hemagglutininEAAAK, AAY, GPGPG, GGGSPADRE, TATJCatN2022[173] Hafnia alvei 12 proteinsWhole 11 genome sequences download from NCBI, screened by several filtersT: IEDB T-cell antigenic determinants analysis package;B: BepipredCholera toxin B-subunitEAAAK, GPGPG,NAJCatN2022[174]Lymphocytic choriomeningitis virus4 proteinsWhole proteome retrieved from the UniProt database, screened by several filtersCTL: NetCTL 1.2; CTLPred; IEDB SMM methodHTL: NetMHCIIpan 4.0; IEDB SMM method; IFNepitope; IL4pred; IL10predB: BCPred; BepiPred-2.0; ABCpred; Ellipro (for discontinuous)50 S ribosomal protein L7/L12EAAAK, AAY, GPGPG, KKPADRE, 6xHis tagJCatN2022[175]Monkeypox virus10 proteins with the highest antigenic probability scoreentire proteome related to epidemic in 2022, downloaded from UniProt, screened by antigenic and allergicCTL: NetCTL-1.2HTL: IEDB MHC-II binding predictions; IFN-epitopeB: ABCpredhumanβ-defensin-2EAAAK, AAY, GPGPG, KKNAJCatN2023[176]Crimean-Congo hemorrhagic fever virus (CCHFV)2 consensus sequences of glycoprotein precursors (GPC) and nucleoproteins (NP)GPC and NP have been proven protection against CCHFVCTL: NetCTL 1.2; IEDB MHC-I binding predictions; SMMPMBECHTL: NN-align 2.3 (NetMHCII 2.3)B: Bepipred 2.0, Emini surface accessibility prediction, Kolaskar and Tongaonkar antigenicity and Karplus and Schulz flexibility prediction method50S ribosomal protein L7/L12GGGGSEAAAKGGGGS, GPGPG, KK, AAYPADRE, MITD sequence,GenSmartN2022[177] Aeromonas hydrophila An aerolysin protein that conserved and has no similarity with human and normal flora proteomeThe role of Aerolysin has been proven by studies, related information obtained from UniProt and PDB database, screened by several filtersCTL: IEDB-recommended methodHTL: IEDB-recommended methodB: BepiPred-2.0Cholera Toxin BEAAAK, GPGPGNAJCatN2024[178]Coxsackievirus B (CVB)complete amino acid sequencesNCBI Protein databaseCTL: NetCTL-1.2; NetMHCpan 4.1HTL: NetMHCII-2.3; NetMHCIIpan 4.0; IFN- epitopeB: ABCpred, BCPreds (for linear);ElliPro, DiscoTope (for discontinuous)β-defensinEAAAK, AAY, GPGPG, KKPADRE, TATJCatN2022[179]Monkeypox VirusMPXVgp181 virus proteinProtein dataset obtained from NCBI, screened by several filtersCTL: IEDB MHC-I binding predictions toolHTL: IEDB MHC-II binding predictions tool; NN-align 2.3B: Bepipred 2.050S ribosomalprotein L7/L12EAAAK, AAY, GPGPG, KK6xHis tagJCatN2022[180]Rotavirus and NorovirusAll structural proteins of two virusesepidemiological relevanceCTL: IEDB MHC-I binding predictions; NetCTL-1.2HTL: IEDB MHC-II binding predictions; NETMHCII 2.3B: ABCpredconserved enterotoxic sequence of RV’s NSP4, tetanus toxin epitope P2EAAAK, AAY, GPGPGNAGenSmartN2023[181]Visceral leishmaniasis10 proteins (6 are parasitically derived, 4 are salivary proteins)Literature survey, immune ability of salivary proteins has been proven, retrieval from NCBI, screened by several filtersCTL: NetCTL-1.2HTL: RANKPEPB: ABCpredTLR-4 agonistEAAAK, AAY, GPGPG, KKNANAN2020[182]SARS-CoV-29 SARS-CoV-2 proteinsproteome of SARS-CoV-2, screened by length and antigenicCTL: NetCTL-1.2; EpiToolKitHTL: IEDB MHC-II binding predictions; IFN- epitopeB: ABCpred, BepiPred (for linear);ElliPro (for discontinuous)β-defensinEAAAK, AAY, GPGPG, KKPADRE, TATJCatN2020[183]NA: data not given. Main studies of multi-epitope vaccine design using bioinformatics tools against different pathogens NA: data not given. Vaccine construction Base on the mentioned construction strategy, the assembly process of designing a multi-epitope vaccine would involve the application of linkers, adjuvant, and other functional peptides. The related information resources of vaccine construction and optimization are listed in Table 16, which contains information of databases and analysis tools of adjuvants, linker, and codon optimization. Table 16A list of tools and databases of adjuvants, linker, and codon optimizationNameusageInputOutputURLReflinkerLinkerDBdatabase of inter-domain linkersQuery typesA list of linker identifiers along with their sequences, the identifier could connect to the 3D structure of linkers http://mathbio.nimr.mrc.ac.uk [209]MEROPSmanually curated resources for peptidases, their inhibitors, and substrates with known cleavage sitesIndex of Name, MEROPS Identifier, or source organismA list of peptidase names with detailed information links https://www.ebi.ac.uk/merops/ [210]LINKERan automatic program generates peptide sequences with extended conformations determined by experimentsdesired linker sequence length and optional input parametersA list of peptide sequences with specified criteria http://astro.temple.edu/~feng/Servers/BioinformaticServers.htm [211, 212]SynLinkerSystem compiled 2260 linker sequences containing natural linkers and artificial/empirical linkersQuery criteriaA list of linker candidates with structure information satisfying criteria, fusion protein structure, and hydropathicity plot http://bioinfo.bti.a-star.edu.sg/synlinker [213]adjuvantVaxjodatabase and analysis system contains the basic information and usage of vaccine adjuvantsKeyword and their fieldA table of related adjuvants with a link of basic adjuvant information and associated vaccine information. https://violinet.org/vaxjo/ [214]vaccineDAmodel of designing oligo deoxy nucleotide-based vaccine adjuvantsQuery nucleotide sequenceA list of query sequences with predicted class (Immunomodulatory or not), score, and additional properties https://webs.iiitd.edu.in/raghava/vaccineda/ [215]vaxinPADwebserver for designing or predicting peptide-based vaccine adjuvants.query peptide sequenceA list of query sequences with predicted class (Immunomodulatory or not), score, and additional properties https://webs.iiitd.edu.in/raghava/vaxinpad/ [216]Codon optimizationJCATstatistic-based method, a Java-based tool, for most prokaryotic and some eukaryotic organismsquery sequence, class of query sequence, organism which codon should be adapted toThe CAI values of query sequence and optimized sequence, graphical representation of the relative adaptiveness http://www.prodoric.de/JCat [217]Optipyzerstatistic-based method, a multi-species server with the ability to process large sets of genesA query sequence, species weights, sequence typeOptimized sequence https://optipyzer.com [218]ICORAn RNN-based method, for Escherichia coliamino acid sequencean optimized nucleotide codon sequence https://github.com/Lattice-Automation/icor-codon-optimizati [206]Fu et al.A DL-based method that converts the codon optimization into sequence annotation with codon boxes, for E. coliNANA https://github.com/Devil625/Codon_Optimization.git [219]MOABCA heuristic-based method using a multi-objective adaptation of the Artificial Bee Colony algorithmNANANA[220]LinearDesignA heuristic-based method for optimized mRNA in both structure stability and codon usage by adapting the lattice parsing conceptSingle protein sequence, the class of paste sequence, beam size(optimal)Two CSV files, one contains predicted values, optimized sequence, and structure, and another contains codon usage frequency table https://rna.baidu.com/app/vaccine/linear-design/forecast [221] A list of tools and databases of adjuvants, linker, and codon optimization Use of linkers Linkers are generally short stretch amino acid sequences derived from nature, inserted in a protein to separate multiple domains and act as spacers [184]. Linkers are indispensable components of rational vaccine design, ensuring the immunogenicity of each individual epitope and minimizing the junctional immunogenicity, and some linkers could induce an immune response and thus increase the immunogenicity of the vaccine [185]. The natural linkers may serve as a good lead for fusing proteins of interest, and the empirical linkers have been widely used in the design of various applications [186]. To accelerate the progress of selecting linkers, several interesting bioinformatics tools and databases have been developed to facilitate linker selection for rational vaccine designing, the introduction of information resources including input, output, and usage has been listed in Table 16. Based on the sequence and structure, linkers used in vaccine design could be divided into two categories: flexible and rigid linkers [186]. ①Flexible linkers have great flexibility and mobility and are suitable for joining two functional domains, allowing a certain amount of movement or interaction of the protein domains [187]. Most widely used flexible linkers such as GPGPG, AAY, HEYGAEALERAG, and KK sequences were usually applied to join CTL, HTL, and BCL epitopes. The linker of GPGPG can induce HTL immune response and facilitate epitope presentation [188]. The AAY and HEYGAEALERAG sequence provides the site of proteasome cleavage, thus could prevent the loss of epitope during antigen presentation [185, 189, 190]. KK linker can reduce the junctional immunogenicity, which might be caused by linearly joint epitopes [185]. Nevertheless, the high flexibility and lack of rigidity make the functional domains separate less effectively and may cause a loss of biological activity and poor expression yields [187, 191]. ②When a fixed distance between the functional domains and sufficient separation of protein domains is desired, rigid linkers may be the best choice [192]. EAAAK is one of the commonly used rigid linkers for joining adjuvant and CTL epitopes [188] and could separate the two protein components to increase efficiency and minimize interference [189]. Researchers have demonstrated that linkers could increase the stability of fusion protein vaccine and the degree of vaccine stability is changed with different linkers [193]. The other properties also have significant impacts on function and flexibility [194]. Thus, the properties and components of linkers and the requirements and characteristics of the designed vaccine should be worth careful consideration when selecting a suitable linker for rational vaccine development. Use of adjuvants One of the limitations of epitope-based subunit vaccines is their weak ability to activate the immunity system as they only consist of the antigenic components of pathogens. Thus, adjuvants are always co-administered with vaccines to enhance the magnitude and durability of the immune response by using a delivery system or chemical conjugation with the peptide to incorporate into the vaccines [8, 195]. Besides the ability to elicit a robust immune response, adjuvants could also increase the biological half-life of vaccines, induce the production of immunoregulatory cytokines, and induce local inflammation and cellular recruitment [196]. Detailed information about the mechanisms and platforms of adjuvants could be seen in other research [197]. Two major types of adjuvants include delivery adjuvants and immune agonists. (i) Delivery adjuvants, including aluminum adjuvants, MF59, emulsions, liposomes, etc., can effectively help antigen presentation. The earliest and most widely used aluminum adjuvants could induce an effective humoral immune response, but insufficient cellular immune response [198] and could also cause cell damage [199]. (ii) Immunoagonists, such as CpG oligodeoxynucleotides (CpG ODN), could enhance the immune response by recognizing and triggering toll-like receptors, activation of toll-like receptors (TLRs) on the surface of APCs will induce the secretion of various kinds of cytokines which will promote Th response [200]. TLR agonists, especially for TLR3, TLR4, and TLR9, are widely used adjuvants for computationally designed vaccines [201], and the efficacy of TLR agonists has been proven in many preclinical and clinical studies [200]. However, there is a potential risk of systemic toxicity and inflammation, and it may not be ideal to enhance the immunity of the vaccine [202, 203]. There are some resources for the selection and development of vaccine adjuvants, the description of these resources has been listed in Table 16 and ‘Supplementary Adjuvant and functional peptides’ part. A good adjuvant that could be used for the development of a multi-epitope vaccine must have some characteristics like safe, well-tolerated, stable, reproducible, robust, scalable, and easy to produce [204]. In the progress of the vaccine design currently, the selection of adjuvants is resource-independent, and usually references previous related literature to choose several types of adjuvants to construct vaccine models and the one with the best immunity will serve as the last selected. The majority of vaccine candidates use the agonists of TLRs as adjuvants to synergistically activate the immune response [205]. We still need to take care of the disadvantages of adjuvants in the rational development of vaccines, including the possibility of adverse reactions, less effective in older populations, and weak ability to induce CD8+ T cell-mediated cellular immunity [203]. Therefore, we should be careful about the selection of adjuvants. The PADRE sequence is also appended to vaccine construction to increase the immunogenicity which could be seen as an additional adjuvant, the application of PADRE sequence and other functional peptides is introduced in the ‘Supplementary Adjuvant and functional peptides’ part. Vaccine construct optimization Determining the expression of the constructed protein in a heterologous host is a significant step for the development of vaccines, the successful expression of vaccine candidates would be allowed for future production and purification [16, 206]. As the degeneracy of codons allows multiple codon coding the same protein and the codon usage bias is different for expression hosts, codon optimization of vaccines by using tools is an effective approach to improve the protein expression in the heterologous hosts [9, 207]. Besides the improvement of protein expression, the effectiveness of immunization, stability, protein conformation, and protein function could also be altered by codon optimization [208]. The CAI index and CG-content are widely used for assessing the express degree of vaccine sequence [173, 174, 180], it is generally agreed that a CAI value between 0.8-1.0, the score of GC-content between 30 and 70% would be a good vaccine candidate with high efficiency of transcription and translation [174]. There are numerous tools for codon optimization have been developed which could be divided into three categories: statistic-based, ML-based, and heuristic-based methods. The introduction of the three categories can be seen in the ‘Supplementary Codon optimization’ part and the information of related methods has listed in Table 16. Computational verification of vaccine construct Prediction of antigenicity Besides the proteins that have been experimentally demonstrated to be immunogenicity, the antigenicity of other candidate proteins should be tested, only the proteins that are considered to have antigenicity can be selected for further study. There are several related RV programs, that could be categorized into two types: filtering and classifying [222], both types take protein sequences as input, and output whether the proteins can be potential vaccine candidates or not based on the antigenicity predicted result. Vaxign [223], NERVE [224], Jenner-predict [225], and VacSol [226] are classical filtering tools. Vacceed [227] and VaxiJen [228] are the typical classifying programs. However, none of the above models could achieve a recall over 0.76. The advent and progress of ML/DL algorithms have also brought great improvements in the above two fields of predicting immunogenicity. The newest Vaxign-DL [222] method was developed by employing a multi-layer perceptron model which is a kind of DL algorithm that operates through the sequential layering of nonlinear processing units, achieve an AUC value of 0.94. The Vaxign-DL and VaxiJen v3.0 [229], which has been updated by introducing several ML algorithms and a new dataset, both exhibited great performance in the bacterial immunogenicity prediction, while the VirusImmu [230] method is proposed to improve the accuracy in the prediction of viral protective antigens, which adopt a soft voting approach to construct an ensemble model based on eight commonly-used ML methods. The VirusImmu method shows the powerful and stable capability for immunogenicity prediction with the highest AUC value over other commonly used models on their independent external test set. Prediction of allergenicity and toxicity The epitopes selected for the construction of multi-epitope vaccines must be non-allergic and non-toxic to avoid potential dangers for humans. In silico prediction of peptide allergenicity The assessment of potential allergenicity is an indispensable step in the development of vaccines [231]. The development of classical vaccines introduces large proteins or whole organisms as antigens which increases the unnecessary antigenic load, while epitope-based vaccines just comprise antigen regions of foreign substances which could decrease the chance of inducing an allergenic response [232]. The selected epitopes used for the vaccine construct and the final vaccine construction candidates must be classified as non-allergen by allergenicity prediction tools [232]. There are two criteria for the assessment of allergenic potential defined by WHO/FAO: the identity of at least six contiguous amino acids, or over 35% similarity over a window of 80 amino acids with known allergens [233]. Databases, such as AllergenOnline [234], COMPARE [235], and SDAP [54] et al. could obtain information on known allergens. The computational methods of prediction of potential allergenicity could be divided into three categories: alignment-based, alignment-free, and hybrid approaches, the classical tools have been listed in Table 19, and the discussion of all three categories can be seen in the ‘Supplementary Prediction of allergenicity’ part. In silico prediction of peptide toxicity The screening of non-toxic peptides is another important step in the filter of epitope candidates. The computational prediction methods for chemical toxicity and the in silico tools specialized for toxins of certain animal origins have been greatly studied over the years [236], while the attempt of the predictive technologies of peptide toxicity is limited but still pave the way of determining the non-toxic peptide that reduces the number of experiments [237]. ToxinPred [225] server has been extensively adopted by the scientific community for predicting the toxicity of peptides, which is an SVM-based model using features of dipeptide composition and amino acid composition (AAC) to determine the toxicity peptides or non-toxicity peptides. The upgraded version of ToxinPred2.0 [236] was designed for the prediction of protein toxicity, which compensates for the ToxinPred 1.0 length limit on predictable peptides. The newest version 3.0 [238] was proposed in 2023 for predicting peptide toxicity with the upgrade of an algorithm by using a new ML model (extra tree-based) or DL model (ANN–LSTM with fixed sequence length), and the predicted performance of ensemble approaches and solely ML/DL model all achieved a remarkable AUC value. The field of developing DL-based model is getting more attention since their great performance and the ability to handle complex tasks. Many in silico methods of DL-based have been proposed, including ToxDL [239], CSM-Toxin [240], ATSE [241], and ToxIBTL [242], and the MLP and CNN are the most used algorithms [243]. However, sometimes the performance of DL models is not better than ML models as expected may be the insufficient large dataset and the non-clear mechanistic understanding of the prediction have limited the progress of the model [243, 244]. The above methods (with the exception of ToxinPred) have rare applications in the construction of epitope-based vaccines due to their late development. With the emergence of more epitope-based vaccine research, the methods may be better applied. The potential of binding to immune receptors The innate immune receptors are important sensors of the innate immune system, which can recognize and bind to pathogen-associated molecules, and then act as molecular switches to trigger innate immune activation and subsequent adaptive immune responses [245, 246]. TLRs are the main immune receptors in mammals [191], TLRs are widely distributed and can detect a variety of ligands derived from both pathogenic and non-pathogenic microbial infections [245]. The molecular docking of TLRs and vaccine candidates is a pivotal step in validating vaccine effectiveness since successful docking could be seen as a signature of the potential of vaccine construction to trigger human immune response [10]. There are several points should be noted when selecting a docking receptor among the ten known TLRs: could recognize and respond to the pathogen-associated molecular patterns and ligands of specific pathogens, high expression levels of TLR in cells that interact with pathogens, using the extracellular or ectodomains to bind with ligands [187, 247]. There are numerous docking tools for computational simulation of the binding of vaccine constructs and TLRs, classical tools exhibit the effective performance of protein-TLR binding, such as GalaxyPepDock [192], ZDOCK [248], pyDockWEB [249], and Cluspro [250]. Meanwhile, in order to improve the prediction accuracy, a variety of ML\DL algorithms have been introduced into the development of tools [251, 252], and the remarkable and revolutionary performance of AlphaFold3 in predicting the joint structure of complexes has revealed the great potential of AI in the development of molecular docking and modeling structures in the future [253]. Immune response simulation Computational immune simulation is significantly important in the in silico design of vaccines, the verification of the ability to induce the immune response of vaccine candidates by using in silico methods with accuracy and low computational cost would effectively reduce the trial-and-error cost of experimental work. The techniques of modeling the immune system could be divided into two categories: equation-based and agent-based modeling (ABM) [254]. However, the non-linearities of the immune system make it difficult to get the right model by using equation-based methods [255], thus, the programs are commonly developed by using ABM technology. ABMs are models which observe and describe the characteristics of population by using simple rules to dictate the behavior and interaction patterns of agents at the individual level [256]. C-IMMSIM is the only available simulation program that has been great widely used in the development of multi-epitope vaccines [16]. C-IMMSIM simultaneously simulates three compartments found in mammals: the bone marrow, the thymus, and a tertiary lymphatic organ, the tertiary organ is the place where the interactions among cells and molecules take place and have been described geometrically [257]. The program uses the sequence of antigen protein in FASTA format as the input, administrates vaccine injection following user-defined intervals, and the immune response profiles in the human body of antibodies titers and several immune cells are the final output. The simulation time and targeted people could be changed by adjusting the default parameters [258]. The high consistent of predicted results with real-world animal experimental data has been demonstrated, which greatly indicated the reliability of the C-IMMSIM server and showed the remarkable application of immunoinformatic techniques in vaccine development [259, 260]. Validation of real-world cases To explore the performance of antigenicity prediction tools in real-world applications, we have collected positive vaccine sequences and constructed negative sequences for validation. The positive multi-epitope vaccines, including SARS-CoV-2 vaccine [183], CVB vaccine [179], MPXV-1-3 [173], LCMV vaccine [175], ChRNV22 [181], MVC [176], and MPXV vaccines [172, 180] have been collected from published literature, all of above illustrated potential immunogenicity through computational verification or experimental verification in their studies. The collected process of negative samples can be seen in the ‘Supplementary Validation of real-world cases’. Here, we selected two widely used and user-friendly tools of VaxiJen [228] and DeepImmuno [261] tools for real-world vaccine validation. As illustrated in Table 17, the predicted score of VaxiJen 2.0 is higher in the vaccine group (average value of 0.6219) than in negative control group (average value of 0.5125), but without statistical significance (P = .14). Though the average scores of both groups are over the threshold, the predicted scores of the vaccine group are well above the threshold, the highest score over twice than the threshold. The result exhibited that although there is no statistical significance between the negative and positive results, the VaxiJen tool can get higher scores for real vaccines. The result may lack of representation since the volume of vaccine sequence datasets is relatively small which may make the tool cannot effectively distinguish negative data from positive data during operation. Table 17Statistical analysis result of VaxiJen 2.0 tool VaxiJen 2.0 (threshold = 0.4)Average scoreP valuepositive0.53080.50760.63190.55170.59400.63230.59230.56060.43911.10810.62190.1363negative0.56870.46940.48550.36730.71750.56620.49200.60970.42100.42730.5125 Statistical analysis result of VaxiJen 2.0 tool Meanwhile, the results of DeepImmuno illustrated in Table 18, most of the average scores of positive group are higher than that of negative group, statistical significance in four out of 10 tested HLA alleles (P < .05), indicating that this tool may have the potential to distinguish effective immune epitopes (positive results) from ineffective ones (negative results). The performance of this tool in recognizing the immunogenicity of CD8+ epitopes reflects the effectiveness and importance of computational tools in the process of vaccine verification. Meanwhile, it provides a reliable idea for the development of prediction tools for the immunogenicity of CD4+ epitopes and B cell epitopes. According to the performance difference of the two tools, we should be cautious about using computational tools for antigen screening. The antigen candidates of vaccines can be identified efficiently by in silico methods but there may still be FP results, so screened results should be combined with other more reliable experimental methods for comprehensive evaluation. Secondly, both of these tools provide useful ideas for future tool development or improvement, we look forward to more comprehensive and accurate immunogenicity prediction tools in the future. Table 18Statistical analysis result of DeepImmuno tool DeepImmuno (threshold = 0.5) HLA-A*0201HLA-A*1101HLA-A*2402HLA-B*0702HLA-B*0801HLA-B*3501HLA-B*4001HLA-C*0102HLA-C*0401HLA-C*0702Average scorePositive0.54680.53870.44490.51020.81330.72250.80080.95580.84020.8423negative0.50910.47950.41910.49870.77740.67780.76660.80870.93790.8032P value0.19720.16250.20970.69220.0136*0.0381*0.05653.669E-18*8.071E-12*0.0364* Statistical analysis result of DeepImmuno tool Table 19A list of tools for evaluation of vaccineUsageToolFeatureInputOutputCut offPlatformYearRefantigenicityVacceedClassifying class, pipeline based on eukaryotic pathogens resources, including build proteome and ML algorithm.Proteomea ranked list of protein candidates>0.5source code2014[227]VaxiJenClassifying class, alignment-independent method based on ACC transformationSingle/multiple protein sequence, target organismprediction probability, a statement of protective antigen or non-antigen>0.5webserver2007[228]VaxiJen v3.0Classifying class, a voting approach based on three supervised ML methodstarget organism, single/multiple protein/peptidePredicted probability for immunogenicityNAwebserver2020[229]NERVEFiltering class, an automated RV system, identify PVCs from bacterial proteomesProteomeA ranked table of PVCs with predicted features information and links to corresponding primary dataNon-surface antigens, >2 transmembrane helices, adhesin probability>0.46 or 0.38, and no or low similarity with human proteinssource code2006[224]Jenner-predict serverFiltering class, method predicting PVCs from bacterial proteomes based on identifying critical functional domainsProtein sequence or a proteomeA ranked list of PVCs and information of predicted parametersNon-cytosolic protein, <3 transmembrane helices, Pfam ID is listed in master listwebserver2013[225]VaxignFiltering class, a system based on genome sequences, including two programs: Vaxign Query, Dynamic Vaxign AnalysisSelected genomes, or single /multiple protein sequence and parameters (optional)A table of PVCs with information of predicted parameters and similar proteinsOuter membrane proteins, <2 transmembrane helix, >0.51 Adhesin probability, no homology with human and mouse proteinswebserver2010[223]VacSolFiltering class, a highly scalable, multi-mode, and configurable software for identifying PVCs from bacterial proteomesproteomea summary report of query proteome with predicted feature information of each sequence, the proteins that meet all feature criteria in report would have an epitope analysis tableno homology with human proteins, <2 transmembrane helix, essential gene, virulent protein, no cytoplasmatic proteinsource code2017[226]Vaxign-MLClassifying class, a ML classification RV program, incorporates both biological and physicochemical propertiesSingle protein sequence, pathogen typethe percentile rank score and basic information>58%webserver source code2020[262]Vaxign2Classifying class, a comprehensive web server consisting of predictive and computational workflow componentsProtein sequence, parametersA table with basic analysis results, a table with immunogenicity and functional profile, contains basic and population coverage information of predicted epitopeVaxign-ML score > 90, adhesin probability>0.51webserver source code2021[263]DeepImmunoA CNN-based model using a beta-binomial distribution approach to determine the immunogenicity potential of query peptide with HLA-I moleculesPeptide and MHC moleculeImmunogenicity score and binding score of query peptide and MHC molecule, extra information of query sequence and MHC.>0.5webserver source code2021[261]Vaxign-DLa three-layer fully connected NN modelNANANANA2023[222]VirusImmuClassifying class, a novel soft-voting ensemble approach based on the top three modelsProtein sequencesthe predicted antigenicity score>0.4source code2023[230]allergenicityAllermatchsequence similarity-based, three alignment methods: sliding window approacha, wordmatchb, and full alignmentcamino acid sequence without headerA ranked table of similar allergens with alignment scores and detailed informationab A bar diagram shows the hit number between the query sequence and allergenic protein database, a ranked list of similar allergens with alignment scores and detailed informationc35%awebserver2003[264]AllerToolsequence similarity-based, four integrated tools: XR-BLASTa, XR-Graphb, ALR-SCANc and ALR-SVMdamino acid sequenceinformation on allergens that have reported cross-reactivity with the individual matchesa, a possible allergen cross-reactivity relationship graphb, a list of matchs that satisfy either of the rulesc, a list of high-similarity allergen sequences and reported cross-reactivity informationdNAwebserver2007[265]Bjorklund et almotif similarity-based, a dataset of allergen-representative peptides (ARPs), a supervised classifier DASARP based on the automated selection of ARPsPeptide sequencePredicted score value5.51, a higher value indicating a higher risk of allergenicityNA2005[266]Lu et al.motif similarity-based, a dataset of allergen-specific motifs based on physical and chemical properties (PCP-motifs) for 17 highly populated protein domains, a score model based on PCP-motifsNANANANA2018[267]AllergenFPAn alignment-free descriptor-based fingerprint approachOne protein sequencea statement of probable allergen or probable non-allergen, a link of protein from the pair with the highest Tanimoto similarity indexNAwebserver2014[268]AllerTOPalignment-free predictor based on the main physicochemical properties of proteinsOne protein sequencea statement of probable allergen or probable non-allergen, a link of the nearest protein in UniPrptKB databaseNAwebserver2013[269]AllerTOP v.2alignment-free method using amino acid E-descriptors, ACC transformation, and ML algorithmOne protein sequencea statement of probable allergen or probable non-allergen, a link of the nearest protein in UniPrptKB databaseNAwebserver2014[270]ProAll-Dalignment-free model using long short term memory slgorithmprotein sequencea statement of allergen or non-allergenNAwebserver source code2022[271]Kumar et alalignment-free ensembled approach using three DL modelsProtein sequencethe class label (allergen or not) of query proteinNApython programs2023[272]AlgPredHybrid approach, contains (i) scanning of IgE epitopes; (ii) motif-based approach; (iii) SVM-based method using amino acid composition; (iv) SVM module based on dipeptide composition, (v) BLAST search on ARPs, and (vi) Hybrid ApproachOne protein sequencecomprehensive information about the prediction that includes score, threshold, distance from threshold, precision and negative prediction value−0.4(iii) −0.2(iv)webserver2006[121]AlgPred 2.0Hybrid approach, integrates four major modules: (i) prediction using hybrid or RF model, (ii) IgE epitope mapping, (iii) motif scan, and (iv) BLAST searchone or more protein sequencea statement of allergen or non-allergen, predicted score of each method (for (i)), the predicted similar proteins or motifs from the database (for (ii) (iii) (iv))(i) default threshold is 0.3, while user can change the valuewebserver standalone source code python programs2020[127]AllerCatPro1.7Hybrid model based on similarity of both their amino acid sequences and 3D structuresone or more protein sequenceA table with the predicted result for allergenicity, the identity scores of similar allergensNAwebserver2019[273]AllerCatPro 2.0Hybrid model based on similarity of both their amino acid sequences and predicted 3D structures, provide clinical relevance informationone or more protein/nucleotideA table with the predicted result for allergenicity, the identity scores, functionality and clinical information of similar allergensNAwebserver2022[274]toxicityToxinPred 1.0Model developed for predicting and designing toxic peptides, including several major modules: (i) designing peptide, provides multiple methods to select, (ii) batch submission, (iii) Protein scanning, (iv) QMS calculator, and (v) motif scanningone or more peptide/protein sequenceA list with a statement of toxic or non-toxic, result score, and predicted physiochemical properties (for (i)(ii)(iii)), the mutant positions of peptides (for (i)(ii)), a table of original sequence and QM score ((for (iv)), a quantitative matrix of positions and QM scores (for (v))SVM threshold and E-value cut-off for motif-based method should be defined by users, the default status is 0.0 and 10webserver2013[225]ToxinPred2.0a protein toxicity predictor, including four major modules: (i) prediction using two models, (ii) motif scan, (iii) BLAST search and (iv) Downloadone or more protein sequencesa statement of toxic or non-toxic, result scores of each method (for (i)), similar sequence information from the database (for (ii)(iii))(i) default threshold is 0.6, (iii) default E-value is 10e-6, both values could be changedwebserver stand-alone2022[236]ToxinPred3.0a peptide toxicity predictor, including five major modules: (i) prediction, using models of ET/DL based or hybrid approaches, (ii) protein scanning, (iii) motif scan, (iv) BLAST search, and (v) Downloadone or more protein sequencesa statement of toxic or non-toxic, result scores of each method and precision value (for (i)(ii)(iii)), similar sequence information (for (iv))<0.5 means non-toxic of ET/DL based model, <0.38 means non-toxic of hybrid approaches, the E-value is 10e-3, while the values could also be defined by userswebserver standalone pip package2023[238]ToxDLa multi-modal DL-based approach, which could deal with variable-length sequences in inputone or more peptide sequenceThe predicted score and status, a proclaimed contribution score for each amino acid, and toxic domains detected by InterProScan>0.5, non-toxicwebserver source code2021[239]CSM-Toxinan in-silico protein toxicity classifier using natural languages modelone or more protein sequencesa table includes predictions for each protein sequence with general physicochemical detailsNAwebserver source code2023[240]ATSEa peptide toxicity predictor based on DL model exploiting structural and evolutionary informationpeptide sequencesa toxicity probability of a given peptideNAwebserver2021[241]ToxIBTLa peptide and protein toxicity predictor based on DL framework by utilizing the information bottleneck principle and transfer learningProtein/peptide sequencea toxicity probability<0.5, non-toxicwebserver source code2022[242]Protein-peptide dockingpyDockWEBrigid-body docking program using electrostatics and desolvation scoring3D structures of two interacting proteinsa gzip compressed tar archive containing structure files and process files of generated docking modelNAwebserver2007[249]ZDOCKrigid-body docking program using a combination of shape complementarity, electrostatics and statistical potential terms for scoringtwo structures to be docked3D structures of generated complex models and the center-of-mass positions of ligands, download link of each predicted modelNAwebserver2014[248]GalaxyPepDocktemplated-based docking method based on interaction similarity and energy optimizationprotein structure, peptide sequenceA table contains the best 10 generated models with structure, additional information, download linksNAwebserver2015[192]Clusprorigid-body docking program using four scoring schemesTwo protein/peptide 3D structuresThe calculated scores and 3D structures of top 10/20/30 scoring docking models with download linkNAwebserver2020[250]Immune SimulationC-IMMSIMAn agent-based model to simulate the immune system response of mammalian at cellular level after the injection of antigenone or more protein sequencePlots relative to the cell count of immune related cells, the predicted outcome of the epitope/peptideNAwebserver2010[257, 260]Key for feature: ACC: auto cross covariance; ML: machine learn; DL: deep learning; NN: neural network; ET: Extra tree. NA: data not given. A list of tools for evaluation of vaccine Key for feature: ACC: auto cross covariance; ML: machine learn; DL: deep learning; NN: neural network; ET: Extra tree. NA: data not given. The role of ai in the development of vaccines The applications of AI technology have greatly improved the development of vaccines, both ML and DL techniques are widely used to develop computational tools. AI is becoming increasingly relevant for epitope prediction, the development of DL-based methods including DLBEpitope [128], BigMHC [88], MHCflurry [84], and other epitope predictors have greatly improved the efficiency of epitopes screening, tools like Fine-tuned AlphaFold2 and MHCfold [94] can achieve the accurate modeling of pMHC complexes. Besides the above epitope predictors, the application of AI has also promoted the construction of pipelines for the design and screening of immunogenic antigens for vaccines. NeoDisc [275] is an end-to-end clinical proteogenomic pipeline that integrates various in silico tools for the identification, prediction, and prioritization of immunogenic tumor-specific HLA-I and -II antigens. The DeepNovoAA [276] and pTuneos [277] are also pipelines developed for the identification and design of neoantigens based on DL. The Neo-intline [278] tool is an integrated pipeline to simulate the presentation process of peptides in vivo. The TransPHLA-AOMP [86] is a transformer-based model that is derived from the same team as TransPHLA used for pHLA binding prediction. Based on the predicted results of TransPHLA, the AOMP program can automatically optimize mutated peptides for peptide vaccine design. The above tools demonstrated that AI technology can greatly promote the progress in antigen identification and design and the potential for personalized antigen discovery and neoantigen cancer vaccine design. Moreover, AI plays an important role in the optimization of vaccines, the LinearDesign [221] tool introduced the classical concept of lattice parsing in computational linguistics to handle the insurmountable computational challenge caused by codon usage and the limited in application of mRNA vaccines caused by mRNA instability and degradation. The application of the tool would shorten the cycle and reduce the costs of the development of vaccines. In the computational verification of vaccine candidates, AI-based tools such as DeepImmuno [261], ProAll-D [271], ToxinPred3.0 [238], CSM-Toxin [240], ATSE [241], and others have covered the antigenicity, allergenicity and toxicity, and other aspects of the validation. Besides design based on current appeared pathogens or mutations, the development of the EveScape [279] tool also demonstrated the potential of AI in the forecasting of emerging mutant strains future. The EveScape is a flexible framework that can quantify the viral escape potential of mutations at scale and predict probable further mutations. According to the forecasted emerging viruses with pandemic potential, we can assess the ability of developed vaccines to protect against future new viruses and improve or design new vaccines or drugs to achieve early prevention and control. The development of the above tools covers various aspects of vaccine design and demonstrates that the application of AI technology has greatly improved the design of vaccines. The utilization of AI-based tools has simplified the steps, and accelerated the process of vaccine development, and improved the accuracy and efficiency of vaccine design. The requirement for a large number of computing sources and long run times [280], and the need for high quality and large number of training data [281] have limited the development and application of DL-based tools to some extent. The un-interpretable result of prediction is another main challenge [282]. Thus, to promote the development of DL-based methods with great performance, we may need to further explore the high-quality data and the mechanism of tools. Discussion and perspective Revolutionary technological advances over the past few decades have greatly changed the form of vaccine development, the usage of effective and reliable bioinformatic tools has replaced the tedious and time-consuming experiment, which greatly improves the application and shortens the development cycle of vaccines. Following the genome era advent, the integration of computational means with biology knowledge is an inevitable tendency to develop medical interventions, the multi-epitope vaccine is a new attractive type, and the rational design of vaccines showed a guarantee to produce a long-term cross-protection and controlled robust immune response, and also could improve side effects to ensure the safety of vaccines in humans. The rational design of multi-epitope vaccines largely depends on the existing databases and immunoinformatics tools, mainly including three aspects: 1) immunogen design, 2) vaccine construction and optimization, and 3) computational verification. In this review, we systemically review the pipeline of computational designing a multi-epitope vaccine, and the current development strategies with commonly used in silico resources including databases and tools of each step have been introduced. Further, we designed three benchmark validations on T-cell epitope predictors, B-cell epitope predictors, and immunogenicity predictors for real-world vaccine sequences. The results of benchmark validation can provide hints to users for in-silico vaccine design and optimization. The development process of multiple-epitope vaccines is highly procedural and data-driven [283]. The high-quality database, effective computational tools, and standard procedure will greatly promote the development of vaccines. The selection of suitable data is the foundation of further analysis which will decide the accuracy and reliability of the result. Currently, related databases are well established, and most of them contain high-quality experimentally or manually curated data, such as IEDB [20] and AntiJen v2.0 [24]. Meanwhile, there are multiple pan-epitope databases, with only a few for specific pathogens. For example, the HBV and influenza peptides in the IEDB database are relatively small, which cannot be used to generate the pathogen-specific model. This is largely due to the accumulation of experimental data and the updating rate of each database. The update frequency will also affect the data quality, such as the IMGT/mAb-DB database being updated twice per year [22], InnateDB database will weekly updated annotation [43], STCRDab is automatically updated weekly [35], up-to-date data will help researchers to master the latest developments. Besides, the difference in data format and annotation standard will increase the complexity of data processing. As the usage of databases, whether the operation is simple, whether to provide query tools and extra tools, for the integration of the relevant database, whether free and so on will affect the use efficiency of the user. These gaps in databases may be bridged through the development of stricter and standard criteria for data processing and the application of advanced technology. This is one of the important development directions of our future. Also, data can be considered as the source of vaccine design, and appropriate bioinformatics methods are the tools that influence the success rate. Despite the fact that relevant methods have been constantly introduced in the last decades with several successful cases of in-silico vaccine design, the overall success rate is still not particularly satisfactory. This is partially because the performance of models still needs to be further improved, but more importantly due to the limitations of the computational tools that are designed to solve binary classification, prediction and regression issues cannot deal with the entire complex biological process, especially the response of the immune system to the vaccines. The computational design encompasses the screening of antigens, the prediction of epitopes, the optimization of vaccine construct, the computational verification, and so on, which would involve many tools. The selection of suitable tools is also a challenge. To standardize and simplify the overall process of vaccine design, the development of AI-based pipelines that integrate various tools with great performance is another direction for future study. T cell epitope predictors developed mainly focusing on the mechanism of processing and presentation, but many peptides that could be processed and presented still are not immunogenic [284]. Thus, we should clarify the internal mechanism of being epitopes and combine the other aspects such as the binding stability of peptide and HLA molecule, the secretion of specific cytokines, and the binding of pMHC-TCR to develop new epitope predictors. Currently, tools for predicting epitopes are mainly sequence-based, however, sequences are essentially a one-dimensional abstraction that often fails to encapsulate some high-dimensional information [16], meanwhile, the time-consuming experiments have limited the accumulation of high-quality 3D structures which makes the development of structure-based method lag behind the sequence-based methods. But the occurrence of AlphaFold which has exhibited significant performance in modeling, may accelerate the progress of the prediction and application of conformational epitopes since an accurate computational modeling model could greatly reduce the need of structures in nature. There are several tools based on AlphaFold have been developed [95, 98], but the number is still low, we might need to pay more attention to studying how to apply AlphaFold to epitope-based vaccine developments. Despite the great advantages of currently available tools, there is still room for improvement to guide future vaccine design. Current SOTA methods can be divided into webserver-based tools and GitHub code- based tools according to the usage for users. New tools such as MixMHCpred [90], BigMHC [88], and ConvNeXt-MHC [91] can only be applied by GitHub code whether than the user-friendly webserver. Moreover, those tools require high computational resources, which may not be convenient enough for researchers without enough background knowledge and resources. In this regard, webserver-based tools such as ImmuneApp [92], NetMHCpan [75], HLAthena [80], and TransPHLA [86] are more friendly for researchers. Meanwhile, webserver-based tools limited the submission maximum. For example, ImmuneApp, NetMHCpan-4.1, and HLAthena can only submit a limited number of HLA alleles and peptides, which makes it difficult for large-scale screening. More importantly, besides those tools for predicting the interactions between specific molecules such as peptide–MHC, pMHC-TCR, and epitope-BCR, there is an urgent need to develop integrated epitope prediction processes, which can fill in the gaps of high prediction performance of in-silico models and low clinical application successes. In the field of tumor neoantigen vaccine design, pipelines rather than individual tools become to accumulate in recent years, which help to accelerate the discovery of neoantigens. Typical works including muller’s approach [285] and neo-intline [278] considered multiple or even dozens of different in vivo processing steps to incorporate the pipeline that ultimately allows for the direct screening of suitable neoantigen design. This idea can also be applied to the development of in-silico approaches for pathogen-related vaccine design in the future. Secondly, in the selection of linkers and adjuvants during the construction of multi-epitope vaccines, there are only a few relevant information resources, and the design tools of vaccine adjuvants are still needed. Meanwhile, since the current selection usually references previous related literature, the scope of application, advantages, and disadvantages of currently commonly used adjuvants to be obtained through a literature survey, maybe could provide comprehensive information for future vaccine design and selection. The use of nanotechnology can offer a self-adjuvanting delivery system and reduce the toxicity of currently studied experimental adjuvants in the development of vaccines, the application of antigen in nanoparticle form is another area worth discussing [7]. Since advanced technology has revolutionized vaccine development, there are various studies about the computational design of vaccines every year, but only a small portion of a huge number of designed vaccines has the potential to apply and is worth validating by experiments. The in-silico evaluation platform should be constructed and used as the last step to assess the effectiveness of studies of the development of vaccines. In addition to the above-discussed computation verification terms factors, others like glycosylation site, physicochemical properties, etc. have also been studied in some research. Therefore, constructing a complete and rigorous standard process of evaluation could ensure the feasibility and evaluation efficiency of vaccine evaluation data. This review has systemically summarized the strategy of rational design of multi-epitope vaccines in silico and introduced the widely used bioinformatics tools and databases on the basis of the relative literature. We hope this review can help the researchers identify the basic steps of developing a multi-epitope vaccine and select suitable tools for each step quickly, provide some help for future research. Key Points The multi-epitope vaccine is a promising strategy for the prophylactic and therapeutic against pathogens infection, the pipeline of computational designing a multi-epitope vaccine can be divided into four critical steps. The multi-epitope vaccine is a promising strategy for the prophylactic and therapeutic against pathogens infection, the pipeline of computational designing a multi-epitope vaccine can be divided into four critical steps. The current development strategies with commonly used in silico resources including databases and tools of each step have been concluded which can help researchers quickly grasp the basic points of developing multi-epitope vaccines and available resources. The current development strategies with commonly used in silico resources including databases and tools of each step have been concluded which can help researchers quickly grasp the basic points of developing multi-epitope vaccines and available resources. The description of tools used in each process containing claimed performance, features, dataset, and input/output information have been summarized, which can used as a reference for researchers to select suitable tools of each process for designing a multi-epitope vaccine. The description of tools used in each process containing claimed performance, features, dataset, and input/output information have been summarized, which can used as a reference for researchers to select suitable tools of each process for designing a multi-epitope vaccine. This study provides three benchmark validations on T-cell epitope predictors, B-cell epitope predictors, and immunogenicity predictors for real-world vaccine sequences, the results can provide hints to users for in-silico vaccine design and optimization. This study provides three benchmark validations on T-cell epitope predictors, B-cell epitope predictors, and immunogenicity predictors for real-world vaccine sequences, the results can provide hints to users for in-silico vaccine design and optimization. Supplementary Material