ARTICLE https://doi.org/10.1038/s41467-019-09799-2 OPEN 1234567890():,; Community assessment to advance computational prediction of cancer drug combinations in a pharmacogenomic screen Michael P. Menden 1,2,185,187, Dennis Wang1,3,187, Mike J. Mason 4,187, Bence Szalai5,6,7,187, Krishna C. Bulusu1,187, Yuanfang Guan8,187, Thomas Yu 4, Jaewoo Kang 9, Minji Jeon9, Russ Wolfinger10, Tin Nguyen 11, Mikhail Zaslavskiy12, AstraZeneca-Sanger Drug Combination DREAM Consortium†, In Sock Jang4, Zara Ghazoui1, Mehmet Eren Ahsen 13, Robert Vogel13, Elias Chaibub Neto4, Thea Norman4, Eric K.Y. Tang1, Mathew J. Garnett14, Giovanni Y. Di Veroli15, Stephen Fawell16, Gustavo Stolovitzky 13,17, Justin Guinney 4,188, Jonathan R. Dry16,188 & Julio Saez-Rodriguez 2,7,186,188 The effectiveness of most cancer targeted therapies is short-lived. Tumors often develop resistance that might be overcome with drug combinations. However, the number of possible combinations is vast, necessitating data-driven approaches to find optimal patient-specific treatments. Here we report AstraZeneca’s large drug combination dataset, consisting of 11,576 experiments from 910 combinations across 85 molecularly characterized cancer cell lines, and results of a DREAM Challenge to evaluate computational strategies for predicting synergistic drug pairs and biomarkers. 160 teams participated to provide a comprehensive methodological development and benchmarking. Winning methods incorporate prior knowledge of drug-target interactions. Synergy is predicted with an accuracy matching biological replicates for >60% of combinations. However, 20% of drug combinations are poorly predicted by all methods. Genomic rationale for synergy predictions are identified, including ADAM17 inhibitor antagonism when combined with PIK3CB/D inhibition contrasting to synergy when combined with other PI3K-pathway inhibitors in PIK3CA mutant cells. 1 Oncology, IMED Biotech Unit, AstraZeneca, Cambridge SG8 6EH, UK. 2 European Bioinformatics Institute, European Molecular Biology Laboratory, Cambridge CB10 1SD, UK. 3 Sheffield Institute for Translational Neuroscience, University of Sheffield, Sheffield S10 2TN, UK. 4 Sage Bionetworks, Seattle, WA 98121, USA. 5 Department of Physiology, Faculty of Medicine, Semmelweis University, Budapest 1085, Hungary. 6 Laboratory of Molecular Physiology, Hungarian Academy of Sciences and Semmelweis University (MTA-SE), Budapest 1085, Hungary. 7 RWTH Aachen University, Faculty of Medicine, Joint Research Center for Computational Biomedicine, Aachen 52062, Germany. 8 Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor 48109, USA. 9 Department of Computer Science and Engineering, Korea University, Seoul 02841, Korea. 10 SAS Institute, Inc, Cary, NC 27513, USA. 11 Department of Computer Science and Engineering, University of Nevada, Reno 89557, USA. 12 Independent Consultant in Computational Biology, Owkin, Inc., New York, NY 10022, USA. 13 IBM Thomas J. Watson Research Center, Yorktown Heights, New York 10598, USA. 14 Wellcome Trust Sanger Institute, Hinxton CB10 1SA, UK. 15 Early Clinical Development, IMED Biotech Unit, AstraZeneca, Cambridge SG8 6EH, UK. 16 Oncology, IMED Biotech Unit, AstraZeneca, R&D Boston, Waltham, MA 02451, USA. 17 Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York 10029, USA. 185Present address: Institute of Computational Biology, Helmholtz Zentrum München - German Research Center for Environmental Health, Munich D-85764, Germany. 186Present address: Heidelberg University, Faculty of Medicine, Institute for Computational Biomedicine, Bioquant, 69120 Heidelberg, Germany. 187These authors contributed equally: Michael P. Menden, Dennis Wang, Mike J. Mason, Bence Szalai, Krishna C. Bulusu, Yuanfang Guan. 188These authors jointly supervised this work: Justin Guinney, Jonathan R. Dry, Julio Saez-Rodriguez. †A full list of consortium members appears at the end of the paper. Correspondence and requests for materials should be addressed to J.G. (email: justin.guinney@sagebionetworks.org) or to J.R.D. (email: jonathan.dry@astrazeneca.com) or to J.S.-R. (email: julio.saez@bioquant.uni-heidelberg.de) NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 1 ARTICLE P NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 ersonalized treatment matching targeted drugs to a tumor’s genetics has resulted in remarkable responses. Unfortunately, most patients’ tumors develop resistance leading to disease relapse. There are multiple mechanisms that may lead to drug resistance1 that include genetic and non-genetic heterogeneity inherent in advanced cancers, coupled with complex feedback and regulatory mechanisms, and dynamic interactions between tumor cells and their microenvironment. Any single therapy may be limited in its effectiveness, but drug combinations are hypothesized to potentially overcome drug resistance and lead to more durable responses in patients. The molecular makeup of cancer cells and the mechanisms driving resistance will influence the optimal combination of mechanisms to target1–3. High-throughput preclinical approaches are crucial to determine and evaluate effective combination strategies. While empirical experiments are important for observing potential synergistic properties across drug pairs, the possible number of combinations grows exponentially with the number of drugs under consideration. This is further complicated by the influence of disease and cellular contexts, rendering it impractical to cover all possibilities with undirected experimental screens4. Computational approaches for predicting drug synergy are critical to guide experimental approaches for discovery of rational combination therapy5. A number of approaches have been developed to model drug combination synergy using chemical, biological, and molecular data from cancer cell lines6,7 but with limited translatability to the clinic. A key bottleneck in the development of such models has been a lack of public data of sufficient size and variety to train computational approaches4,8, particularly considering the diversity of biological mechanisms that may influence drug response. A further limit to the translatability of many computational approaches is their reliance on data features that may not be present during the course of patient care, such as on-treatment tumor molecular profiles. To accelerate the understanding of drug combination synergy, Dialog for Reverse Engineering Assessments and Methods (DREAM) Challenges partnered with AstraZeneca and the Sanger Institute to launch the AstraZeneca-Sanger Drug Combination Prediction DREAM Challenge. DREAM Challenges (dreamchallenges.org[www.dreamchallenges.org]) are collaborative competitions that pose important biomedical questions to the scientific community, and evaluate participants’ predictions in a statistically rigorous and unbiased way, emphasizing model reproducibility, and methodological transparency9. This Challenge was designed to explore fundamental traits that underlie effective combination treatments and synergistic drug behavior. Specifically, it was structured to address the following translational questions using data available prior to drug treatment (mirroring a clinically relevant scenario to direct therapeutic choice): [i] how to predict whether a known (previously tested) drug combination will be effective for a specific patient; [ii] how to predict which new (untested) drug combinations are likely to yield synergistic behaviors in a patient population; and [iii] how to identify novel biomarkers that may help reveal underlying mechanisms related to drug synergy. We shared with the scientific community 11,576 experimentally tested drug combinations on 85 cancer cell lines. Molecular data was provided for the untreated (baseline) cell lines, alongside chemical information for the respective drugs. Participants used the described data to train and test models, and were encouraged to extend computational techniques to leverage a priori knowledge of cellular signaling networks. In this manuscript, we report on the results of this Challenge where we have identified novel and performant methods using a rigorous evaluation framework on previously unpublished data. 2 We describe the details of these approaches, as well as general trends arising from the meta-analysis of all submissions. The full dataset, along with methods and scoring functions, are freely provided to the research community, and available to benchmark future algorithms in the field. Finally, we describe putative mechanistic models derived from the observed predictive features underlying synergistic responses, particularly between receptor tyrosine kinase and PI3K/AKT pathway inhibitors. Results A large high-throughput drug combination screen. We collated a combinatorial drug sensitivity screen comprising 11,576 experiments each measured in a 6-by-6 dose matrix (Methods) across 85 cancer cell lines. A synergy and an antagonism distribution (Loewe reference model10,11) were calculated and summarized via a single score for each experimental matrix (Methods; Supplementary Fig. 1 and Supplementary Data 1). The resulting dataset included highly reproducible cell viability response measurements and synergy scores for 910 pairwise combinations of 118 drugs (Supplementary Fig. 2 and Methods), plus information on the drugs including putative drug targets and their chemical properties. We also integrated deep molecular characterization of these same cell lines, including somatic mutations, copy-number alterations, DNA methylation, and gene expression profiles (Fig. 1a–c) measured before drug treatment12. The 85 cell lines were predominantly derived from tumors of the breast (N = 34), lung (N = 22), bladder (N = 14), and the gastrointestinal tract (N = 12) (Fig. 1d). Drug synergy score distributions varied across disease types (Fig. 1d); in particular lung cell lines had over twofold higher mean synergy than breast cell lines (t-test P = 7e-27). Of the 118 drugs tested, 59 were targeted therapies against components of oncogenic signaling pathways (Methods), 15 of which target receptor tyrosine kinases (RTKs), 22 target PI3K/AKT signaling, and 9 target MAPK signaling (Fig. 1e, f). Across the pairwise drug combination experiments, 88% (N = 797) of the unique pairs had drug targets within the same signaling pathway and demonstrated markedly overall higher synergy scores (average of 17.3 vs. 7.3, t-test P = 2e–18) than the remaining 12% (N = 113) whose drug targets were defined to be in distinct pathways. As part of the Challenge design, we ensured that drug targeted pathways and cancer types were proportionally distributed across sub-challenges and training/test datasets (Fig. 1g). Sparsity in the cell line drug combination data matrix (Fig. 1g) resulted as several drug combinations were selectively profiled in clinically relevant cancer cell lines, e.g., ESR1 inhibitors were predominantly combined with other drugs in estrogen receptor-positive breast cancer cell lines since these agents are standard of care within this cancer subtype. Comparison of AZ-DREAM to published combination screens. We compared the AstraZeneca-DREAM (AZ-DREAM) challenge dataset with the independently published in vitro combination screening studies by O’Neil et al.4 and ALMANAC13. All three studies used different experimental designs and protocols (Fig. 2a and Supplementary Table 1), with AZ-DREAM exploring screens with a 5-by-5 concentration titration format, O’Neill et al.4 a 4by-4 format, and ALMANAC a 3-by-3 format. The overlap is limited in cell lines, targets and drugs explored: 10 cells and 7 targets, 4 drugs and 0 combination-cell pairs shared between AZDREAM and O’Neil et al.4; and 15 cells, 28 targets, 19 drugs, and 10 combination-cell pairs shared between AZ-DREAM and ALMANAC. AZ-DREAM provides greater coverage of targeted agents and greater numbers of cell lines per tumor type (Supplementary Table 1). NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 a d *Challenge 1B, restricted input Methylation Synergistic Breast Lung Urology GI Niche Haems 85 cell lines Deep molecular characterisation CNV* Mutations* 0 10 20 –100 30 0 100 Synergy score Number of cell lines e Function: f Pathway: Cell death b Input Data mining External data EMT/migration Differentiation DNA repair DDR Metabolism Other Chemo MAPK Hormonal Metabolism STK Cell Cycle Epigenetic Other Pathways* AKT/PI3K Apoptosis Oncogenic signal c RTK Predict g Monotherapies ug A Sub-challenge 2 Classification (synergy/non-synergy) • Combinations Dru Dr gB Viabi lity Conc. 11,576 experiments Drug A Drug B 910 drug combinations 85 cell lines Viability Putative target Structure Properties Pharmacology high-throughput 118 drugs in portfolio GEX Gene Test sets Leaderboards Train set Sub-challenge 1 Regression Not experimental measured Fig. 1 Drug combinations and cell lines profiled. a Molecular characterization of the cell lines included genetics, epigenetics, and transcriptomics. b Participants were encouraged to mine external data and pathway resources. c Participants were provided the putative targets for all and chemical structures for ~1=3 of drugs (with this manuscript structures are now provided for all drugs). d The cell line panel contained 85 cell lines from six different cancer types, combination synergy scores capped within a range of −100 to 100. e The drug portfolio comprised approximately half oncogenic signaling targeting agents, and half cytotoxic drugs of which 14 were untargeted chemotherapies. f Drugs split by the putative targeted pathway. g Sparse data was split into training set, leaderboard, and independent test set for SC1 and SC2 b Maximal used drug concentrations c Drug combinations of gefitinib + drug X (synergy scores) 15 3 ALMANAC synergy scores Tamoxifen log10(conc.) [µM] 2 1 0 –1 –2 10 Vorinostat 5 t al. eil e O’N AC AN ALM Fulvestrant Everolimus Tamoxifen 0 –5 caene raZ Ast REAM D Crizotinib ALMANAC cell viability [%] a Drug combinations of gefitinib + drug X (cell viability of identical drug conc.) 100 90 Spearman = 0.70 (P = 7.92e–7) Pearson = 0.71 (P = 6.92e–7) 80 70 Experiments: Fulvestrant in mcf7 Fulvestrant in t-47d Tamoxifen in mcf7 Tamoxifen in t-47d Vorinostat in mcf7 Crizotinib mcf7 Crizotinib in t-47d 60 MCF7 T47D –30 –20 –10 0 10 20 30 AstraZeneca-DREAM synergy scores 40 20 40 60 80 100 AstraZeneca-DREAM cell viability [%] Fig. 2 Reproducibility of independent in vitro drug combination datasets. a Comparison of the maximum drug concentration used in the AZ-DREAM, O’Neil et al.4 and ALMANAC datasets. b Synergy scores of identical drug combinations in AZ-DREAM and ALMANAC. Horizontal and vertical striped lines mark the threshold for synergistic and antagonistic, where positive and negative scores confirm synergy and antagonism, respectively. c Shows cell viability for each of the 38 overlapping experimental titration points that are identical in AZ-DREAM and ALMANAC across the nine drug combination experiments, significance calculated with test for association (Supplementary Fig. 3) For the AZ-DREAM and ALMANAC comparison, only nine experiments passing quality control (Supplementary Methods) had the same combination tested in the same cell line, comprising gefitinib combined with either tamoxifen, fulvestrant, vorinostat, crizotinib, or everolimus, and tested in two breast cancer cell lines (MCF7 or T47D). Encouragingly, all but one experiment were concordantly identified synergistic with the same effect signs seen in AZ-DREAM and ALMANAC (Fig. 2b). Within the nine overlapping experiments, 38 titrations were identically used by both ALMANAC and AZ-DREAM (Supplementary Fig. 3 and Supplementary Fig. 4a). For these 38 titrations we observed a correlation >0.7 (Fig. 2c and P < 10−7, test for association) between cell viability measures from AZ-DREAM and ALMANAC, maintained for individual combinations and cell lines NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 3 ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 where the number of data points was sufficient (Supplementary Fig. 4). While there were ten cell lines and four drugs found in both AZ-DREAM and O’Neil et al.4, no combination-cell experiment was shared between those two screens. O’Neill et al.4 data displayed lower dispersion of synergy scores (Supplementary Fig. 2c, d) and fewer instances of extreme synergy scores. The technical reproducibility within these screens, however, was comparable, with a similar correlation observed between replicated experiments (Spearman = 0.63 for O'Neil et al.,4 Spearman = 0.56 for AZ-DREAM). We derived a RECIST-like response measure from the AZDREAM in vitro data (see Methods) to enable comparison to in vivo response metrics for the eight overlapping combinations in patient-derived tumor xenograft (PDX) models published by Gao et al.8 (Supplementary Data 1 and Supplementary Fig. 5a). We compared the % PDX models with synergy in Gao et al.4,8 to the % cell lines with synergy in AZ-DREAM. A concordant trend was observed (Pearson r = 0.34, P = 0.42; Methods; Supplementary Fig. 5b), although too few combinations were shared between the datasets to conclude with statistical confidence. independent drug pairs. SC1 was further subdivided into two parts: SC1A allowed the use of all available data for model prediction, while SC1B limited data use to just mutation and copynumber variation (mimicking current clinical assay feasibility). A total of 969 participants of diverse geography and expertize registered for the Challenge (Supplementary Fig. 6a, b). Onehundred sixty teams submitted across any portion of the Challenge and 78 teams submitted for final assessment. Specifically, SC1A received final submissions from 76 teams, 62 for SC1B and 39 for SC2. As scoring metric we used the average weighted Pearson correlation between the continuous endpoints of predicted and known synergy values for SC1, and both the –log10(p) from a 3way analysis of variance (ANOVA) and balanced accuracy (BAC) for SC2 where predictions were binary (Methods). Across all teams, mean performance scores were r = 0.24 ± 0.01 and r = 0.23 ± 0.01 (weighted Pearson correlation ± standard error) for SC1A and SC1B, respectively, and –log10(p) = 12.6 (3-way ANOVA) for SC2. Despite omitting several input data types, teams performed only slightly worse for SC1B, Δprimary metric = 0.01 (t-test P = 0.90), compared to SC1A (Fig. 3a and Supplementary Fig. 6c, d). While teams employed many different methodological approaches to modeling drug synergy—including regression, decision trees, random forests, Gaussian processes, SVM, neural networks, text mining, mechanistic network-based, and others (Supplementary Fig. 7a)—algorithm class showed little relationship to performance (Supplementary Fig. 7b). The top winning team in all three sub-challenge was Yuanfang Guan (Y Guan) with primary metrics of 0.48, 0.45, and 74.89 in SC1A, SC1B, and SC2, respectively. Based on the primary metric in SC2, Y Guan performed considerably better (Methods; >5 Bayes Factor, based on bootstrapped metrics’ comparisons) than other Benchmarking of methods reveal high prediction accuracy. The Challenge was divided into two primary sub-challenges. In subchallenge 1 (SC1) participants were asked to predict continuous synergy scores for drug combinations for which training data on those same combinations were available. In sub-challenge 2 (SC2), participants were asked to predict binary synergy status on drug combinations for which no training data was provided, thereby requiring participants to infer synergy using transferable data/knowledge patterns identified from previously seen b a Replicates 15 Density Random 10 5 Yuanfang guan North Atlantic dream Mikhail zaslavskiy DMIS Team predictions SC1B 15 20 25 30 35 SC1A 0 −0.1 0.0 0.1 0.2 0.3 0.4 Average weighted pearson correlation c Random DMIS 40 Team predictions 0 0.50 0.55 0.60 0.65 Balanced accuracy SC2 0.70 20 40 60 3-way ANOVA 80 d Ensemble (5 models) North atlantic dream Standigm Yuanfang guan Balanced accuracy 80 0 0.5 Replicates 120 Density Team rankings Yuanfang guan North atlantic dream Standigm DMIS FINCHIPS 0.65 0.55 SML Random aggregate Individual 0.45 0 10 20 30 40 Ranked teams Fig. 3 Performance of teams in the AstraZeneca-DREAM challenge. a Participant performance in SC1A and SC1B— the distribution of performance of random predictions was used to estimate a lower limit, and the distribution of synergy correlations between biological replicates were used to estimate the upper limit. b Participant performance ranked in SC2 based on the primary metric, 3-way ANOVA. Distribution of bootstrap prediction performances for each team are shown by each boxplot with the dot showing their actual performance. c Participant performance plotted with upper and lower limits for SC2 based on the tie-break metric. d Ensemble models compared to the performance of individual models ranked from best to poorest performing in SC2. SML is an ensemble of the best performing models based on estimation of their BAC. Random Aggregation is an ensemble combining a random combination of models. Standard error of mean represented by error bars are estimated from ten random splits of the data 4 NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 and Y Guan) was to filter molecular features, leaving only those related to known cancer drivers for subsequent modeling (Supplementary Methods). These teams also consolidated pharmacological and/or functional pathway information associated with the molecular drug target, enabling one drug’s model to learn from data generated for another drug with the same target (Y Guan16 and NAD16–18). We took two approaches to analyze each feature type’s importance, particularly whether incorporating molecular features and chemical/biological knowledge can increase prediction accuracy. In the first approach, we generated a baseline model (following Team NAD’s method) utilizing only cell line and drug labels as input features as per SC1B. We then assessed changes in the primary metric after the substitution or addition of feature types (Fig. 4a and Supplementary Methods). In the second approach, we started with the DMIS model obtained from SC1B, and then iteratively removed single feature types and pairs of features to assess changes in prediction accuracy (Fig. 4b and Supplementary Methods). Surprisingly, high primary metrics were observed for the NAD baseline model where the only input features were drug and cell line label (Fig. 4a, 0.32). Drug target was the only feature to improve performance of the NAD baseline model when swapped with drug label (Fig. 4a, t-test P = 0.012). Furthermore, removing both drug label and target resulted in the highest performance drop for the DMIS model (Fig. 4b, −0.17). This result highlights the importance of the global cell-line state in predicting drug synergy, and how drug target information shared across drugs can facilitate transfer learning across separate models. Mutational and copy-number variation (CNV) data can similarly offer a barcode of cell identity to encode cell line label. However, where mutation data improved performance when replacing cell line labels, replacement with CNV decreased performance significantly (Fig. 4a, t-test P = 8.8e-6). Importantly, in all cases additional feature data increased performance when added to the NAD baseline model (Fig. 4a, t-test P = 0.009, 0.009, 0.002, 0.008, 0.021 adding drug target, KEGG pathway, Gene Ontology, teams (Fig. 3b). All performance statistics and team rankings are available at the Challenge website (synapse.org/DrugCombinationChallenge[https://www.synapse.org/#!Synapse:syn4231880/ wiki/235649]). To benchmark the performance of teams in the final rounds of SC1A/B and SC2, we established lower and upper bounds of performance. We defined the lower bound as the null model, i.e., random permutation of the synergy data across each cell line (see ‘Code availability’’ section). We would not expect algorithms to predict better than the reproducibility observed between replicate experiments. We therefore identified cases for which replicate measurements (same drug/combination tested independently in the same cell line) were available and assessed the primary metric achieved when using one measure to predict the other. We set this metric value as our upper-bound. We observed that 83%, 85%, and 94% of submitted models performed better than random (Methods; 5% false discovery rate, FDR) for SC1A, SC1B, and SC2, respectively. Team performances varied widely, but remarkably the top 15 models (20%) submitted to SC1A all reached a performance level comparable to experimental replicates (primary metric = 0.43; Fig. 3a), as did the top 13 models (21%) in SC1B. Proportionally fewer teams performed at the level of replicate experiments in SC2 based on the BAC, with North Atlantic Dream (NAD) achieving the best performance (BAC = 0.688; Fig. 3c). Given the less robust performance of SC2, we assessed whether an ensemble method—based on an aggregation of all submitted models—could yield a better overall model, a phenomenon called “wisdom of the crowd”9,14. By applying a Spectral Meta-Learner (SML)15 as our ensembl approach, we achieved a modest improvement in performance (BAC = 0.693) over the best performing individual team (BAC = 0.688), as well as an ensemble of randomly selected models (BAC = 0.63, (Fig. 3d). Leveraging biological relationships improves predictions. A common strategy among top-performing teams (DMIS, NAD, a b 0.45 Replaced Added *** ** ** ** ** * *** 0.35 0.08 0.03 0.01 0.11 0.03 RTK signaling 0.01 0.01 0.02 0.12 0.03 Telomere maintenance 0.01 0.02 0.07 0.03 Drug 0.02 0.01 0.02 0.02 0.02 0.02 0.08 0.17 Max conc. 0.30 0.08 0.03 0.02 Mutation 0.08 0.11 0.12 0.07 0.08 0.08 0.07 0.08 Target Mutation Max conc. 0.17 0.03 0.08 0.03 Telomere maintenance Ensemble +CNV +Mutation +Network +GO +KEGG +Target CNV Mutation Network GO KEGG Target Baseline DNA damage response PI3K-AKT signaling RTK signaling Target 0.03 0.03 0.03 0.25 Drug Averaged weighted pearson correlation * 0.40 DNA damage response PI3K-AKT signaling Fig. 4 Feature impact. Drug target annotation is key in top-performing algorithms, as is the meta information about variants including their functional impact and tumor driver gene status. a Cross validation-based distributions of NAD primary metric of SC1B when replacing or adding drug/cell line label with respective features. NAD baseline model (red) used cell line labels and drug labels only as feature inputs. In the other models different drug specific (drug targets, drug target KEGG pathway memberships, drug target-associated Gene Ontology terms or direct interactions between drug targets in a signaling network) or cell line specific (mutations or CNVs of selected, cancer related genes) features (green and blue, respectively) were added either in place of or in addition to the baseline model features. Ensemble model (cyan) is the averaged prediction of the different models. Single asterisks refers to t-test P < 0.05, double asterisks for P < 0.01, and triple asterisks for P < 0.001 compared to baseline model. b Heatmap of decrease in performance (average weighted Pearson correlation) of SC1B for DMIS support vector regression method when a particular feature type is removed (diagonal) or two feature types are removed at once (off diagonal) NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 5 ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 signaling network, and mutation features, respectively). Ensemble of different feature sets improved prediction most when collectively increasing coverage of biological (pathway) complexity (Fig. 4a, t-test P = 1.2e-6). Inspecting consistently poorly predicted drug combinations. While a global performance metric applied to all cell-lines and drug combinations provides a broad assessment of model prediction accuracy, we hypothesized that some models may be optimized for certain subclasses of combinations and/or tumor types. We assessed the Pearson correlation between predicted and observed synergy scores for each combination in SC1A/B, and clustered teams by correlation of performance across combinations. Of the 118 combinations that had observed synergy scores >20 in more than one cell line, we identified 22 combinations predicted poorly by all participants (Fig. 5a, Methods), and over 50 combinations predicted well across all teams. Combinations tested across a higher diversity of tumor types tended to show lower overall performance (Supplementary Fig. 8a; t-test P = 0.04), indicating that a pan-cancer prediction presents a more difficult prediction task. Combinations tested across more tumor types were also tested across greater numbers of experiments (Supplementary Fig. 8b; Spearman = 0.56, a P = 2.3e–15), but no significant difference was observed between performance and number of experiments within a cancer type specific setting (Supplementary Fig. 8c, d). On average the quality assessment scores were significantly better (t-test P = 0.018) for the pharmacology experiments in the training set of well predicted compared to poorly predicted combinations (Supplementary Fig. 8e). Comparable trends were seen between the quality of synergy and predictive performance in the training and test sets (Supplementary Fig. 8f; r = 0.52 vs. 0.43). The distribution of synergy scores were similar between poorly and well predicted combinations (Supplementary Fig. 8g) as were the proportion of synergistic cases (37% for poorly predicted vs. 39% for well predicted). Well predicted cases were enriched for combinations inhibiting both the PI3K/AKT and MAPK pathways (Fig. 5b, average Pearson r = 0.37 vs. 0.25; t-test P = 0.008), or apoptosis pathway combined with either metabolism, cell cycle, or receptor tyrosine kinase pathways. The drugs targeting these pathways were prevalent in our dataset, but these specific combinations of those drugs were not (Supplementary Fig. 9a). Assessment of the interactions between drug targets and neighboring proteins from OmniPath, a comprehensive compendium of literature-based pathway resources19, revealed no differences in the somatic alteration frequency for targets or their first neighbors between b 73 teams 22 poorly predicted –0.5 0.5 Pearson correlation TargetA Cell cycle RTK Cell cycle Apoptosis Apoptosis Hormonal Hormonal MAPK MAPK AKT/ AKT/ PI3K PI3K DDR Chemo STK Chemo STK DDR Metabolism Metabolism d TargetB 0.6 Proportion of combinations c 50 well predicted combinations KNN Regression trees Bayesian statistics Gaussian process Network based predictors Penalized regression SVM Artificial neural networks Boosting Random forest Decision tree Linear regression Kernel mehtods Ensembles Poor predictions Good predictions RTK Neighbor Well predicted Poorly predicted 0.4 2 X = 0.44 0.2 0.0 Predictions (P = 0.01) Predictions (P = 0.32) Predictions (P = 0.55) 0.8 Average synergy e 0.4 or Po d 0.0 G oo or d 0.0 None 1 2 >2 # of edges in the shortest path between targets Inhibit parallel pathways Proportion of path 0.4 Po or d 0.0 0.8 G oo 0.3 Po or G oo d 0.0 0.6 G oo 0.3 Inhibit same pathway Proportion of path Inhibit target + feedback Proportion of path 0.6 Po Proportion of path Inhibit downstream target Predictions (P = 0.03) 80 40 0 −40 P = 0.031 None 1 2 >2 # of edges in the shortested path between targets Fig. 5 Features of poorly and well predicted combinations. a Heatmap of Pearson correlation between observed and predicted synergy scores for 118 combinations across 73 teams participating in SC1A/B. Algorithms used by each team is marked in the matrix below. b Combinations of pathways targeted. Size of node is proportional to number of drugs targeting a specific pathway in the entire dataset and width of edges is proportional to the number of drug combinations within the poorly or well predicted combination subset. Red edges highlight target pathway combinations unique to either the well predicted or poorly predicted combinations. c Types of interactions between the nearest neighboring gene and the two drug targets of poorly and well predicted combinations. Boxplots show the difference in the proportion of interactions of each type for poorly and well predicted combinations (t-test). d Proportion of poorly and well predicted combinations for different network distances (minimum number of interactions in the OmniPath shortest path) between the two targets of a drug combination, difference significance estimated with chi-squared test. e Difference in average synergy for combinations categorized by the network distance between targets are tested with t-test 6 NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 Biomarkers of drug combination synergies. A limitation of many machine learning algorithms is the lack of feature interpretability and experimentally testable logic-based rules. We took two approaches to identify biomarkers that may be predictive of drug synergies: a direct survey of participants through which predictive features were nominated for each drug pair (Supplementary Data 2); and retrospective work focusing on results from two of the best performing teams, NAD and DMIS, to deconvolute features most impactful to model predictions (Supplementary Fig. 10 and Supplementary Data 3). The survey-submitted biomarker results varied in detail and depth (Supplementary Data 2), but common genetic markers were apparent across good predictions in SC1B, including EGFR, ERBB2, PIK3CA, PTEN, TP53, or RB1. In the survey, synergy was commonly assigned to drug pairs targeting directly down- or upstream of a mutated, amplified, overexpressed or deleted cancer gene. We hypothesized that drug synergy may result when one drug overcomes a resistance mechanism for the other. Focusing on mutations in cancer genes (as defined by Iorio et al.12) we identified all mutations associated with resistance to monotherapy in our data (Supplementary Methods and Methods) selected at increasingly stringent P-value (wilcoxon rank sum test) thresholds (Supplementary Methods and Methods). For each threshold, we then assessed the likelihood of synergy seen from combinations paired to these monotherapies in the presence vs. absence of the respective mutation. We observed an increase in the proportion of synergistic drug combinations with each increase in threshold stringency (Fig. 6a, Pearson r = −0.90, P = 4.09e-38). We observed the same trend in patient-derived xenograft (PDX) models (Fig. 6b, Pearson r = −0.95, P = 2.2e49). This observation supports the notion that drug sensitivity may be restored with drug combinations targeting a resistance driver. We also explored models of best performing teams and their chosen features, focusing on biomarker associations aligned to combinations for which the respective team had achieved a robust prediction accuracy (Pearson r > 0.5), with particular interest in the genetic biomarkers revealed through SC1B. Multiple criteria for quality, independence and reproducibility (Methods)4,8 were applied yielding 13 feature-to-combination associations (Fig. 7a and Supplementary Data 3), seven associated with synergy and six with non-synergy. To assess whether these associations could be independently validated as synergistic biomarkers, we explored nine overlapping and 21 non-overlapping (independent) cell lines in O’Neil et al.4 (Fig. 7b) that were treated with similar drug combinations, i.e., same putative drug targets. Concordance of association was observed in the nine overlapping cell lines (Fig. 7c; six out of seven associations, ~86%) and in the 21 independent cell lines (Fig. 7d; eight out of eleven associations, ~72%). Fraction of synergistic combinations within selected samples a Incr 0.36 eas of s ed cha n yne rgy ce Cell lines 0.32 Select more significant resistance mono-therapy markers 0.28 0.2 0.4 0.6 0.8 1.0 Fraction of selected samples b Fraction of synergistic combinations within selected samples the poorly and well predicted combinations (Supplementary Fig. 9b, c). We did observe a significant enrichment of well predicted combinations where both drugs’ respective targets were downstream of a common neighboring protein (Fig. 5c, t-test P = 0.01), and conversely, we observed an enrichment of poorly predicted combinations where targets were both up-stream (Fig. 5c, t-test P = 0.03). There was no significant difference (Chi-sqr P = 0.44) in OmniPath protein network distance between drug targets for well and poorly predicted combinations (Fig. 5d), nor any correlation between either network distance and average/median synergy scores (Fig. 5e) or the number of cases with synergy >20. Combinations where targets were found to not be connected in a protein network had significantly lower average synergy (t-test P = 0.031) and lower max synergy (t-test P = 0.0021). 0.40 PDX models Inc rea s of s ed ch yne anc e rgy 0.30 0.20 Select more significant resistance mono-therapy markers 0.2 0.4 0.6 0.8 1.0 Fraction of selected samples Fig. 6 Drug synergy and monotherapy resistance biomarker relationship. a Cell lines and b PDX models show increased frequency of synergistic drug combinations if they contain biomarkers with stronger association to monotherapy resistance (Methods; Supplementary Methods). The fraction of combination experiments is selected by order of most significant linked monotherapy resistance biomarker associations. The solid and dashed line are the LOcal regrESSion (LOESS) curve fit and its standard error, respectively Among the prioritized feature-to-combination associations were several genetic variants associated with synergistic responses to the combination of receptor tyrosine kinase (RTK) inhibitors with inhibitors of the downstream PI3K/AKT pathway. Amplifications or activating mutations in EGFR or ERBB2 consistently predicted synergy from inhibition of the RTK + PI3K/AKT pathways across multiple independent drugs and datasets (Fig. 7a). Less direct relationships were also observed, including combined AKT inhibition with either IGFR inhibition in the ERBB2 mutant setting or FGFR inhibition in the EGFR mutant setting (Supplementary Data 3). Despite kinase domain homology it is unlikely these observations are explained by off-target effects since EGFR, ERBB2, and FGFR mutations were only predictive of respective monotherapy responses (Supplementary Fig. 11). Combinations inhibiting multiple points within the PI3K/AKT pathway also showed synergy in the presence of up-stream activation from mutations in PIK3CA or deleterious events in PTEN (Fig. 7a, e). Inhibition of the metalloproteinase ADAM17, known to influence RTK activity20, also showed synergistic responses in a common subset of cell lines when combined with inhibitors of PIK3C-pan or AKT1/2 (Fig. 7a and Supplementary Data 3), with a notable exception of PIK3CB/D selective inhibitors, which show antagonism unique to PIK3CA mutant cell lines (Fig. 7e, f). Amplification and activating mutations in Androgen Receptor (AR) were also found to be associated with antagonistic effects when targeting AKT in combination with MAP2K or IGFR inhibitors (Fig. 7a). Translatability of synergy and biomarker predictions. We assessed the performance of top-performing AstraZenecaDREAM models on the independent screening datasets by O’Neil et al.4 and ALMANAC13. Since no combination-cell experiments NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 7 ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 a 10 overlapping 21 independent b Combination-therapy markers O’Neil et al. 2016 Effect Biomarkers c ERBB2 *** ERBB2 ** O’Neil et al. 2016 effect size Non-syn. Syn. EGFR *** EGFR ** PIK3CA ADAM17 & PIK3CA *** PIK3CB, PIK3CD ERBB2 ** AKT & ALK, IGFR AR AR * * AKT, SGK & MAP2K AR * AKT & PIK3C ADAM17 & MAP2K AKT, SGK & PIK3C 10 0 −10 Cisplatin & PARP1 (CDKN2A) −20 AKT & EGFR (EP300 ) d PIK3CA PIK3CA AKT, SGK & FGFR ERBB2 −30 −20 −10 0 10 20 30 –100 –50 0 50 100 –40 Non-syn. Syn. 0 40 Non-syn. Syn. Synergy score Wild type 21 independent cell lines AKT & PIK3C (PTEN ) 40 AKT & PIK3C (PIK3CA) 20 AKT & EGFR (EP300 ) 0 AKT & EGFR (ERBB2) AKT & EGFR (EGFR ) ERBB & PIK3CA (EGFR ) MAP2K & PIK3C (TP53) −20 AKT, SGK & MAP2K (AR ) Effect size Independent test set Drug A & drug B (biomarker) 60 −40 Mutant >35% FDR 35% FDR 20% FDR 5% FDR * ERBB2 ADAM17 & AKT MAP2K & PIK3C (TP53) AKT, SGK & MAP2K (AR) Syn. Non-syn. AstraZeneca-DREAM dataset effect size PIK3CA * PIK3CA PTEN AKT & PIK3C (PIK3CA) 20 −40 Syn. AKT & ERBB O’Neil et al. 2016 effect size AKT & EGFR 10 overlapping cell lines Non-syn. Combinations AstraZeneca-DREAM dataset 75 Train set −20 0 20 40 Non-syn. 60 Syn. AstraZeneca-DREAM dataset effect size e f 80 NRG1 ErbB1 ErbB4 PIK3CA mut. PIK3CA & PTEN mut. PTEN mut. Wild type Synergy score of ADAM17 & PIK3C 60 PIK3CAP539R 40 20 Cytopla PTENI253N PIK3CAD350N PIK3CA ErbB3 ErbB3 sm MAPK PI3K ADAM17 PTENF 90fs*9 H1047R PDK1 PTENN323fs*2 PIK3CAE542K PTENdel ERK AKT1 0 PTENloss PTEND92H −20 Anti-apoptosis Nucleus −20 −10 Translation PTENV275fs*1 0 10 20 Synergy score of ADAM17 & PIK3CB, PIK3CD Expression 30 Direct interactions Indirect interactions Fig. 7 Post-hoc analysis of putative synergy biomarkers. a Synergy markers suggested by DMIS and NAD, when focusing on top weighted features from predictive models filtered for biological relatedness to drug targets, ANOVA with FDR of triple asterisks refers to 5%, double asterisks refers to 20% and single asterisks to 35%. b Venn-diagram showing independent and overlapping cell lines between AZ-DREAM and O’Neil et al.4. Independent dataset reproducibility of biomarker predictions in c the overlapping and d O’Neil et al.4 exclusive cell lines. The effect size is the mean difference in synergy scores of mutant vs. wild-type cell lines. e Comparison of ADAM17 combined with PIK3CB/D against ADAM17 in combination with pan-PIK3C inhibitor. f Network cartoon of PI3K signaling and role of ADAM17 directly overlapped AZ-DREAM and O’Neil et al.4, we collapsed drugs by shared targets to expand the overlap. We observed that SC1A models from NAD and DMIS outperformed random models (Fig. 8a, mean primary metric = 0.07, top 1% of random models) for cell lines and drug target combinations nonoverlapping between O’Neill et al. and AZ-DREAM data (Supplementary Data 1). Interestingly, no substantial performance increase was observed when independent model predictions were 8 made for the ten cell lines in common between the two datasets, nor the 30 combinations with similar chemical/target properties (Supplementary Table 2 and Fig. 8b–d). As in the main Challenge, combining these two or more models in an ensemble led to an improved prediction performance (Fig. 8a–d). Considering the limited overlap and correlation of synergies between AZ-DREAM and ALMANAC datasets, high performance was not expected when predicting ALMANAC synergy NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 50 All experiments Random 20 30 10 0 0 −0.1 0.0 0.1 0.2 0.3 0.4 Averaged weighted pearson correlation Similar drugs Both drugs 0.40 *, # Averaged weighted pearson correlation d Similar combinations 50 Random Replicates 30 20 Replicates 40 Density Density 40 One drug Random −0.1 0.0 0.1 0.2 0.3 0.4 50 None 20 10 c Targeted therapy: Replicates 40 Density 30 e Same cells 50 Replicates 40 Density b 30 20 10 10 0 0 Random Averaged weighted Pearson correlation a 0.35 0.30 0.25 0.20 0.15 0.10 0.05 0.00 −0.1 0.0 0.1 0.2 0.3 0.4 Averaged weighted pearson correlation −0.1 0.0 0.1 0.2 0.3 0.4 Averaged weighted pearson correlation Mikhail Zaslavskiy NAD DMIS DMIS new model m ndo Ra odel m D NA line e s a b del mo D NA el d mo Ensemble Fig. 8 Translatability of AstraZeneca-DREAM models to the independent screens. Performance of SC1A models for predicting synergy scores in the O'Neil et al.4 dataset by the best performing teams are plotted along with distributions of predictions from the random model and replicate experiments. Performance of predictions are shown for a all experiments in the O’Neil et al.4 dataset, and three subsets of the dataset; b experiments that tested same cell lines as AZ-DREAM, c tested similar drugs as in AZ-DREAM (one drug in the combination with the same target), and d tested similar combinations as in AZ-DREAM (same targets for both drugs in the combination). e Prediction performance on the ALMANAC13 dataset is shown for a random, NAD baseline (using only cell line and drug identities as features) and full NAD model for no targeted agents (None, i.e., two chemotherapeutic drugs), one targeted agent plus chemo (One drug), and combinations of two targeted agents (Both drugs)(mean +/− 95% CI). ANOVA P-values: *P = 1.322e-31 for different performance between baseline and full model; #: P = 5.584e-5 for association between model performance and number of targeted drugs in the combinations scores with models trained on AZ-DREAM data points alone, as was observed for the NAD model. We trained two NAD models on 50% of the ALMANAC data: first a baseline model to show maximum performance achievable when using only cell and drug label features as input; and a second allowing use of the full feature set as input. The full model consistently predicted significantly better than baseline in the remaining 50% over ten randomized iterations, giving confidence in the transferability of the method designed for AZ-DREAM. Best performance was observed for targeted combinations (r = 0.369 vs. 0.287 for full NAD and baseline NAD model, ANOVA P = 1.322e-31 for model type and P = 5.5e-05 for model type and targeted therapy association, Fig. 8e). Exploring AZ-DREAM biomarker associations prioritized as described in earlier sections, we assessed statistical association for drug combinations with consistent targets in the O’Neil et al.4 dataset. In the ten cell lines overlapping the AZ-DREAM and O’Neil et al.4 datasets, seven of the prioritized biomarkerdrug combinations were present, of which six (86%) showed reproducible directionality (FDR < 35%, Fig. 7c). In the 21 O’Neil et al.4 cell lines not used within AZ-DREAM training, 11 of the prioritized biomarker-drug combinations were present, of which 8 (72%) showed reproducible directionality (Fig. 7d). Discussion The objective of this AstraZeneca-DREAM Challenge was to drive the development of innovative computational approaches to predict novel drug combinations and to comprehensively benchmark these approaches. To enable this we made one of the largest in vitro drug combinatorial screens to date available to the scientific community. We cover largely non-overlapping experiments to existing datasets and, in particular, offer extensive data for targeted therapies complimenting the non-targeted chemotherapeutic agents covered in the NCI-ALMANAC. Despite little overlap we demonstrated an encouraging reproducibility of data and predictions between screens, particularly when considering the confounding differences in experimental designs and assay formats21. Furthermore, we showed that some trends represented in these data can be reproduced in vivo, and that clinically efficacious combination pairs can be identified. Our double-blinded benchmark of 78 methods provides an unbiased comprehensive evaluation of the state-of-art of drug synergy prediction. Collectively this Challenge manuscript equips the scientific community with data and a methodological baseline for algorithm development, alongside a suite of computational methods to direct new experiments towards likely synergistic drug combinations. The results of the AstraZeneca-Sanger Drug Combination Prediction DREAM Challenge have shed important light on the best practices and limitations in predicting drug synergy. By evaluating predictions from a large number of teams, we were able to discern important strategies for predicting drug synergy from molecular and chemical traits. As with most DREAM Challenges, we observed that the machine learning method itself has little impact on overall performance. Aggressive pre-filtering that incorporates clean sparse network data to consider feature relevance to drug targets and cancer was successfully used by top NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 9 ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 performers to limit model complexity and improve model generalizability. Despite the complexity of the problem, many teams reached the upper-bound of performance levels based on variability in experimental replicates. This was further confirmed when top-performing models were applied to an independent dataset, demonstrating robustness to assay variability, and context heterogeneity. A comprehensive assessment of the predictive value of monotherapy was not completed in the Challenge format, in part due to initial miss-annotation of data. However, post-hoc analyses suggested it offered no significant improvement to wellperforming models (Supplementary Fig. 12). Despite minimal predictivity from monotherapy itself as a feature, biomarkers associated with monotherapy resistance were observed to have predictive value for respective combinations. Looking forward, additional attention is also required for the one-fifth of combinations poorly predicted by all Challenge teams. The rationale differentiating these combinations is non-obvious but our data suggests, in part, some relationship to the complexity of network connectivity between drug targets and proximal biomarkers (Fig. 5c), perhaps a bias introduced by network-led dimension reduction techniques employed by well-performing models. Furthermore higher synergy scores were observed—in some combinations—when both drugs target downstream of a commonly interacting protein22. Collectively, these observations advocate for a more biologically rationalized approach to biomarker discovery, accounting for directionality and exclusivity of signaling and functional relationships between biomarkers and targets. A notable absence from the Challenge was the use of mathematical, reaction- or logic-based mechanistic pathway modeling approaches23–27, likely due to the higher time and data input needed for model creation. The dynamic nature of mechanistic models may offer an advantage by enabling consideration of the heterogeneity that exists across even apparently ‘clonal’’ cell line populations28. The increasing availability of published prederived mechanistic models for many cancer relevant pathways may soon make such an approach more viable. Given the strong benefit seen from inclusion of prior-knowledge, and as text-based artificial intelligence technology matures, computational approaches, such as natural language processing (NLP) to harness knowledge from world literature may also become of significant benefit. Alternatively, more generic signatures of dynamic (e.g., transcriptional) output may first be used to identify a mechanistic rationale28–31 to which causative genetic or epigenetic events can then be inferred and aligned as predictive features32,33. A surprising result of our Challenge, however, suggested only modest improvement to prediction from inclusion of all data in SC1A compared to only genetics in SC1B. To maximize potential for translation it is essential that modeling approaches reveal testable biological insight, particularly considering that this and prior Challenges show no predictive advantage to black box algorithms. As we discovered, however, it can be difficult to incentivize knowledge retrieval within a competition format that focuses on objective scoring of performance. Despite these limitations, we were able to extract important insights to biomarkers for certain drug combinations. Given the dominance of RTK and PI3K/AKT pathway targeting agents in the Challenge data, it was not surprising that these revealed some of our strongest combination-feature relationships. In multiple cases this aligned to a two-hit hypothesis targeting the activating driver with a downstream pathway component. These included synergies between EGFR and AKT inhibitors in the presence of activating EGFR mutations34, or AKT1/2 with pan-PI3K inhibitors in the presence of pathway activating mutations 10 in PIK3CA or PTEN. In some cases the biomarker rationale for AKT inhibitor synergy with RTK or MAPK inhibition was less direct but indicative of crosstalk and feedback signaling previously reported35. Interestingly antagonism was observed in cell lines harboring activating mutations of AR36–39. Feedback signaling resulting from AKT inhibition has been seen to drive AR activity, which in turn can lead to the activation of the MAPK cascade39,40, attenuating respectively targeting drug activity. The synergy observed between ADAM17 and PI3K/AKT pathway inhibitors may work through independent inhibition of multiple cancer hallmarks, or via a more direct mechanism whereby inhibition of ADAM17 driven proteolysis and shedding of RTKs20 stabilizes and increases signaling through PI3K/ AKT41,42. Notably ADAM17 predominantly influences RTK’s other than EGFR/ERBB220, and no benefit is seen in cells with mutations in these genes. ADAM17 inhibition, however, showed antagonism unique to combined PIK3CB/D selective inhibitors within the PIK3CA mutant setting. Reduced synergy may result from a lessened dependency on PI3K paralogues in the presence of constitutively activated PIK3CA, or reduced benefit from ADAM17 loss in the extreme luminal/epithelial physiology of PIK3CA mutants. The apparent antagonism, however, suggests feedback following PIK3CB/D inhibition enhances mutant PIK3CA expression/activity. Indeed PIK3CB inhibition has been shown to result in elevated expression and activity of PIK3CA43, and may also relieve the inhibitory effects of substrate competition or dimerization between PIK3CA and PIK3CB/D. Many drug combinations effective in the clinic to date involve mechanistically distinct agents, often chemotherapies combined with an additional targeted therapy, for which benefit may arise from the independent effects of the drugs on different subpopulations44 rather than synergy. More recently, an increasing number of combinations include multiple targeted therapies5. Hence, identifying both molecularly synergistic and complementary drugs, and how these affect inter- and intra-patient heterogeneity remains an essential area of future research. Future Challenges should further address the question of how to optimize translation of preclinical results into the clinic45. Where this Challenge addressed prediction of synergy for combinations of known drugs, an ability to predict truly novel beneficial target combinations should also be explored. Furthermore, the space of therapeutic combinations should be extended to include >2 drugs, and covering targets in independent cell types, such as subclonal tumor cell populations or cells of the tumor microenvironment and immune system3. These approaches can be complemented by adaptive and sequential strategies reactive to monitoring of the patient tumor and physiology. Success in these areas will be dependent on the availability and access to large-scale data needed for model development and validation. Public-private partnerships—as exemplified by this Challenge and AstraZeneca’s generous sharing of data with the research community—will be critical to future efforts. Methods Drug combination screening. All cell lines were authenticated at AstraZeneca cell banking using DNA fingerprinting short-tandem repeat assays and each bank is confirmed to be free from mycoplasma. Cells ordered from the global cell bank are cultured for up to 20 passages. Cell suspensions are counted using a haemocytometer and cells are re-suspended in full growth medium containing Pen/Strep to a final density for different cell line densities and for different seeding densities into 384-well cell culture plate. A volume of cells as determined by cell count and dependent on cell type was added to each well of a Greiner 384-well plate using a Multidrop Combi liquid handler and then incubated at 37 °C and 5% CO2 overnight in a rotating incubator. After seeding, plates were shaken to distribute the cells more evenly at the bottom of the wells and left to stand on the bench for 1 h to allow even settling of cells. NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 Drug combinations were screened with four combinations per 384-well plate in a 6-by-6 range of concentration format. The first row and first column in the 6-by6 matrix are monotherapies of each drug in the combination, while the top left corner is the untreated control. Drug combinations therefore were tested in a 5-by5 layout with comprehensively rescreening the monotherapy and control for each experiment to minimize batch effects. Drug concentrations ran from the highest dose to the lowest dose. All plates were dosed with drugs solubilized in DMSO or PBS, or DMSO alone to provide comparable treatment and max control wells. After 5 days of incubation 5 µl of 2 µM Sytox Green working solution was added to each well of the 384-well plates (0.133 µM final concentration) and the plates incubated for 1 h at room temperature. After incubation plates were read by the Acumen laser scanner to detect the number of Sytox Green stained cells. The total fluorescent intensity across the well was then read and the number of dead cells calculated by dividing this total fluorescence by the fluorescence of a single cell. The plates were re-read on the Acumen to give a total cell count. A live cell count was then determined by subtracting the dead cell count from the total cell count. Quantifying combination synergy and antagonism. Synergy and antagonism were quantified in an automated way using freely available Combenefit software (v1.31)11. The approach implemented in Combenefit is based on quantifying synergy distribution by comparing a drugs combination experimental doseresponse surface to a modeled reference based on individual drugs dose-response curves. Briefly, for each 6-by-6 matrix, monotherapy dose-responses were extracted and modeled as a sigmoidal curve via the Hill equation46. A reference doseresponse surface is then generated by Combenefit based on the Loewe model of additive combinations and the single drug dose-response curves. The experimental combination dose–response surface is then compared by the software to the modelgenerated one, resulting in a synergy distribution in concentration space. This synergy distribution is finally further summarized by integrating the synergy distribution in logarithmic concentration space. The procedure resulted in a single score (the result of this integration) for each combination. In vivo response class definitions. Response data for 62 treatments across ~1000 PDX models were derived from Gao et al.8 Putative drug targets from the AZDREAM and Gao et al.4,8 dataset were utilized to identify overlap. As synergy scores were not available for the Gao et al.4,8 dataset, ‘Best Response’’ (complete response-CR, partial response-PR, stable disease-SD, progressive disease-PD) for each combination-PDX pair were extracted and compared with monotherapy ‘Best Response’’ of each drug in the combination on the same PDX model. This was represented numerically where CR = 4, PR = 3, SD = 2, and PD = 1. Synergy was assigned to a change of +2 or more, and Antagonism to a change of −2 or less. A change of +1, 0, or −1 was assigned Additive, considering an element of experimental variability. Cases where best response has been observed as a range over time (PR→→PD), the earliest response was considered as we hypothesize this to reflect in vitro response in a more realistic sense for comparison. The percent tumor volume change class definitions are as following: 1. 2. 3. 4. 5. Synergistic efficacy: Combination treatment leads to better tumor regression than either monotherapy. Synergistic non-efficacy: Combination response is better than either monotherapy but does not result in tumor regression. Additivity: Combination response same as the better of either monotherapy responses. Non-synergistic efficacy: Combination response weaker than the better of the monotherapy responses but results in tumor regression. Antagonism: Combination response weaker than both monotherapies. In vitro response class definitions. Response scores defined by the Loewe synergy model were considered in ordered to define in vitro response classes. Synergism was defined as Loewe scores ≥20, Antagonism ≤ −20, and rest are classed as Additive. Molecular characterization. The 85 cell lines were molecularly characterized, including: Mutations from whole exome sequencing with Illumina HiSeq 2000 Agilent SureSelect (EGAS00001000978) 2. Copy-number variants from Affymetrix SNP6.0 microarrays (EGAS00001000978) 3. Gene expression from Affymetrix Human Genome U219 array plates (EMTAB-3610) 4. DNA methylation from Infinium HumanMethylation450 v1.2 BeadChip (GSE68379) Mutations were called with CAVEMAN [https://github.com/cancerit/ CaVEMan/]47 and PINDEL [http://gmt.genome.wustl.edu/packages/pindel/]48 as reported in ref. 12. Variants were provided without further filtering, including putative passenger mutations, germline variants, and potential cell line artefacts, which are in total 75,281 mutations in 85 cell lines. Copy-number variants (CNVs) are called with the PICNIC [http://www.sanger. ac.uk/resources/software/picnic/]49 algorithm using the human genome build 38 as the reference. CNVs might be wild type, deletion, or amplification of certain segments in a chromosome. One or multiple genes can fall within such segments. We reported copy number for the major and minor allele on gene and segment level. Gene expression was processed as described in ref. 12, including Robust Multiarray Average (RMA) normalization with the R-package ‘affy’’50. Gene expression for 83 cell lines across 17,419 genes (HGNC labels) was reported; no expression was available for MDA-MB-175-VII and NCI-H1437. DNA methylation was reported for 82 cell lines the beta and M values51 for 287,450 probes; no methylation was available for the cell lines SW620, KMS-11, and MDA-MB-175-VII. In an additional processing step, CpG sites were compressed to CpG island with the definition from UCSC genome browser52, resulting in a total of 26,313 CpG island based on either M or beta values. Drug properties. The identity of all drugs was anonymized, but for all agents the putative targets are revealed. The gene names of the protein targets are listed with ‘*’’ denoting any character if the target is a protein family. Furthermore, for 58 drugs the Molecular weight, H-bond acceptors, H-bond donors, calculated octanolwater partition coefficient, Lipinski’s rule of 5, and their SMILES (Simplified Molecular Input Line Entry Specification) are provided. Drugs were grouped into pathways and biological processes manually according to their protein targets (Supplementary Data 1). Challenge organization. The Challenge consisted of two sub-challenges, each with multiple rounds: a leaderboard, validation, bonus, and collaborative round. SC1 had four leaderboard rounds that lasted 8, 6, 5, and 5 weeks, while SC2 had three leaderboard rounds that lasted 12, 7, and 5 weeks. Participants were given a leaderboard dataset to build a model and generate three prediction files per leaderboard round. Scores were returned to participants so that they can improve their model throughout these rounds for their one submission to the final round, which was scored against a held-out dataset. The final round lasted for 2 weeks, which was then followed by a 9 week bonus round and 10 week collaborative round. Challenge pharmacology data splits. In SC1, participants were asked to predict drug synergy of 167 combinations in the panel of 85 cell lines. The synergy data of each drug combination was partitioned into three sets: a training dataset (3/6–50%), a leaderboard set (1/6–16.7%), and validation set (2/6–33%) of treated cell lines. SC2 leveraged data for remaining 740 drug combinations not overlapping with those used in SC1, although data for some of the same drugs (in combination with different drugs), homologous drugs (i.e., same target, but different chemical structure), and cell lines were included. A leaderboard set (370 combinations) and a final validation set (370 combinations) were randomly split, which are mutually exclusive from each other, as well as from SC1. Primary scoring metric of Sub-Challenge 1. With synergy scores roughly normally distributed and and outliers truncated to −100 and 100 (Supplementary Fig. 2), Pearson’s correlation was employed as the base measure of prediction accuracy within each drug combination. The primary metric was then the average weighted Pearson correlation (ρw) of the predicted vs. observed synergy scores across each individual pffiffiffiffiffiffiffiffiffiffiffiffi drug combination, i. The weight for a given drug combination i was ni  1where ni is the number of cell lines treated with the drug combination. This resulted in the following primary metric for SC1A&B, PN pffiffiffiffiffiffiffiffiffiffiffiffi n i  1 ρi ð1Þ ρw ¼ Pi¼1 N pffiffiffiffiffiffiffiffiffiffiffiffi ; ni  1 i¼1 where N` = 167 were the tested drug combinations. Tie-breaking scoring metric of Sub-Challenge 1. The tie-breaking metric was identical to the primary metric Eq. 1 except that it was applied to the subset of drug combinations that have at least one cell line with synergy score Sci  20in the held-out test set (Sci = synergy score at cell line c and drug combination i). Neither the subset of drug combinations nor its size (N = 118) was revealed to participants prior to final evaluation. 1. Primary scoring metric of Sub-Challenge 2. The primary metric was a sequential three-way ANOVA, which tested the separation of held-out synergy scores by predicted synergy (=1) and predicted non-synergy (=0). In the sequential threeway ANOVA (type 1), we controlled for systematic drug and cell line effects, and evaluated variance explained by a given team’s synergy predictions. We define the primary metric as SA ¼ sgn ´ log10 ðpÞ; ð2Þ where sgn is the sign of the effect size (positive or negative separation by prediction), and p is the P-value (F-statistic) computed from the ANOVA distinguishing predicted synergy (=1) from predicted non-synergy (=0) across all experimentally measured synergy scores. NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 11 ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 This three-way ANOVA score can be interpreted via linear regression where the intercept is set to 0. y  β1  dc þ β2  cl þ β3  x ð3Þ Here, the response variable y is the observed synergy, which is normally distributed, and there are three predictive features: dc = drug combination, cl = cell line and a teams binary synergy predictions x. Then the primary metric, SA ¼ log10 ðp:value½β3 Þxsignðβ3 Þ, measures the significance of a team’s predictions after controlling for variance associated with cell line and and drug combinations. Tie-breaking scoring metric of Sub-Challenge 2. As the tie-breaking metric, we used balanced accuracy (BAC) using discretized synergy scores Sci  20to evaluate the binary classifiers submitted in this sub-challenge. This metric evaluates both the sensitivity and specificity of the classifiers while taking into account the low proportion of synergistic cases to un-synergistic. Application of the Tie-Breaking Metric. In each sub-challenge, we estimated a Bayes Factor (BF) using a paired bootstrapped approach to determine whether a team’s score was statistically indistinguishable from another. In the event that a team’s scores were determined to be statistically equivalent, we then applied the tiebreaking metric. To estimate the BF, we sample with replacement from the M observations of the given sub-challenge and computing the primary metric (pm) for each team 1000 times. For a given team, T, KT was computed by P1000 i¼1 pmT;i 0.5) from the two best performers NAD and DMIS. Features were ranked based on their feature weight or importance for given well predicting model. This geneto-combination short list, was filtered for associations predicted by both teams, or genes biological related to the drug target defined as either the gene being the target itself, a short distance to it in OmniPath signaling network (two molecules up- or downstream) or GO term similarity54 larger than 0.7. This resulted in a list of 47 gene-to-combination associations that we further studied. A gene within this list is considered mutant if it was deleted, amplified (>7 copies) or mutated in any sense, resulting in an extended BEM12. We calculated the P-value for each suggested association with an ANOVA correcting for tissue of origin and multiple hypothesis testing via Benjamini Hochberg. The effect sizes is the mean difference in synergy score between mutant and wild-type cell lines. For external validation of those putative biomarkers of synergy, we focused on drug combinations in O’Neil et al.4, ALMANAC13, and additional experimental data from AstraZeneca (Supplementary Data 3). We validated biomarkers in two different contexts, (i) for cell lines overlapping with AZ-DREAM, considered as biological replicates, and (ii) cells non-overlapping for predictions on independent cell lines. Literature evidence for the shortlisted combination-biomarker associations was identified through PubMed search. The aim was to identify published evidence of (i) the combination-biomarker association, (ii) the combination but not the specific biomarker, and (iii) either one of the targets and the biomarker association. The publications were further categorized into in vitro, in vivo, and preclinical studies. Publications that discuss the specific combination-biomarker association have been highlighted in red (Supplementary Data 3). In summary, synergy biomarker were derived from best performer models, and highlighted based external validation, as well as literature support. Reporting summary. Further information on research design is available in the Nature Research Reporting Summary linked to this article. Data availability The data used for this study are available from the Genomics of Drug Sensitivity in Cancer (GDSC [http://www.cancerrxgene.org/downloads/]) repository12, the Catalog of Somatic Mutations in Cancer (COSMIC[http://cancer.sanger.ac.uk/cell_lines]) database55, the European Genome-phenome Archive (EGA) EGAS00001000978, Gene Expression Omnibus (GEO) GSE68379, ArrayExpress E-MTAB-3610, Synapse database synapse.org/DrugCombinationChallenge[https://www.synapse.org/ DrugCombinationChallenge] and the AstraZeneca Open Innovation Portal openinnovation.astrazeneca.com/data-library.html[https://openinnovation.astrazeneca. com/data-library.html]. Code availability Full description and source code of all participants in this Challenge can be downloaded from synapse.org/DrugCombinationChallenge[https://www.synapse.org/ DrugCombinationChallenge]. Individual prediction models. Full description and implementation of models used by teams in the final submission to DREAM can be downloaded from: Synapse.org/ AstraZeneca_Sanger_Drug_Combination_Challenge_Leaderboards [http://www. synapse.org/AstraZeneca_Sanger_Drug_Combination_Challenge_Leaderboards]. Top-performing prediction models in SC1 and SC2 made use of genetic features relating to the gene targets of the drugs. Feature selection from the models enabled nomination of putative biomarkers for drug combination synergy (Supplementary Methods). Received: 12 February 2018 Accepted: 1 April 2019 Ensemble models. SC2 participant models were aggregated using two types of ensemble models Spectral Meta-Learner (SML) and Random Aggregation. SML choses predictions from n methods to aggregate based on an estimation of BAC for each method without using actual labels15,53. Random Aggregation is the traditional way that people aggregate models by giving equal weight to each method. We randomly pick n methods (do this ten times) and for n methods we compute the average BAC and the error. 2. Monotherapy biomarkers and synergy enrichment. Monotherapy markers are the mutational status of genes, either mutated or copy number altered, from the pan-cancer binary event matrix (BEM)12, which separate the monotherapy response into sensitive vs. non-response. The likelihood of separation was estimated with a Wilcoxon Rank Sum test (Supplementary Methods). From most 12 References 1. 3. 4. 5. 6. 7. Holohan, C., Van Schaeybroeck, S., Longley, D. B. & Johnston, P. G. Cancer drug resistance: an evolving paradigm. Nat. Rev. Cancer 13, 714–726 (2013). Hanahan, D. & Weinberg, R. A. Hallmarks of cancer: the next generation. Cell 144, 646–674 (2011). Dry, J. R., Yang, M. & Saez-Rodriguez, J. Looking beyond the cancer cell for effective drug combinations. Genome Med. 8, 125 (2016). O’Neil, J. et al. An unbiased oncology drug screen to identify novel combination strategies. Mol. Cancer Ther. 15, 1155–1162 (2016). Al-Lazikani, B., Banerji, U. & Workman, P. Combinatorial drug therapy for cancer in the post-genomic era. Nat. Biotechnol. 30, 679–692 (2012). Bulusu, K. C. et al. Modelling of drug combination effects and applications to efficacy and toxicity: state-of-the-art, challenges and perspectives. Drug Discov. Today 21, 225–238 (2016). Bansal, M. et al. A community computational challenge to predict the activity of pairs of drugs. Nat. Biotechnol. 32, 1213–1222 (2014). NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 8. 9. 10. 11. 12. 13. 14. 15. 16. 17. 18. 19. 20. 21. 22. 23. 24. 25. 26. 27. 28. 29. 30. 31. 32. 33. 34. 35. 36. 37. Gao, H. et al. High-throughput screening using patient-derived tumor xenografts to predict clinical trial drug response. Nat. Med. 21, 1318–1325 (2015). Saez-Rodriguez, J. et al. Crowdsourcing biomedical research: leveraging communities as innovation engines. Nat. Rev. Genet. 17, 470–486 (2016). Loewe, S. Effect of combinations : mathematical basis of problem. Arch. Exp. Pathol. Pharmakol. 114, 313–326 (1926). Di Veroli, G. Y. et al. Combenefit: an interactive platform for the analysis and visualization of drug combinations. Bioinformatics 32, 2866–2868 (2016). Iorio, F. et al. A Landscape of Pharmacogenomic Interactions in. Cancer Cell 166, 740–754 (2016). Holbeck, S. L. et al. The National Cancer Institute ALMANAC: A comprehensive screening resource for the detection of anticancer drug pairs with enhanced therapeutic activity. Cancer Res. 77, 3564–3576 (2017). Marbach, D. et al. Wisdom of crowds for robust gene network inference. Nat. Methods 9, 796–804 (2012). Parisi, F., Strino, F., Nadler, B. & Kluger, Y. Ranking and combining multiple predictors without labeled data. Proc. Natl Acad. Sci. USA 111, 1253–1258 (2014). Gene Ontology Consortium. Gene Ontology Consortium: going forward. Nucl. Acids Res. 43, D1049–D1056 (2015). Kanehisa, M., Sato, Y., Kawashima, M., Furumichi, M. & Tanabe, M. KEGG as a reference resource for gene and protein annotation. Nucl. Acids Res 44, D457–D462 (2016). Babur, Ö. et al. Systematic identification of cancer driving signaling pathways based on mutual exclusivity of genomic alterations. Genome Biol. 16, 45 (2015). Türei, D., Korcsmaros, T. & Saez-Rodriguez, J. OmniPath: guidelines and gateway for literature-curated signaling pathway resources. Nat. Methods 13, 966–967 (2016). López-Otín, C. & Hunter, T. The regulatory crosstalk between kinases and proteases in cancer. Nat. Rev. Cancer 10, 278–292 (2010). Haibe-Kains, B. et al. Inconsistency in large pharmacogenomic studies. Nature 504, 389–393 (2013). Dent, P., Curiel, D. T., Fisher, P. B. & Grant, S. Synergistic combinations of signaling pathway inhibitors: mechanisms for improved cancer therapy. Drug Resist. Updat. 12, 65–73 (2009). Eduati, F. et al. Drug Resistance mechanisms in colorectal cancer dissected with cell type–specific dynamic logic models. Cancer Res. 77, 3364–3375 (2017). Kirouac, D. C. et al. Clinical responses to ERK inhibition in BRAF(V600E)mutant colorectal cancer predicted using a computational model. NPJ Syst. Biol. Appl. 3, 14 (2017). Klinger, B. et al. Network quantification of EGFR signaling unveils potential for targeted combination therapy. Mol. Syst. Biol. 9, 673 (2013). Silverbush, D. et al. Cell-specific computational modeling of the PIM pathway in acute myeloid leukemia. Cancer Res. 77, 827–838 (2017). Flobak, Å. et al. Discovery of drug synergies in gastric cancer cells predicted by logical modeling. PLoS Comput. Biol. 11, e1004426 (2015). Fallahi-Sichani, M. et al. Adaptive resistance of melanoma cells to RAF inhibition via reversible induction of a slowly dividing de-differentiated state. Mol. Syst. Biol. 13, 905 (2017). Margolin, A. A. et al. Reverse engineering cellular networks. Nat. Protoc. 1, 662–671 (2006). Lefebvre, C. et al. A human B-cell interactome identifies MYB and FOXM1 as master regulators of proliferation in germinal centers. Mol. Syst. Biol. 6, 377 (2010). Fakhry, C. T. et al. Interpreting transcriptional changes using causal graphs: new methods and their practical utility on public networks. BMC Bioinforma. 17, 318 (2016). Leiserson, M. D. M. et al. Pan-cancer network analysis identifies combinations of rare somatic mutations across pathways and protein complexes. Nat. Genet. 47, 106–114 (2015). Alvarez, M. J., Chen, J. C. & Califano, A. DIGGIT: a Bioconductor package to infer genetic variants driving cellular phenotypes. Bioinformatics 31, 4032–4034 (2015). Yi, Y. W. et al. Inhibition of the PI3K/AKT pathway potentiates cytotoxicity of EGFR kinase inhibitors in triple-negative breast cancer cells. J. Cell. Mol. Med. 17, 648–656 (2013). Wei, F. et al. mTOR inhibition induces EGFR feedback activation in association with its resistance to human pancreatic cancer. Int. J. Mol. Sci. 16, 3267–3282 (2015). Shi, X. -B. et al. Functional analysis of 44 mutant androgen receptors from human prostate cancer. Cancer Res. 62, 1496–1502 (2002). Gottlieb, B., Beitel, L. K., Nadarajah, A., Paliouras, M. & Trifiro, M. The androgen receptor gene mutations database: 2012 update. Hum. Mutat. 33, 887–894 (2012). ARTICLE 38. Eisermann, K., Wang, D., Jing, Y., Pascal, L. E. & Wang, Z. Androgen receptor gene mutation, rearrangement, polymorphism. Transl. Androl. Urol. 2, 137–147 (2013). 39. Carver, B. S. et al. Reciprocal feedback regulation of PI3K and androgen receptor signaling in PTEN-deficient prostate cancer. Cancer Cell 19, 575–586 (2011). 40. Zhu, M. -L. & Kyprianou, N. Androgen receptor and growth factor signaling cross-talk in prostate cancer cells. Endocr. Relat. Cancer 15, 841–849 (2008). 41. Meng, X. et al. ADAM17-siRNA inhibits MCF-7 breast cancer through EGFRPI3K-AKT activation. Int. J. Oncol. 49, 682–690 (2016). 42. Zheng, X. et al. ADAM17 promotes breast cancer cell malignant phenotype through EGFR-PI3K-AKT activation. Cancer Biol. Ther. 8, 1045–1054 (2009). 43. Schwartz, S. et al. Feedback suppression of PI3Kα signaling in PTEN-mutated tumors is relieved by selective inhibition of PI3Kβ. Cancer Cell 27, 109–122 (2015). 44. Palmer, A. C. & Sorger, P. K. Combination cancer therapy can confer benefit via patient-to-patient variability without drug additivity or synergy. Cell 171, 1678–1691 (2017). e13. 45. Lopez, J. S. & Banerji, U. Combine and conquer: challenges for targeted therapy combinations in early phase trials. Nat. Rev. Clin. Oncol. 14, 57–66 (2016). 46. Di Veroli, G. Y. et al. An automated fitting procedure and software for doseresponse curves with multiphasic features. Sci. Rep. 5, 14701 (2015). 47. Stephens, P. J. et al. The landscape of cancer genes and mutational processes in breast cancer. Nature 486, 400–404 (2012). 48. Ye, K., Schulz, M. H., Long, Q., Apweiler, R. & Ning, Z. Pindel: a pattern growth approach to detect break points of large deletions and medium sized insertions from paired-end short reads. Bioinformatics 25, 2865–2871 (2009). 49. Greenman, C. D. et al. PICNIC: an algorithm to predict absolute allelic copy number variation with microarray cancer data. Biostatistics 11, 164–175 (2010). 50. Gautier, L., Cope, L., Bolstad, B. M. & Irizarry, R. A. Affy–analysis of Affymetrix GeneChip data at the probe level. Bioinformatics 20, 307–315 (2004). 51. Du, P. et al. Comparison of Beta-value and M-value methods for quantifying methylation levels by microarray analysis. BMC Bioinforma. 11, 587 (2010). 52. Kent, W. J. et al. The human genome browser at UCSC. Genome Res. 12, 996–1006 (2002). 53. Jaffe, A., Nadler, B. & Kluger, Y. Estimating the accuracies of multiple classifiers without labeled data. Artif. Intel. Stat. 38, 407–415 (2015). 54. Wappett, M. et al. Multi-omic measurement of mutually exclusive loss-offunction enriches for candidate synthetic lethal gene pairs. BMC Genom. 17, 65 (2016). 55. Forbes, S. A. et al. COSMIC: exploring the world’s knowledge of somatic mutations in human cancer. Nucl. Acids Res. 43, D805–D811 (2015). Acknowledgements We thank the Genomics of Drug Sensitivity in Cancer and COSMIC teams at the Wellcome Trust Sanger Institute for help with the preparation of the molecular data, Denes Turei for help with Omnipath, and Katjusa Koler for help with matching drug names across combination screens. We thank AstraZeneca for funding and provision of data to the DREAM Consortium to run the challenge, and funding from the European Union Horizon 2020 research (under grant agreement No 668858 PrECISE to J.S.R.), the Joint Research Center for Computational Biomedicine (which is partially funded by Bayer AG) to J.S.R., National Institute for Health Research (NIHR) Sheffield Biomedical Research Center, Premium Postdoctoral Fellowship Program of the Hungarian Academy of Sciences. M.G lab is supported by Wellcome Trust (102696 and 206194). Author contributions M.P.M., D.W., T.Y., I.S.J., T.No, G.Y.D., S.F., G.S., J.G., J.R.D., and J.S.R. designed the challenge. The top-performing approach was designed by Y.G. Data analysis for the topperforming approach was conducted by M.P.M,. D.W., M.M., B.S., K.C.B., J.K., M.J., R.W., T.Ng, and M.Z. The DREAM Consortium provided drug synergy and biomarker predictions, as well as method implementations and descriptions. M.P.M., D.W., M.M., T.Y., E.C.N., R.V., and M.E.A. performed analysis of challenge predictions. M.P.M., D.W., M.M., B.S., and K.C.B. interpreted the results of the challenge and performed follow-up analyses for the manuscript. E.K.Y.T., M.J.G., Z.G., and S.F. generated experimental data. M.P.M., D.W., Y.G., M.M., B.S., K.C.B., T.Y., J.K., M.J., R.W., T.Ng, M.Z., I.S.J., J.G., J.R.D., and J.S.R. wrote the manuscript. J.G., J.R.D., and J.S.R. supervised the project. Additional information Supplementary Information accompanies this paper at https://doi.org/10.1038/s41467019-09799-2. NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 13 ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 Competing interests: K.C.B., Z.G., G.Y.D., E.K.Y.T., S.F., and J.R.D. are AstraZeneca employees. K.C.B., Z.G., E.K.Y.T., S.F., and J.R.D. are AstraZeneca shareholders. Y.G. receives personal compensation from Eli Lilly and Company, is a shareholder of Cleerly, Inc., and Ann Arbor Algorithms, Inc. M.G. receives research funding from AstraZeneca and has performed consultancy for Sanofi. The remaining authors declare no competing interests. Reprints and permission information is available online at http://npg.nature.com/ reprintsandpermissions/ Journal peer review information: Nature Communications thanks the anonymous reviewers for their contribution to the peer review of this work. Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/ licenses/by/4.0/. © The Author(s) 2019 AstraZeneca-Sanger Drug Combination DREAM Consortium Jordi Abante18, Barbara Schmitz Abecassis19, Nanne Aben20,21, Delasa Aghamirzaie22, Tero Aittokallio23, Farida S. Akhtari24, Bissan Al-lazikani25, Tanvir Alam26, Amin Allam27, Chad Allen28, Mariana Pelicano de Almeida19, Doaa Altarawy29,30, Vinicius Alves31, Alicia Amadoz32, Benedict Anchang33, Albert A. Antolin25, Jeremy R. Ash34, Victoria Romeo Aznar35, Wail Ba-alawi26, Moeen Bagheri36, Vladimir Bajic26, Gordon Ball37, Pedro J. Ballester38,39,40,41, Delora Baptista42, Christopher Bare4, Mathilde Bateson43, Andreas Bender28, Denis Bertrand44, Bhagya Wijayawardena45, Keith A. Boroevich46, Evert Bosdriesz20,47, Salim Bougouffa26, Gergana Bounova20, Thomas Brouwer48, Barbara Bryant49, Manuel Calaza50, Alberto Calderone51, Stefano Calza52,53, Stephen Capuzzi31, Jose Carbonell-Caballero54, Daniel Carlin55, Hannah Carter55, Luisa Castagnoli56, Remzi Celebi57, Gianni Cesareni56, Hyeokyoon Chang9, Guocai Chen58, Haoran Chen59, Huiyuan Chen60, Lijun Cheng45, Ariel Chernomoretz35, Davide Chicco61, Kwang-Hyun Cho62, Sunghwan Cho62, Daeseon Choi63, Jaejoon Choi64, Kwanghun Choi9, Minsoo Choi63, Martine De Cock65, Elizabeth Coker25, Isidro Cortes-Ciriano66, Miklós Cserzö5,6, Cankut Cubuk67, Christina Curtis68, Dries Van Daele69, Cuong C. Dang38,39,40,41, Tjeerd Dijkstra70, Joaquin Dopazo67, Sorin Draghici71,72, Anastasios Drosou73, Michel Dumontier74, Friederike Ehrhart19, Fatma-Elzahraa Eid29,75, Mahmoud ElHefnawi76,77, Haitham Elmarakeby29,75, Bo van Engelen19, Hatice Billur Engin55, Iwan de Esch78, Chris Evelo19, Andre O. Falcao79, Sherif Farag31, Carlos Fernandez-Lozano80, Kathleen Fisch81, Asmund Flobak82,83, Chiara Fornari1, Amir B.K. Foroushani84, Donatien Chedom Fotso85, Denis Fourches86, Stephen Friend4, Arnoldo Frigessi87, Feng Gao88, Xiaoting Gao89, Jeffrey M. Gerold90, Pierre Gestraud91, Samik Ghosh92, Jussi Gillberg93, Antonia Godoy-Lorite94, Lizzy Godynyuk19, Adam Godzik95, Anna Goldenberg96, David Gomez-Cabrero37,97, Mehmet Gonen98,99, Chris de Graaf78, Harry Gray100, Maxim Grechkin101, Roger Guimera94,102, Emre Guney103, Benjamin Haibe-Kains104, Younghyun Han62, Takeshi Hase92, Di He105, Liye He23, Lenwood S. Heath29, Kristoffer H. Hellton106, Manuela Helmer-Citterich56, Marta R. Hidalgo67, Daniel Hidru36, Steven M. Hill100, Sepp Hochreiter107, Seungpyo Hong108, Eivind Hovig109,110, Ya-Chih Hsueh36, Zhiyuan Hu111, Justin K Huang112, R. Stephanie Huang113, László Hunyady5,6, Jinseub Hwang114, Tae Hyun Hwang115, Woochang Hwang64, Yongdeuk Hwang116, Olexandr Isayev31, Oliver Bear Don’t Walk IV117, John Jack24, Samad Jahandideh95, Jiadong Ji118,119,120, Yousang Jo62, Piotr J. Kamola46, Georgi K. Kanev78, Loukia Karacosta33, Mostafa Karimi18, Samuel Kaski93, Marat Kazanov121,122, Abdullah M Khamis26, Suleiman Ali Khan23, Narsis A. Kiani123, Allen Kim101, Jinhan Kim124, Juntae Kim62, Kiseong Kim62, Kyung Kim125, Sunkyu Kim9, Yongsoo Kim20,126, Yunseong Kim62, Paul D.W. Kirk100, Hiroaki Kitano92, Gunter Klambauer107, David Knowles33,127, Melissa Ko128, Alvaro Kohn-Luque129, Albert J. Kooistra78, Melaine A. Kuenemann86, 14 NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 ARTICLE Martin Kuiper82, Christoph Kurz130, Mijin Kwon62, Twan van Laarhoven131, Astrid Laegreid82, Simone Lederer131, Heewon Lee9, Jeon Lee115, Yun Woo Lee63, Eemeli Lepp_aho93, Richard Lewis28, Jing Li60, Lang Li132, James Liley133, Weng Khong Lim134,135, Chieh Lin136, Yiyi Liu89, Yosvany Lopez46,137,138, Joshua Low19, Artem Lysenko46, Daniel Machado42, Neel Madhukar139, Dries De Maeyer140, Ana Belen Malpartida19, Hiroshi Mamitsuka141, Francesco Marabita37, Kathleen Marchal140, Pekka Marttinen142, Daniel Mason28, Alireza Mazaheri123, Arfa Mehmood143, Ali Mehreen144, Magali Michaut20, Ryan A. Miller19, Costas Mitsopoulos25, Dezso Modos28, Marijke Van Moerbeke145, Keagan Moo101, Alison Motsinger-Reif24, Rajiv Movva127, Sebastian Muraru19, Eugene Muratov31, Mushthofa Mushthofa146, Niranjan Nagarajan44, Sigve Nakken147, Aritro Nath113, Pierre Neuvial147, Richard Newton148, Zheng Ning53, Carlos De Niz149, Baldo Oliva150, Catharina Olsen145,151, Antonio Palmeri56, Bhawan Panesar36, Stavros Papadopoulos73, Jaesub Park62, Seonyeong Park63, Sungjoon Park9, Yudi Pawitan53, Daniele Peluso56, Sriram Pendyala152, Jian Peng153, Livia Perfetto56, Stefano Pirro56, Sylvia Plevritis33, Regina Politi31, Hoifung Poon154, Eduard Porta95, Isak Prellner155, Kristina Preuer107, Miguel Angel Pujana156,157, Ricardo Ramnarine36, John E. Reid100, Fabien Reyal158, Sylvia Richardson100, Camir Ricketts139, Linda Rieswijk19,159, Miguel Rocha42, Carmen Rodriguez-Gonzalvez25, Kyle Roell24, Daniel Rotroff24, Julian R. de Ruiter20,160, Ploy Rukawa148, Benjamin Sadacca158, Zhaleh Safikhani104, Fita Safitri161, Marta Sales-Pardo94, Sebastian Sauer162, Moritz Schlichting19, Jose A. Seoane68, Jordi Serra156,157, Ming-Mei Shang37, Alok Sharma46,163,164, Hari Sharma36, Yang Shen18, Motoki Shiga165, Moonshik Shin62, Ziv Shkedy166, Kevin Shopsowitz167, Sam Sinai90, Dylan Skola112, Petr Smirnov104, Izel Fourie Soerensen168, Peter Soerensen168, Je-Hoon Song62, Sang Ok Song124, Othman Soufan20, Andreas Spitzmueller169, Boris Steipe36, Chayaporn Suphavilai44,170, Sergio Pulido Tamayo69, David Tamborero171, Jing Tang23, Zia-ur-Rehman Tanoli23, Marc Tarres-Deulofeu94, Jesper Tegner37,172, Liv Thommesen82, Seyed Ali Madani Tonekaboni104, Hong Tran29, Ewoud De Troyer166, Amy Truong4, Tatsuhiko Tsunoda46,137,138, Gábor Turu5,6, Guang-Yo Tzeng36, Lieven Verbeke140, Santiago Videla35, Daniel Vis20, Andrey Voronkov147, Konstantinos Votis73, Ashley Wang36, Hong-Qiang Horace Wang173, Po-Wei Wang136, Sheng Wang153, Wei Wang88, Xiaochen Wang89, Xin Wang88, Krister Wennerberg23, Lorenz Wernisch100, Lodewyk Wessels20,21,47, Gerard J.P. van Westen174, Bart A. Westerman175, Simon Richard White100, Egon Willighagen19, Tom Wurdinger175, Lei Xie176, Shuilian Xie18, Hua Xu58, Bhagwan Yadav177, Christopher Yau178, Huwate Yeerna179, Jia Wei Yin37, Michael Yu112, MinHwan Yu9, So Jeong Yun124, Alexey Zakharov180, Alexandros Zamichos73, Massimiliano Zanin181, Li Zeng89, Hector Zenil123,182, Frederick Zhang36, Pengyue Zhang183, Wei Zhang55, Hongyu Zhao89, Lan Zhao184, Wenjin Zheng58, Azedine Zoufir28 & Manuela Zucknick129 18 Department of Electrical and Computer Engineering, Texas A&M University, College Station 77843, USA. 19Department of Bioinformatics BiGCaT NUTRIM Maastricht University, Maastricht 6229 ER, The Netherlands. 20Division of Molecular Carcinogenesis NKI, Amsterdam 1066 CX, The Netherlands. 21Faculty of EEMCS, Delft University of Technology, Delft 2628 CD, The Netherlands. 22Genetics Bioinformatics and Computational Biology Virginia Tech, Blacksburg, VA 24061, USA. 23Institute for Molecular Medicine Finland FIMM, University of Helsinki, Helsinki FI-00014, Finland. 24Bioinformatics Research Center North Carolina State University, Raleigh, NC 27695-7566, USA. 25The Institute of Cancer Research, London SW3 6JB, UK. 26Computational Bioscience Research Center (CBRC) KAUST, Thuwal 23955, Saudi Arabia. 27King Abdullah University of Science and Technology (KAUST), Thuwal 23955, Saudi Arabia. 28Centre for Molecular Informatics, Department of Chemistry, University of Cambridge, Cambridge CB2 1EW, UK. 29Department of Computer Science Virginia Tech, Blacksburg, VA 24061, USA. 30Alexandria University, Alexandria 21500, Egypt. 31Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill 27599, USA. 32 Department of Bioinformatics, Igenomix SL, Valencia 46980, Spain. 33Department of Radiology, Stanford University, Drive, Stanford 94305, USA. 34 Bioinformatics Research Center, Department of Chemistry, Department of Statistics, North Carolina State University, Raleigh, NC 27695, USA. 35 Leloir Institute, Buenos Aires C1405 BWE, Argentina. 36University of Toronto, Toronto, ON M5S, Canada. 37Unit of Computational Medicine, Department of Medicine, Solna SciLifeLab Center for Molecular Medicine Karolinska Institute, Solna SE-171 76, Sweden. 38INSERM U1068, Marseille 13005, France. 39Institut Paoli-Calmettes, Marseille 13009, France. 40Aix-Marseille University, 13007 Marseille, France. 41CNRS UMR7258, Marseille 13273, France. 42Centre Biological Engineering (CEB), University of Minho, Braga 4710-057, Portugal. 43Institut HyperCube, Paris 92907, France. 44Computational and Systems Biology, Genome Institute of Singapore, Singapore 138672, Singapore. 45Indiana University School of Medicine, Indianapolis 46202, USA. 46Center for Integrative Medical Sciences RIKEN Japan, Kobe, Hyogo 650-0047, Japan. 47Cancer Genomics Netherlands, Utrecht 3584 CG, Netherlands. 48Computer Laboratory, University of Cambridge, Cambridge CB3 0FD, UK. 49Constellation NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 15 ARTICLE NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 Pharmaceuticals, Cambridge 2142, USA. 50CIMUS University of Santiago de Compostela, La Coruña 15001, Spain. 51Bioinformatics and Computational Biology Unit, Department of Biology, University of Rome Tor Vergata, Rome 00133, Italy. 52Department of Molecular and Translational Medicine, University of Brescia, Brescia 25123, Italy. 53Department of Medical Epidemiology and Biostatistics, Karolinska Institute, Stockholm SE-171 76, Sweden. 54Centre de Regulacio Genomica (CRG), Barcelona Institute for Science and Technology, Barcelona 08036, Spain. 55 Department of Medicine, University of California, San Diego, La Jolla, CA 92093, USA. 56Department of Biology, University of Rome Tor Vergata, Rome 00133, Italy. 57Department of Computer Engineering, Ege University Turkey, Metro İstasyonu 35100, Turkey. 58University of Texas Health Science Center, Houston 77030, USA. 59Texas A&M University, Station, College Station, TX 77843, USA. 60Case Western University, Cleveland 44106, USA. 61Princess Margaret Cancer Centre, Toronto M5G 2C1, Canada. 62Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, South Korea. 63Department of Medical Information, Kongju Nationtional University, Gongju 32588, South Korea. 64Bio-Synergy Research Center, Daejeon 02451, Republic of Korea. 65University of Washington Tacoma, Tacoma 98402, USA. 66Departement de Biologie Structurale et Chimie Institut Pasteur Unite de Bioinformatique Structurale CNRS UMR, 3825 Paris, France. 67 Clinical Bioinformatic Area Fundacion Progreso y Salud CDCA Hospital Virgen del Rocio, Sevilla 41092, Spain. 68Stanford University, Stanford 94305, USA. 69KU Leuven, Leuven 3000, Belgium. 70Max Planck Institute for Developmental Biology, Tuebingen 72076, Germany. 71Department of Computer Science, Wayne State University Michigan, Detroit 48202, USA. 72Department of Obstetrics and Gynecology, Wayne State University Michigan, Detroit 48202, USA. 73CERTH-ITI, Thessaloniki GR 5700, Greece. 74Institute of Data Science, Maastricht University, Maastricht 6229 ER, Netherlands. 75Al-Azhar University, Cairo 11651, Egypt. 76National Research Centre, Cairo 12622, Egypt. 77Nile University, Cairo 12622, Egypt. 78 Division of Medicinal Chemistry, AIMMS Vrije Universiteit, Amsterdam 1081 HZ, The Netherlands. 79LaSIGE Faculdade de Ciencias Universidade de Lisboa Portugal, Lisboa 1749-016, Portugal. 80University of A Coruna, Coruña 15001, Spain. 81Center for Computational Biology and Bioinformatics, University of California, San Diego, La Jolla, CA 92093, USA. 82Norwegian University of Science and Technology, Trondheim 7491, Norway. 83St. Olav’s University Hospital, Trondheim 7030, Norway. 84Texas State University, San Marcos Texas, San Marcos 78666, USA. 85 University of Oxford, Oxford OX1 2JD, UK. 86Bioinformatics Research Center, Department of Chemistry, North Carolina State University, Raleigh, NC 27695, USA. 87Oslo Centre for Biostatistics and Epidemiology, University of Oslo and Oslo University Hospital Norway, Oslo 0317, Norway. 88 Department of Biomedical Sciences, City University of Hong Kong, Hong Kong 999077, Hong Kong. 89Yale University, New Haven 06520, USA. 90 Program for Evolutionary Dynamics, Harvard University, Cambridge 02138, USA. 91Institut Curie Inserm U900, Paris 75248, France. 92The Systems Biology Institute Tokyo, Tokyo 141-0022, Japan. 93Department of Computer Science Aalto University, Espoo 02150, Finland. 94 Departament d’Enginyeria, Quimica Universitat Rovira i Virgili, Tarragona 43007, Spain. 95Sanford Burnham Prebys Medical Discovery Institute, Jolla 92037, USA. 96Hospital for Sick Children, Toronto, Ontario M5G 1X8, Canada. 97Mucosal and Salivary Biology Division King’s College London Dental Institute, London SE1 9RT, UK. 98College of Engineering, Koc University, Istanbul 34450, Turkey. 99School of Medicine, Koc University, Istanbul 34450, Turkey. 100MRC Biostatistics Unit University of Cambridge, Cambridge CB2 0SR, UK. 101University of Washington, Seattle, WA 98195, USA. 102ICREA, Barcelona 08010, Spain. 103Joint IRB-BSC-CRG Program in Computational Biology Institute for Research in Biomedicine, Barcelona 08028, Spain. 104Princess Margaret Cancer Centre, University Health Network, Toronto, M5G 2C1 ON, Canada. 105Ph.D. Program in Computer Science, The Graduate Center, The City University of New York, New York 10016, USA. 106Department of Mathematics University of Oslo, Oslo 0371, Norway. 107Institute of Machine Learning Johannes Kepler University Linz, Linz 4040, Austria. 108University of Wisconsin, Madison 53706, USA. 109Department of Tumor Biology Institute for Cancer Research, Oslo University Hospital Norway, Oslo 0424, Norway. 110 Department of Informatics University of Oslo, Oslo 0316, Norway. 111Wellcome Trust Centre for Human Genetics University of Oxford, Oxford OX3 7BN, UK. 112Bioinformatics and Systems Biology Program, University of California, San Diego, La Jolla, CA 92093, USA. 113University of Minnesota, Minneapolis 55455, USA. 114Department of Computer Science and Statistics, Daegu University, Daegu 38453, South Korea. 115 Department Bioinformatics, University of Texas Southwestern Medical Center, Dallas, TX 75390, USA. 116Department of Computer Science, The University of Suwon, Suwon 16499, Republic of Korea. 117Department of Biomedical Informatics, Columbia University in the City of New York, New York 10032, USA. 118School of Statistics Shandong, University of Finance and Economics, Jinan 250000, China. 119Department of Computer Science, Hunter College, The City University of New York, New York, NY 10065, USA. 120Department of Biostatistics, School of Public Health Shandong University China, Shandong 250012, China. 121Skolkovo Institute of Science and Technology, Moscow 121205, Russia. 122A.A.Kharkevich Institute for Information Transmission Problems, Moscow 127051, Russia. 123Algorithmic Dynamics Lab Unit of Computational Medicine, Department of Medicine Solna, SciLifeLab Center for Molecular Medicine Karolinska Institute, Solna SE-171 76, Sweden. 124Standigm Inc, Seoul 06250, Korea. 125Department of Bioengineering, University of Washington, Seattle 98195, USA. 126Division of Oncogenomics NKI, Amsterdam 1066 CX, The Netherlands. 127Department of Genetics, Stanford University, Stanford 94305, USA. 128Department of Cancer Biology, Stanford University Stanford, Stanford 94305, USA. 129Oslo Centre for Biostatistics and Epidemiology, Department of Biostatistics, University of Oslo, Oslo 0317, Norway. 130Helmholtz Zentrum Munchen Institute of Health Economics and Health Care Management, Neuherberg 85764, Germany. 131Data Science Radboud University, Nijmegen 6525, Netherlands. 132The Ohio State University College of Medicine, Department of Biomedical Informatics, Columbus 43210, USA. 133Department of Medicine, University of Cambridge, Cambridge CB2 0SP, UK. 134Centre for Computational Biology DukeNUS, Medical School Singapore, Singapore 169857, Singapore. 135SingHealth Duke-NUS Institute of Precision Medicine Singapore, Singapore 169857, Singapore. 136Carnegie Mellon University, Pittsburgh 15213, USA. 137Department of Medical Science, Mathematics Medical Research Institute Tokyo Medical and Dental University, Tokyo 113-8510, Japan. 138CREST JST, Tokyo 102-0076, Japan. 139Weill Cornell Medicine, New York, NY 10065, USA. 140Ghent University, Gent 9000, Belgium. 141Bioinformatics Center Institute for Chemical Research Kyoto University, Kyoto 6110011, Japan. 142Helsinki Institute for Information Technology HIIT, Department of Computer Science, Aalto University Finland, Espoo 02150, Finland. 143 University of Turku, Turku 20500, Finland. 144Helsinki University, Helsinki 00100, Finland. 145Interuniversity Institute of Bioinformatics in Brussels, Ixelles 1050, Belgium. 146Ghent University Bogor Agricultural University, Gent 9000, Belgium. 147Institut de Mathematiques de Toulouse, Universite Paul Sabatier, Toulouse 31400, France. 148University of Cambridge, Cambridge CB2 8PQ, UK. 149Texas Tech University, Lubbock 79409, USA. 150Structural Bioinformatics Group GRIB IMIM, Department of Experimental and Life Sciences, Universitat Pompeu Fabra Barcelona, Catalonia 08041, Spain. 151Machine Learning Group (MLG), Department d’Informatique, Universite libre de Bruxelles (ULB), Brussels 1050, Belgium. 152 Harvard University, Cambridge 02138, USA. 153University of Illinois at Urbana-Champaign Urbana, Champaign 61820, USA. 154Microsoft Research Redmond, Redmond 98052, USA. 155Cambridge Rindge and Latin High School, Cambridge 02138, USA. 156Catalan Institute of Oncology (ICO), Barcelona 199 08908, Spain. 157Bellvitge Biomedical Biomedical Research Institute (IDIBELL), Barcelona 199 08908, Spain. 158Institut Curie RT2 Lab, Paris 75248, France. 159Division of Environmental Health Sciences, School of Public Health, University of California, Berkeley, CA 94720, USA. 160Division of Molecular Pathology NKI, Amsterdam 1066 CX, The Netherlands. 161Kyungpook National University, Daegu 41566, South Korea. 162 FOM University of Applied Sciences, Essen 45127, Germany. 163Institute for Integrated and Intelligent Systems Griffith University, Mount Gravatt, QLD 4111, Australia. 164University of the South Pacific Fiji, Suva, Fiji. 165Department of Electrical Electronic and Computer Engineering, Gifu University, Gifu 501-1193, Japan. 166Center for Statistics, Hasselt University Belgium, Hasselt 3590, Belgium. 167Faculty of Medicine, University of British Columbia, Kelowna V1Y 1T3, Canada. 168Center for Quantitative Genetics and Genomics, Department of Biology and Genetics, Aarhus 16 NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications NATURE COMMUNICATIONS | https://doi.org/10.1038/s41467-019-09799-2 ARTICLE University, Aarhus 8000, Denmark. 169Technische Universitat Munchen, München 80333, Germany. 170Department of Computer Science, National University of Singapore, Singapore 117417, Singapore. 171Research Unit on Biomedical Informatics, University Pompeu Fabra UPF, Barcelona 08041, Spain. 172Biological and Environmental Science and Engineering, Division KAUST, Thuwal 23955, Saudi Arabia. 173Cancer Hospital of Chinese Academy of Sciences, Hefei 230031, China. 174Drug Discovery and Safety Leiden, Academic Centre for Drug Research, Leiden University, Einsteinweg 55, Leiden 2333 CC, The Netherlands. 175Department of Neurosurgery, Cancer Center, Amsterdam 1012 WX, The Netherlands. 176 Department of Computer Science, Hunter College and The Graduate Center, The City University of New York, New York, NY 10016, USA. 177 Hematology Research Unit Helsinki, Department of Clinical Chemistry and Hematology, University of Helsinki and Helsinki University Hospital Comprehensive Cancer Center, Helsinki 00029, Finland. 178Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham B15 2SY, UK. 179University of California, San Diego, SD 92093, USA. 180National Center for Advancing Translational Sciences National Institutes of Health, Rockville, MD 20892, USA. 181Universidad Politecnica de Madrid, Madrid 28040, Spain. 182Oxford Immune Algorithmics Ltd, Oxford RG1 3EU, UK. 183Indiana University - Purdue University, Indianapolis 47907, USA. 184Department of Electronic Engineering, City University of Hong Kong, Hong Kong 999077, Hong Kong NATURE COMMUNICATIONS | (2019)10:2674 | https://doi.org/10.1038/s41467-019-09799-2 | www.nature.com/naturecommunications 17