A Test of Highly Optimized Tolerance Reveals Fragile Cell-Cycle Mechanisms Are Molecular Targets in Clinical Cancer Trials Authors: Satyaprakash Nayak, Saniya Salim, Deyan Luan, Michael Zai, Jeffrey D. Varner Published: 2008, PLOS ONE DOI: 10.1371/journal.pone.0002016 ABSTRACT Robustness, a long-recognized property of living systems, allows function in the face of uncertainty while fragility, i.e., extreme sensitivity, can potentially lead to catastrophic failure following seemingly innocuous perturbations. Carlson and Doyle hypothesized that highly-evolved networks, e.g., those involved in cell-cycle regulation, can be resistant to some perturbations while highly sensitive to others. The “robust yet fragile” duality of networks has been termed Highly Optimized Tolerance (HOT) and has been the basis of new lines of inquiry in computational and experimental biology. In this study, we tested the working hypothesis that cell-cycle control architectures obey the HOT paradigm. Three cell-cycle models were analyzed using monte-carlo sensitivity analysis. Overall state sensitivity coefficients, which quantify the robustness or fragility of a given mechanism, were calculated using a monte-carlo strategy with three different numerical techniques along with multiple parameter perturbation strategies to control for possible numerical and sampling artifacts. Approximately 65% of the mechanisms in the G1/S restriction point were responsible for 95% of the sensitivity, conversely, the G2-DNA damage checkpoint showed a much stronger dependence on a few mechanisms; ∼32% or 13 of 40 mechanisms accounted for 95% of the sensitivity. Our analysis predicted that CDC25 and cyclin E mechanisms were strongly implicated in G1/S malfunctions, while fragility in the G2/M checkpoint was predicted to be associated with the regulation of the cyclin B-CDK1 complex. Analysis of a third model containing both G1/S and G2/M checkpoint logic, predicted in addition to mechanisms already mentioned, that translation and programmed proteolysis were also key fragile subsystems. Comparison of the predicted fragile mechanisms with literature and current preclinical and clinical trials suggested a strong correlation between efficacy and fragility. Thus, when taken together, these results support the working hypothesis that cell-cycle control architectures are HOT networks and establish the mathematical estimation and subsequent therapeutic exploitation of fragile mechanisms as a novel strategy for anti-cancer lead generation. INTRODUCTION The capability to gather protein-protein and protein-DNA interaction data, for example using the Yeast Two-Hybrid (Y2H) system [1] , [2] , Fluorescence Resonance Energy Transfer (FRET) techniques [3] , quantitative Mass Spectrometry (MS) proteomic or Chromatin Immunoprecipitation (ChIP)-DNA micro-array techniques [4] , [5] has far outstripped our ability to understand it. Transforming large-scale interaction data into a better understanding of the biomolecular networks underlying disease progression and eventually to new therapies requires integrative tools and strategies. Perhaps one strategy to leverage our knowledge of interaction networks into efficacious therapies would be to identify and exploit weak or fragile mechanisms while avoiding the manipulation of robust network interactions. Robustness, a long-recognized property of living systems and networks, allows function in the face of uncertainty while fragility, i.e., extreme sensitivity, can potentially lead to catastrophic failure following seemingly innocuous perturbations [6] – [10] . Different factors can influence why elements of a network are robust or fragile. Venkatasubramanian and co-workers demonstrated that the structure of complex networks can result from a trade-off between efficiency and robustness [11] while You and Yin explored how the environment has shaped the robust properties of bacteriophage T7 [12] . Leibler computationally predicted and later experimentally verified robust features of chemotaxis control networks [13] and Stelling et al. , reviewed several examples of robust biological networks [9] . Perhaps no better example of robustness can be found than cell division. The cell-cycle is one of the most fundamental and highly controlled processes in biology. The decision to divide is tightly regulated integrating extracellular signals, such as growth factors and hormones, with intracellular cues that coordinate events leading to division. However, despite extensive control and surveillance subsystems guiding the progression of cells through the division cycle, malfunctions do occur as evidenced by the uncontrolled proliferation underlying many cancers [14] . Thus, while evolutionary pressure may have programmed cells to be robust to shifting nutritional environments or varying growth factor availability, perhaps rare challenges could result in unforeseen consequences. For example, exposure to radiation, exotic chemicals (carcinogens) or even Single Nucleotide Polymorphisms (SNPs) may cause seemingly innocuous changes which manifest themselves in the breakdown of cell-cycle logic. Carlson and Doyle have hypothesized that highly-evolved networks can be resistant to some perturbations while extremely sensitive to others. The “robust yet fragile” duality of networks and systems has been termed Highly Optimized Tolerance (HOT) and has been the basis of new lines of inquiry in computational and experimental biology [10] . Sensitivity analysis is an enabling tool for the investigation of robustness and fragility in networks relevant to human health and more generally for model-based knowledge discovery. Cho et al. , used sensitivity analysis to study TNF-α-mediated NF-kβ signaling where parametric uncertainty was addressed using a monte-carlo parameter sampling protocol; a family of random parameter sets, generated from the best parameter guess, was used to calculate the sensitivity profile in a region of parameter space [15] . Bullinger and coworkers explored the robustness of models of programmed cell death or apoptosis [16] while Stelling et al. , computationally identified points of robustness and fragility, using monte-carlo sensitivity analysis and Overall State Sensitivity Coefficients (OSSCs), in models of circadian rhythm [17] . Mahdavi et al. , employed sensitivity analysis to better understand stem cell differentiation [18] , while Luan et al. , used an uncertain mechanistic model of the coagulation cascade in combination with monte-carlo sensitivity analysis, to show that computationally derived sensitive mechanisms were consistent with anticoagulation therapeutic strategies [19] . Sensitivity analysis has also been used to integrate model identification and discrimination with optimal experimental design. Several optimal experimental design and model identification studies are resident in the literature [20] – [24] along with many techniques to estimate sensitivity coefficients for models composed of ordinary differential equations, differential algebraic and stochastic equations [25] – [28] . In this study, we employ mathematical modeling and monte-carlo sensitivity analysis to explore the working hypothesis that cell-cycle control architectures are HOT networks. If our working hypothesis is true, then fragile cell-cycle mechanisms (reaction steps) should be overrepresented among experimentally observed malfunctions underlying solid and hematological cancers. Moreover, the manipulation of fragile mechanisms in a therapeutic context, which has been suggested by Kitano [29] to be more likely to elicit an efficacious response from a network or system, should also be prevalent in the treatment literature. We test our working hypothesis by computationally screening three overlapping qualitative models of cell-cycle control architectures; we employ monte-carlo sensitivity analysis and k-means clustering to rank-order mechanisms in cell-cycle and then contrast the predicted fragile and robust mechanisms with literature. If cell-cycle control architectures obey the HOT paradigm, then computational identification of fragile mechanisms using protein-protein or protein-DNA network models could be a novel strategy for anti-cancer lead generation or more broadly as a strategy to identify and exploit weakness in arbitrary networks relevant to human health. RESULTS The whole-cycle model of Novak and Tyson ( Fig. 1 ), the G1-S model of Qu et al. , ( Fig. 2A ) and the G2/M-DNA damage model of Aguda ( Fig. 2B ) were implemented from literature and screened for fragile mechanisms using monte-carlo sensitivity analysis [30] – [32] . The Novak and Tyson model, which employed a complex description of the G1/S and G2/M checkpoints, programmed protein expression and degradation, was composed of 18 dynamic species, 4 species constraints and 74 parameters. The mass-action G1/S and G2/M-DNA damage models described only the molecular logic in their respective checkpoints; the G1/S model was composed of 16 dynamic protein balances, 2 species constraints and 44 parameters while the G2/M-DNA damage model consisted of 15 dynamic protein balances,1 constraint and 40 parameters. Parameter values for each model were taken from literature. Unreported initial conditions were adjusted so that simulated model trajectories were qualitatively consistent with published values (Supplementary Material Figure S1 ). The published parameter sets, with fixed initial conditions, were used to generate random parameter sets (N = 500, unless otherwise noted) where each nominal parameter was perturbed by up to ±50%, ±1-order, or ±2-orders of magnitude. Overall State Sensitivity Coefficients (OSSCs) were calculated over the random parameter families for each cell-cycle model using three different numerical algorithms. For each model, the mean OSSC values were ranked-ordered and plotted. The Area Under the Curve (AUC) was used to measure the cumulative sensitivity contribution of each parameter. A cumulative cutoff of 95% of the overall sensitivity was used to establish the list of mechanisms (Supplementary Material Figure S2 ) which were clustered into three groups (high, medium and low sensitivity) using a k-means algorithm. The Novak and Tyson model, composed of 18 dynamic species, 4 species constraints and 74 parameters, describes both the G1/S and G2/M checkpoints and programmed protein expression and degradation. Nomenclature: Cdk1-Cyclin Dependent Kinase 1, Cdk2 - Cyclin Dependent Kinase 2, Cdk4/6 - Cyclin Dependent Kinase 4 or 6, CycD - Cyclin D, CycB - Cyclin B, CycE - Cyclin E, CycA - Cyclin A, GF - Growth Factor, ERG - Early Response Genes, DRG - Delayed Response Gene, E2F – Transcription Factor E2F, pRB - Retinoblastoma protein, p27 – A Cyclin Dependent Kinase Inhibitor (CKI), also called Kip1, PPI - type1 protein phosphatase, IE - “Intermediary Enzyme”, PPX-A phosphatase inactivating IE , APC - Anaphase Promoting Complex, a family of E3 ligases, Cdh1 - an activator of APC class of ligases, Cdc20 - an activator of APC, Small red circle with P represents a phosphate group, a (+) sign implies positive regulation whereas a (−) sign represents negative regulation. The G1/S model of Qu et al. , is composed of 16 dynamic protein balances, 2 species constraints and 44 parameters [31] . TheG2-DNA damage model of Aguda is composed of 15 dynamic protein balances 1constraint and 40 parameters (30). Both the G1/S and G2/M models employ mass action kinetics and the parameters are linear in the mass balances. Nomenclature G1/S: CDC25A - Dual Specificity Phosphatase CDC25A, Cdk2 - Cyclin Dependent Kinase 2, Cdk4/6 - Cyclin Dependent Kinase 4 or 6, CycE - Cyclin E, CycD - Cyclin D, E2F - Transcription Factor E2F, pRB - Retinoblastoma protein, p27 - A Cyclin Dependent Kinase Inhibitor (CKI), also called Kip1. Nomenclature G2/M: pMPF - pre-Maturation Promoting Factor, a complex of CycB (Cyclin B) and Cdk1 (Cyclin Dependent Kinase1) in inactive form, MPF – active form of MPF, aCDC25 - active CDC25 phosphatase, iCDC25 – inactive form of CDC25, aCDC25(P-216) – active CDC25, phosphorylated at Serine 216 residue, iCDC25(P-216) - inactive CDC25, phosphorylated at Serine 216, 14-3-3σ - 14-3-3σ protein. In both the schematics, small red circles with P represent phosphate group, a (+) sign implies positive regulation whereas a (−) sign represents negative regulation. Approximately 65% of the G1/S mechanisms (reaction steps) were responsible for 95% of the sensitivity, conversely, the G2-DNA damage network showed a stronger dependence on a few interactions. Of the 44 G1/S reactions steps, 29 were responsible for 95% of the sensitivity (Supplementary Material Figure S2 ). The distribution of fragility was not specific to any single class of interaction ( Table 1 ). The dephosphorylation of CDC25, the expression of cyclin E, the degradation of the cyclin E-CDK2 complex, and the concentration of the transcription factor E2F were classified as the most fragile reaction steps in the G1/S checkpoint ( Table 1 , cluster I). A previous model of G1/S by Aguda et al. , [33] found that although pRB and cyclin E-CDK2 formed a positive feedback loop, they did not form a sharp robust switch at the restriction point, i.e., the increase in active cyclin E-CDK2 concentration was gradual and sensitive to model parameters. However, addition of CDC25 to the positive cyclin E-CDK2-pRB feedback loop, made the restriction point robust to model parameter variation, thus supporting our findings of the importance of CDC25 interactions. The synthesis, activation and degradation of CKIs, the expression and degradation of CDC25, pRB concentration, the expression of cyclin D and cyclin E-CDK2 mechanisms dominated the second-tier of G1/S fragility ( Table 1 , cluster II). Tier-three of G1/S fragility involved several cyclin D mechanisms, cyclin E-CDK2 activity and E2F mediated cyclin E expression ( Table 1 , cluster III). When taken together, the most heavily implicated G1/S protein was cyclin E, with 11 of 29 mechanisms, followed by CKIs with six, CDC25 and cyclin D were each involved in five fragile mechanisms and E2F and pRB were each listed twice. Moreover, 16 of the 29 fragile parameters were functionally associated with cyclin E and cyclin E-CDK2 activity. As expected, the expression and degradation of the G1/S-phase cyclins and their associated CKIs were predicted to be important. However, the expression and degradation of cyclin E and other it's interactions were ranked higher than the corresponding cyclin D mechanisms with the exception of the dissociation of the cyclin E-CDK2-CKI complex. The G2-DNA damage network showed a stronger dependence on a few mechanisms when compared with G1/S; ∼32% or 13 of 40 mechanisms accounted for 95% of the sensitivity (Supplementary Material Figure S2 ). Consistent with G1/S, no single class of mechanism dominated the fragility list. The most sensitive mechanisms were related to the generation and degradation of the cyclin B-CDK1 complex otherwise known as the Maturation Promoting Factor (MPF) ( Table 2 ). The top five mechanisms were either directly or closely associated with the formation and activity of MPF while mechanisms leading the deactivation of MPF, e.g., the expression, degradation and activity of p21, 14-3-3σ and Wee1 phosphorylation dominated the remaining eight mechanisms ( Table 2 , cluster III). Activation of inactive MPF complex, whose expression is negatively regulated by p53, was the most sensitive G2 mechanism ( Table 2 , cluster I), followed by preMPF generation, activation and transport of CDC25 into the nucleus ( Table 2 , cluster II). The finding that all CDC25 related mechanisms were more fragile than Wee1, is consistent with earlier work by Aguda [34] which showed that even though both Wee1 and CDC25 form a phosphorylation-dephosphorylation (PD) loop with MPF, only CDC25 coupling gave rise to qualitatively different behavior. Interestingly, while the generation of p53 itself was not predicted to be sensitive, interactions involving p53 were prevalent, e.g., the expression of inactive MPF and p21, both of which are regulated by p53, were predicted to be sensitive. Approximately 77% of the Novak and Tyson parameters (57 of 74) were responsible for 95% of the sensitivity (Supplementary Material Figure S2 ). Both global and local components of the model were predicted to be fragile. The most sensitive global mechanism was the translational efficiency while local mechanisms such as activation of IE (hypothetical protein which activates the E3-ligase CDC20), expression of cyclin B and CDH1 degradation were also predicted to be fragile ( Table 3 , cluster I). The second-tier mechanisms were associated with deregulation of programmed proteolysis ( Table 3 , cluster II). Interestingly, while the percentage of mechanisms responsible for 95% of the sensitivity of the Novak and Tyson model was the largest of the three models, several mechanisms in cluster III had small OSSC values, including most of the G1/S checkpoint logic. Thus, sampling the complex Novak and Tyson model produced less information than the mechanistic mass-action based G1/S and G2-DNA damage models. Three different numerical methods were used to solve the sensitivity equations; OSSC-BDF: 3rd order fixed step-size backward difference method (implicit); OSSC-FD: forward-finite difference (explicit); and OSSC-ODE15s: 5th order variable step-size backward difference routine (implicit) from the Matlab (The Mathworks, Natick MA) ODE suite. Each member of the nominal parameter set was randomly perturbed by up to ±1-order of magnitude to form a family of random parameter sets (N = 500). OSSC were calculated for every member of the family of random parameter sets. The mean (μ) ±1-standard deviation (σ) are reported. Three different numerical methods were used to solve the sensitivity equations; OSSC-BDF: 3rd order fixed step-size backward difference method (implicit); OSSC-FD: forward-finite difference (explicit); and OSSC-ODE15s: 5th order variable step-size backward difference routine (implicit) from the Matlab (The Mathworks, Natick MA) ODE suite. Each member of the nominal parameter set was randomly perturbed by up to ±1-order of magnitude to form a family of random parameter sets (N = 500). OSSC were calculated for every member of the family of random parameter sets. The mean (μ) ±1-standard deviation (σ) are reported. Three different numerical methods were used to solve the sensitivity equations; OSSC-BDF: 3rd order fixed step-size backward difference method (implicit); OSSC-FD: forward-finite difference (explicit); and OSSC-ODE15s: 5th order variable step-size backward difference routine (implicit) from the Matlab (The Mathworks, Natick MA) ODE suite. Each member of the nominal parameter set was randomly perturbed by up to ±1-order of magnitude to form a family of random parameter sets (N = 150). OSSC were calculated for every member of the family of random parameter sets. The mean (μ) ±1-standard deviation (σ) are reported. The qualitative conclusions drawn from sampling the cell-cycle models were robust to the choice of solution method and the size of the parameter perturbation but sensitive to the number of parameter sets sampled. Three different numerical techniques were used to solve the sensitivity equations to control for possible numerical artifacts. The ODE15s routine of Matlab (The Mathworks, Natick MA), a third-order backward-difference implicit method (BDF3; see Supplementary Material S1 ) and forward finite difference (FD), generated qualitatively similar sensitivity results ( Fig. 3 ). The lowest Spearman rank between any two methods (ODE15s versus FD for the G1/S model) was 0.91 indicating a worse case correlation of approximately 91%. Interestingly, while the Spearman rank indicated good agreement between the solution methods, there were statistically significant shifts in OSSC values indicating the solution methods systematically shifted mechanisms, i.e., different OSSC values were calculated but the order or ranking of mechanisms was maintained (see Supplemental Material Table S1 ). Two additional sampling controls were conducted to verify the robustness of the qualitative conclusions drawn from our analysis. First, the perturbation size used to generate the random parameter families was varied to test if different conclusions would have been drawn with different perturbation sizes; OSSC values computed over random parameter families generated using ±50%, ±1-order and ±2-orders of magnitude showed no qualitative difference as quantified by the Spearman rank correlation for the G1/S model ( Fig. 4 ). The worst case correlation of 0.90 was observed between the ±50% and ±2-orders of magnitude cases indicating on average 90% of the conclusions drawn between the two cases were consistent ( Fig. 4C ). Such a strong correlation in Spearman ranks across 2-orders of magnitude in the parameter values might suggest that network structure (connectivity) is more important than parameter values. Comparison of exactly similar mechanisms across the three models supported the hypothesis of connectivity dominance where mechanisms classified as either fragile or robust in the G1/S and G2-DNA damage models were also predicted to be important in the Novak and Tyson model, albeit with different ranks ( Table 4 ). There were 11 mechanisms which appeared exactly in each model, 10 mechanisms were classified similarly while one was ranked inconsistently. Second, the cumulative Spearman rank correlation between sensitivity results generated using the ODE15s, BDF3 and FD methods for each model was calculated as a function of the number of parameter sets sampled. While the cumulative Spearman rank converged to the population mean as the number of parameter sets increased, a population size dependence was observed ( Fig. 5 ). For each model, the results reported were obtained in the region of convergence; hence, no new information would have been gained if additional random parameter sets were sampled. Scaled Overall State Sensitivity Coefficients (OSSC) were calculated for each cell-cycle model over a family of random parameters sets (N = 500 unless otherwise noted) generated by randomly perturbing the published set by ±1-order of magnitude. Three different numerical methods were used to solve the sensitivity equations to control for numerical artifacts. A–C: Sensitivity results for the Novak and Tyson model [32] . D–F: Sensitivity results for the G1/S checkpoint model of Qu et al. , [31] . G–I: Sensitivity results for the G2/M-DNA damage model of Aguda [30] . The different numerical techniques used to solve the sensitivity equations yield qualitatively similar results as quantified by the Spearman rank correlation between any two methods (lower right-hand corner of each plot). A family of random parameter sets was constructed (N = 150) from the nominal set, where each parameter was perturbed by upto ±50%, ±1-order or ±2-orders of magnitude. The ODE15s routine of Matlab (The Mathworks, Natick MA) was used to solve the sensitivity equations. A: Cumulative Spearman ranks between parameters sets with ±50% change and ±1order change. B: Cumulative Spearman ranks between parameters sets with ±1-and ±2-orders of magnitude change. C: Cumulative Spearman ranks between parameters sets with ±50%-and ±2-orders of magnitude change. The mean percentage ranking, defined as the fractional distance from the lowest ranked mechanism, ±1-standard deviation is reported. The 95% cutoff for mechanisms to be included in the fragile set was 34%, 68% and 23% for the G1/S, G2-DNA damage and Novak and Tyson models, respectively. The red-dashed line in all cases denotes the cumulative Spearman Rank obtained by sampling all parameter sets for any two methods. A–B: Cumulative Spearman rank versus the number of parameter sets sampled for the G1-S model using the BDF3 and ODE15s methods (A) and Finite Difference (FD) and ODE15s methods (B), respectively. C–D: Cumulative Spearman rank versus the number of parameter sets sampled for the G2-M model using the BDF3 and ODE15s methods (C) and Finite Difference (FD) and ODE15s methods (D), respectively. E–F: Cumulative Spearman rank versus the number of parameter sets sampled for the whole-cycle model using the BDF3 and ODE15s methods (E) and Finite Difference (FD) and ODE15s methods (F), respectively. In all models and numerical methods, the cumulative Spearman rank converges to population value, however, the rate of convergence, i.e., the number of random sets required to be sampled, is different for each model and method. TABLE: Comparison of Overall State Sensitivity Coefficients (OSSC) calculated for the G1/S model of Qu et al. , [31] . OSSC-BDF OSSC-FD OSSC-ODE15s Reaction Cluster μ±σ μ±σ μ±σ Dephosphorylation of aCDC25 I 0.6252±0.2980 0.6314±0.2667 0.6942±0.2518 Degradation of aCycE-Cdk2 I 0.5854±0.3452 0.6373±0.3403 0.6756±0.3423 Concentration of E2F I 0.5710±0.3247 0.6744±0.3062 0.6469±0.2958 Synthesis of CycE I 0.4583±0.3364 0.5131±0.3476 0.6063±0.3502 Generation of aCKIs II 0.4513±0.2577 0.5297±0.2540 0.5494±0.2320 Concentration of pRb II 0.4429±0.2982 0.5224±0.2827 0.5238±0.2725 Phosphorylation of iCDC25 II 0.4442±0.3245 0.4349±0.2905 0.4803±0.2856 Synthesis of iCDC25 II 0.3952±0.1934 0.4535±0.2015 0.4801±0.1690 Synthesis of CycD II 0.3367±0.2230 0.3984±0.2340 0.4376±0.2411 Formation of iCycE-Cdk2 II 0.3590±0.2275 0.4053±0.2656 0.4271±0.2417 Dephosphorylation of iCKIs II 0.3841±0.2557 0.4101±0.2428 0.4271±0.2361 Degradation of iCDC25 II 0.3198±0.2129 0.3711±0.2436 0.3789±0.2239 Formation of CycE-Cdk2-CKI II 0.3410±0.1997 0.3655±0.2106 0.3706±0.1731 Dissociation of CycE-Cdk2 complex II 0.3023±0.2626 0.3343±0.2946 0.3428±0.3002 Degradation of CycE II 0.2671±0.2791 0.3163±0.3165 0.3250±0.3262 Phosphorylation of aCKIs II 0.2909±0.2459 0.2705±0.2017 0.3182±0.2099 Degradation of CKIs II 0.2678±0.2556 0.2985±0.2803 0.2921±0.2618 Formation of CycD-Cdk4/6 III 0.1987±0.1312 0.2325±0.1410 0.2639±0.1485 Dissociation of CycE-Cdk2-CKI III 0.2623±0.2512 0.2647±0.2722 0.2585±0.2563 Degradation of CycD III 0.1867±0.1654 0.2194±0.1786 0.2575±0.1910 iCycE-Cdk2→aCycE-Cdk2 III 0.2096±0.2617 0.2472±0.3047 0.2322±0.2888 Phosphorylation of CDC25 by aCycE-Cdk2 III 0.2057±0.2446 0.2358±0.2828 0.2318±0.2893 Formation of CycD-Cdk4/6-CKI III 0.1801±0.1130 0.2054±0.1164 0.2268±0.1232 Rate constant for pRb dephosphorylation III 0.3945±0.3126 0.2016±0.1152 0.2260±0.1164 Degradation of iCKI III 0.1678±0.1646 0.1644±0.1642 0.2077±0.1815 E2F dependent CycE expression III 0.2219±0.2849 0.2432±0.3064 0.2064±0.3020 Dissociation of CycD-Cdk4/6-CKI III 0.1867±0.1654 0.1993±0.1443 0.2046±0.1376 aCycE-Cdk2 regulated pRb phosphorylation III 0.1551±0.1055 0.1812±0.1122 0.2008±0.1127 Rate constant for CKI phosphorylation III 0.1638±0.2232 0.1998±0.2602 0.1911±0.2547 TABLE: Comparison of Overall State Sensitivity Coefficients (OSSC) for the G2-DNA damage model of Aguda [30] . OSSC-BDF OSSC-FD OSSC-ODE15s Description Cluster μ±σ μ±σ μ±σ pMPF→MPF, catalyzed by aCdc25 I 0.8759±0.1475 0.8910±0.1271 0.9924±0.0739 aCdc25→iCdc25 II 0.7676±0.1442 0.7703±0.1181 0.8845±0.0920 Generation of preMPF II 0.9413±0.1214 0.9720±0.0838 0.8684±0.1130 iCdc25 cyto. →iCdc25 nuc. II 0.9270±0.1164 0.9417±0.0938 0.8356±0.1014 iCdc25→aCdc25, catalyzed by MPF II 0.5728±0.2291 0.5010±0.1422 0.2835±0.1517 Generation of p21 III 0.4860±0.1784 0.5031±0.1949 0.2835±0.1517 Degradation of p21 III 0.4833±0.1760 0.4854±0.1838 0.2812±0.1481 p21+MPF→p21−MPF III 0.3382±0.1406 0.3413±0.1504 0.2017±0.1248 p21−MPF→p21+MPF III 0.3352±0.1373 0.3254±0.1438 0.1979±0.1172 Generation of 14-3-3σ protein III 0.3434±0.1250 0.3802±0.1459 0.1913±0.1060 Degradation of 14-3-3σ protein III 0.3421±0.1247 0.3625±0.1390 0.1909±0.1059 Wee1→Wee1P, catalyzed by MPF III 0.3214±0.1338 0.3274±0.1489 0.1739±0.0878 Wee1P→Wee1 III 0.3078±0.1306 0.2993±0.1381 0.1666±0.0855 TABLE: Comparison of Overall State Sensitivity Coefficients (OSSC) for the whole-cycle model of Novak and Tyson [32] . OSSC-BDF OSSC-FD OSSC-ODE15s Description Cluster μ±σ μ±σ μ±σ Translational efficiency (▭) I 0.7904±0.3264 0.8647±0.2372 0.6657±0.3816 Activation of ‘IE’ (k 31 ) I 0.6026±0.3071 0.6026±0.3071 0.5361±0.3843 Generation of CycB (k 1 ) I 0.5650±0.3015 0.4993±0.2299 0.5002±0.3471 Cdh1 degradation (k 4 ) I 0.4043±0.2443 0.3805±0.2361 0.4997±0.3765 Degradation of ‘IEP’ (k 32 ) II 0.4958±0.2863 0.3576±0.2219 0.4759±0.3417 Generation of Cdh1 (k′ 3 ) II 0.4434±0.2863 0.3576±0.2219 0.4759±0.3417 CycA mediated degradation of Cdh1 (γ A ) II 0.4434±0.2934 0.3021±0.1895 0.4482±0.3853 Degradation of ‘PPX’(k 34 ) II 0.2266±0.1621 0.2788±0.1995 0.2835±0.2604 Generation of dephosphatase PPX (k 33 ) III 0.2224±0.1652 0.2152±0.1616 0.2572±0.2240 Activation of Cdc20 (k 13 ) III 0.2441±0.3096 0.2557±0.2616 0.2202±0.2782 CycE dependent CycE∶Kip1 dissociation (k 8 ) III 0.0463±0.0798 0.0041±0.0058 0.1989±0.2545 CycE∶Kip1 dissociation giving Kip1 (k′ 8 ) III 0.0463±0.0798 0.0105±0.0635 0.1988±0.2545 CycE dependent Kip1 accumulation (ψ E ) III 0.0438±0.0744 0.0078±0.0371 0.1861±0.2386 Cdh1 dependent degradation of Cyc B (k′ 2 ) III 0.1143±0.1189 0.0865±0.1405 0.1759±0.1690 Generation of Cyc B (k″ 1) III 0.1486±0.0760 0.1333±0.0672 0.1751±0.1649 Degradation of Cdc20 (k 14 ) III 0.2402±0.2678 0.1898±0.2238 0.1692±0.2057 Total E2F (E2F T ) III 0.1460±0.1282 0.4249±0.2385 0.1524±0.1424 Degradation of DRGs (k 18 ) III 0.0463±0.1020 0.0003±0.0006 0.1461±0.1720 Expression of CycA, catalyzed by aE2F (k 29 ) III 0.1697±0.1366 0.2639±0.1444 0.1334±0.1525 aE2F (k 7 ) mediate CycE expression III 0.0367±0.0625 0.0035±0.0038 0.1325±0.1489 Formation of ‘GM’ (k 27 ) III 0.0911±0.1014 0.1276±0.0863 0.1307±0.1474 Degradation of Cdc20 (J 4 ) III 0.0649±0.0743 0.0743±0.1348 0.1281±0.1331 CycB dependent degradation of Cdh1 (γ B ) III 0.0902±0.1296 0.0478±0.0563 0.1281±0.1331 Synthesis of p27 Kip1 (k 5 ) III 0.0272±0.0447 0.0032±0.0041 0.1274±0.1232 Synthesis of DRG products (k 17 ) III 0.0442±0.0992 0.0003±0.0005 0.1205±0.1754 Maximum specific growth rate (μ) III 0.1231±0.1431 0.1724±0.1096 0.1176±0.1490 CycE dependent decrease in Kip1 (k 6 ) III 0.0264±0.0432 0.0030±0.0038 0.1161±0.1161 Decrease in E2F (k 23 ) III 0.0713±0.0734 0.2138±0.2094 0.1130±0.1080 Degradation of Cdc20 (k 12 ) III 0.0686±0.0969 0.0308±0.0419 0.1091±0.1041 Degradation of free E2F (aE2F (k 22 )) III 0.0683±0.0969 0.0308±0.0419 0.1091±0.1041 Total PP1 T (PP1 T ) III 0.0220±0.0394 0.0001±0.0002 0.1011±0.1034 Synthesis of CycB (J 1 ) III 0.0577±0.0356 0.0594±0.0378 0.0999±0.1341 Degradation of ‘GM’ (k 28 ) III 0.0841±0.0957 0.1025±0.0688 0.0961±0.1092 CycE/A activation of PP1 (K 21 ) III 0.0206±0.0370 0.0001±0.0002 0.0945±0.0972 Cdh1 dependent CycB degradation (k 2 ) III 0.0706±0.0676 0.0547±0.0447 0.0911±0.1137 CycD dependent E2F∶Rb dissociation (k 20 ) III 0.0224±0.0402 0.0022±0.0208 0.0878±0.0941 CycE dependent activation of PP1 (φ E ) III 0.0183±0.0324 0.0011±0.0104 0.0865±0.0911 Degradation of ‘IEP’ (J 32 ) III 0.0467±0.0551 0.0313±0.0428 0.0853±0.0774 Degradation of CycD and CycD∶Kip1 (k 10 ) III 0.0174±0.0307 0.0002±0.0004 0.0852±0.0889 GF dependent synthesis of CycD (k 9 ) III 0.0171±0.0304 0.0012±0.0104 0.0805±0.0874 Degradation of ERG (k 16 ) III 0.0129±0.0227 7.194×10 −7 ±1.728×10 −6 0.0802±0.0912 Total pRb concentration (Rb T ) III 0.0179±0.0321 0.0068±0.0530 0.0780±0.0817 PP1 dependent pRb activation (k 19 ) III 0.0179±0.0321 0.0001±0.0002 0.0772±0.0807 CycB dependent Cdc20 formation (k 11 ) III 0.0138±0.0230 0.0023±0.0171 0.0770±0.0826 Formation of Cdh1 (J 3 ) III 0.0153±0.0224 0.0118±0.0136 0.0710±0.1542 Formation of CycE-Cdk2-Kip1 (k 25 ) III 0.0142±0.0246 0.0004±0.0006 0.0695±0.0687 Cdc20 dependent CycB degradation (k″ 2 ) III 0.0697±0.1035 0.0489±0.0944 0.0685±0.1210 Formation of ERGs (k 15 ) III 0.0124±0.0222 8.593×10 −7 ±2.233×10 −6 0.0662±0.0759 DRG dependent formation of ERG(J 15 ) III 0.0208±0.0399 4.998×10 −7 ±8.465×10 −7 0.0649±0.0997 CycB dissociation of CKI complex(η B ) III 0.0170±0.0328 0.0003±0.0004 0.0598±0.0787 CycD-Cdk4/6-Kip1 association(k 24 ) III 0.0110±0.0199 0.0002±0.0004 0.0469±0.0563 CycE dissociation of CKI complex(η E ) III 0.0099±0.0134 0.0021±0.0022 0.0461±0.0510 Cdh20 depdendent Cdh1 formation (k 3 ) III 0.0732±0.1007 0.0607±0.1165 0.0439±0.0851 CycE dependent pRb phosphorylation (λ E ) III 0.0098±0.0173 7.812×10 −5 ±1.044×10 −4 0.0413±0.0467 Cyclin dependent pRb phosphorylation (k 26 ) III 0.0112±0.0199 0.0001±0.0002 0.0383±0.0470 CycB dependent pRb phosphorylation (λ B ) III 0.0123±0.0238 5.447×10 −5 ±1.567×10 −4 0.0333±0.0515 Cdc20 dependent CycA degradation (k 30 ) III 0.0182±0.0289 0.0138±0.0184 0.0329±0.0458 TABLE: Comparison of OSSC ranks for common mechanisms in the G1/S, G2-DNA damage and Novak and Tyson models. Mechanism G1/S (%) G2/M (%) Whole-cell model (%) Generation of preMPF - 93±2 80±18 Total concentrations Total E2F concentration 93±15 - 77±10 Total pRb concentration 86±15 - 43±16 Reactions of CKIs Generation of CKIs 86±10 85±2 68±12 CycE-Cdk2 associating with CKI 70±9 - 38±15 Dissociation of CycE-Cdk2-CKI 57±19 - ( 8±23 , 5±19) CycD-Cdk4/6 associating with CKI 48±8 - 31±19 Dissociation of CycD-Cdk4/6-CKI 39±11 - (47±14, 8±23 , 4±19) Generation and Degradation Degradation of CycE 66±24 - 38±15 Degradation of CycD 55±15 - 47±14 CycE generation catalyzed by E2F 41±26 - 73±16 DISCUSSION Literature evidence supports the hypothesis that computationally identified fragile cell-cycle interactions represent efficacious targets. Consider the fragility of CDC25 mechanisms. Boutros et al. , recently reviewed the role of CDC25 phosphatases and CDC25 inhibitors in human cancer progression and treatment [35] . While the inhibition of CDC25 as a cancer treatment strategy is still in the laboratory stage, several CDC25 inhibitors in development have shown promising results. The CDC25 inhibitor PM20 inhibited growth in human hepatoma-derived Hep3B cell-lines at a inhibitory concentration (IC) >700 nM, PM-20 also inhibited the growth of several other cell-lines, albeit at higher ICs [36] . BN82685, which inhibited CDC 25A, B and C in-vitro and in-vivo and repressed the growth of HeLa and human pancreatic tumor Mia PaCa-2 xenografts in athymic nude mice, also inhibited the growth of human cell lines resistant to cytotoxic drugs e.g., the human myeloblastic leukemia cell-line HL-60 [37] . The CDC25 antagonist, CPD-5, inhibited the growth of the rat hepatoma cell-line JM-1 in-vitro and the mouse cancer cell-line tsFT210 through selective inhibition of CDC25 [38] . Thus, inhibition of CDC25 represents a viable treatment option which could be pursued further in the clinic. Inhibition and degradation of the active cyclin E-CDK2 complex, the second ranked mechanism in the G1/S network, has also been exploited as a treatment strategy. Bristol-Myers Squibb (BMS) developed BMS-387032, a cyclin E-CDK2 inhibitor, with an IC50 of 95 nM [39] . Preclinical and phase I ovarian cancer studies demonstrated that BMS-387032 possessed better efficacy than Flavopiridol, a promiscuous CDK inhibitor [40] . Flavopiridol, the first cyclin dependent kinase inhibitor in clinical trials, alone or in combination with other drugs is currently being investigated in 52 active phase I or II trials [41] . Flavopiridol has been proposed for the treatment of recurrent, locally advanced, or metastatic soft tissue sarcoma [42] , lymphoma and multiple myeloma [43] , metastatic breast cancer (with Trastumuzumab) [44] or in combination with other drugs (Cisplatin and Carboplatin) for the treatment of advanced solid tumors [45] . Cyclin E expression, the fourth ranked mechanism in the G1/S model, has also been explored therapeutically for the treatment of pancreatic and lung cancers [46] , [47] . The correlation between fragility and treatment strategy was also found to hold for the G2/M-DNA damage network. The activation of preMPF (cyclin B–CDK1 complex), catalyzed by CDC25, was predicted to be the most sensitive mechanism in the G2/M-DNA damage model while three of the four tier-two G2/M-DNA mechanisms were associated with CDC25 activity. Bryostatin-1, a protein kinase C (PKC) inhibitor and antagonist of the cyclin B-CDK1 complex, has been explored in the clinic for the treatment of multiple myeloma [48] , relapsed non-Hodgkin's lymphoma and chronic lymphocytic leukemia [49] . In preclinical models, Bryostatin-1 has demonstrated single-agent activity against B16 melanoma, M5076 reticulum sarcoma and L10A B-cell lymphoma [50] and has been shown to disrupt cyclin B-CDK1 complex formation and activity by several different mechanisms [51] , [52] . When taken together, the top fragile mechanisms for both the G1/S and G2/M phases of the cell-cycle, estimated by monte-carlo sensitivity analysis, were found to be consistent with on-going preclinical and clinical trials for the treatment of a broad spectrum of human cancers. Modulation of translational efficiency and the manipulation of programmed proteolysis, prominently featured among the group of fragile mechanisms across all the models, are also active areas of therapeutic development. Initiation of translation in eukaryotes is thought to be rate limiting [53] and overexpression of initiation components, for example the initiation factor elF4E, occurs frequently in human cancers [54] . Arnqvist and coworkers explored translation inhibition in MCF-7 breast cancer cells following cycloheximide, puromycin or emetine exposure in the presence and absence of Insulin-like Growth Factor1 (IGF-1) [55] . Addition of puromycin, cycloheximide and emetine in the absence of IGF-1 resulted in increased apoptosis at 48 hr relative to the control, however, when IGF-1 was present, a concentration dependent reduction in apoptosis was observed. Bjornsti and Houghton recently reviewed another small molecule translation inhibitor, Ramapycin [56] , which inhibits the Target of Ramapycin (TOR) protein, a serine/threonine kinase involved in translation and other functions. While Ramapycin has FDA approval as an immunosuppressant, development of anticancer therapies has been slow despite anti-tumor activity against established solid-tumor models [57] , [58] . Ramapycin analogs have been evaluated in clinical trials for the treatment of different indications including pediatric patients with relapsed or refractory acute leukemia and renal-cell carcinoma [56] , [59] . Peptide inhibitors have also been used to downregulate translation e.g., BL22, an immunotoxin developed for the treatment of Chronic Lymphocytic Leukemia (CLL) [60] , consists of the variable FV fragment of the RFB4 antibody conjugated to the anti-translation peptide PE38. The second group of fragile mechanisms predicted in Novak and Tyson and more generally across the G1/S and G2/M-DNA damage networks involved deregulation of programmed protein degradation. Programmed proteolysis via the Ubiquitin Proteasome System (UPS), a critical component driving cell-cycle progression [61] , has been the target of several different therapeutic developments [62] . The ubiquination of target proteins involves the coordinated activity of the ubiquitin activating enzyme family (E1), the ubiquitin-conjugating enzyme family (E2) and the ubiquitin ligase family (E3) [63] . While E1 malfunctions have not been observed in cancer, deregulation of E3 and to a lesser extent E2 activity has been directly linked to cancer progression [63] . The Novak and Tyson model has only a skeleton representation of UPS, however, it does explicitly represent Cell Division Cycle protein 20 (CDC20), CDH1 and Anaphase Promoting Complex/Cyclosome (APC/C), all of which are E3 components. APC/C is the core subunit to which the adapter proteins CDC20 and CDH1 bind [64] – [66] . Inhibition of specific E3 ligases remains a technical challenge [67] , however, cis-imidazoline analogs called Nutlins have been developed which inhibit MDM2, an E3-ligase responsible for the recognition of p53. Activity of Nutlins-3 against a human osteosarcoma xenograft model in nude mice showed 90% inhibition of tumor growth relative to control [68] . While multiple lines of experimental evidence support the assertion that malfunctions in fragile mechanisms are implicated in solid and hematological cancers, some evidence is contradictory. CDC25 activity, cyclin E expression and activity of cyclin E-CDK2 were the largest group of fragile G1/S mechanisms. Traditionally, cyclin E expression and cyclin E-CDK2 activity were thought to be critical for cell-cycle progression [69] . Ohtsubo et al. , have shown that cyclin E-CDK2 activity was maximum during the G1/S phase and overexpression of cyclin E accelerated cell-cycle progression [70] . Lucas et al. , showed that abnormal cyclin E but not Cyclin D1 expression was able to override G1 arrest by the INK4a family of CKIs [71] . Keyomarsi et al. , found that cyclin E expression plays a strong role in human breast cancer tumors and the cyclin E-CDK2 complex remains active throughout the cell-cycle suggesting the now established hypothesis that truncated (deregulated) cyclin E variants were responsible for the constitutive function of cyclin E-CDK2 in breast cancer tumors [72] , [73] . Recent studies, however, have challenged the traditional role of cyclin E. Deletion of both cyclin E genes was lethal in-utero but deletion of cyclin E1 or cyclin E2 was tolerated with no obvious abnormalities [74] . Interestingly, double cyclin E knockout mice were born alive if cyclin E was restored in the embryonic component of the placenta [74] and CDK2 null mice were born viable and healthy [75] . Thus, while the cyclin E and CDK2 knockout studies seem to contradict the essential role of cyclin E, clinical evidence suggests further studies are required. Evidence supporting the involvement of other fragile components, such as the concentration of E2F and pRB (constraints in the G1/S and Novak and Tyson models), is also prevalent in the literature [76] , [77] . However, contradictory evidence suggests that the role of cyclin D mechanisms maybe complex. Sensitivity analysis suggested that cyclin D-CDK4/6 and cyclin D-CDK4/6-CKIs trimer mechanisms were robust or only moderately sensitive while cyclin D expression was fragile in the G1/S checkpoint. While Keenan et al. , demonstrated in IIC9 Chinese hamster embryonic fibroblasts that cyclin E expression renders cyclin D-CDK4 dispensable [78] , overexpression of cyclin D variants, particularly cyclin D1, has been observed in several human cancers [79] , [80] . Moreover, cyclin D1, D2 or D3 −/− mice displayed tissue specific phenotypes including defective proliferation [81] – [83] . However, while mice lacking all the cyclin D genes died by day E17.5 of gestation, most tissue and organs were formed by day E13.5 indicating that cyclin D was not required for embryogenies [84] . When taken together, the retrospective cyclin E studies in breast cancer patients and the CDC25 studies support the hypothesis that malfunctions in fragile mechanisms are strongly implicated in cancer progression. However, the cyclin E and CDK2 knockout studies as well the confusing role of cyclin D suggests a more nuanced perspective in which redundant proteins or subsystems might be able to compensate for malfunctions in fragile mechanisms. Consistent with the conjecture of Kitano, the anecdotal comparison between predicted fragile mechanisms and literature suggested that cell-cycle control architectures are HOT networks [29] . However, while different controls were conducted to ensure the fidelity of the monte-carlo sampling protocol, the mathematical models being explored were coarse-grained and not structurally complete. While quantifying the impact of structural uncertainty remains a critical challenge, the general correlation between efficacy and fragility appears to be model independent as other studies have yielded similar results [19] . Moreover, initial results presented here suggest that while the quantitative values of sensitivity coefficients calculated using different models with overlapping biology will change between models, the qualitative conclusions drawn may be invariant. However, this conclusion is likely true only for a subset of mechanisms. One possible strategy to explore structural uncertainty would be to construct detailed subsystem models of the coarse-grained components which were determined by our analysis to be fragile, e.g., translation or UPS. While this top-down strategy does not specifically address structural uncertainty, it does allow us to determine the molecular interactions which are perhaps mediating fragility in the coarse-grained model. A second critical issue is the choice of sensitivity metric. OSSCs quantify the overall impact that a parameter has; however, other measures of sensitivity might be better suited for analysis of the cell-cycle. Doyle and colleagues have established tools for the analysis of mammalian circadian rhythm that could prove useful in understanding how fragility influences phenotypic properties such as division frequency [17] , [85] , [86] . A third critical issue not addressed in this study was safety. Highly efficacious strategies have resulted in unwanted and possible harmful side effects, e.g., the association of rofecoxib with adverse cardiovascular events [87] . While there may not be an obvious linkage between fragility and safety for single agents, initial retrospective studies by Luan et al. , using combinations of coagulation inhibitors, have suggested that shifts in mechanism rank could be used to understand molecular drug-drug synergies [19] . MATERIALS AND METHODS The cell-cycle models used in this study [30] – [32] were represented as systems of Differential Algebraic Equations (DAEs): (1) where x∈ R m denotes the concentration vector, f(x, p)∈ R m denotes the mass balance equation vector describing the kinetics and connectivity of the cell cycle network and p∈ R p denotes the parameter vector. The diagonal m × m matrix Θ contains 1's for dynamic elements of the concentration vector, 0 otherwise (constraints). The fragile elements of the cell-cycle networks were determined by computing Overall State Sensitivity Coefficients (OSSC) [17] . OSSC values were calculated by first calculating the first-order sensitivity coefficients (at time t k ): (2) which are solutions of the equation: (3) subject to the initial condition s j ( t 0 ) = 0. The quantity j denotes the parameter index, P denotes the number of parameters and s j denotes the m ×1 vector of first-order sensitivity coefficients with respect to parameter j . The Jacobian matrix ( A ) and the matrix of first derivatives of the mass balances w.r.t the parameter values ( B ) (whose columns are denoted by b j ) are given by: (4) where x denotes a point along the nominal or unperturbed system solution. We solved the sensitivity equations for each parameter using three different numerical methods to control for possible artifacts; a 3-order Backward Difference (BDF3) method was compared with forward Finite Difference (FD), and the fifth-order variable step-size ODE15s routine of Matlab (The Mathworks, Natick MA). The matrices A and B were estimated numerically at each time step using a generalized gradient algorithm [88] . Overall State Sensitivity Coefficients (OSSC), first used by Stelling et al. , to characterize mechanisms in circadian rhythm as fragile or robust [18] , were calculated for each parameter j : (5) The quantity N T denotes the number of time points used in the simulation while N s denotes the number of proteins/protein complexes in the model. To account for parametric uncertainty, the OSSC values ( S oj ) were calculated over a family of random parameter sets; we randomly perturbed each nominal parameter by up to ±1-order of magnitude then solved the sensitivity balances for each family member. To control for perturbation effects, two other random parameter families were also tested (±50% and ±2-orders of magnitude, N = 500). STATISTICAL AND CLUSTERING ANALYSIS OF OSSC VALUES Three different tests were performed to identify large statistically significant shifts in the OSSC values. The OSSC values calculated over the family of parameter sets were assumed to be normally distributed. The statistical significance of shifts in OSSC values for each algorithm relative to ODE15s (control) were determined by performing a Welch t-test with the null hypothesis that the means of the OSSC values were equal at a 1% significance level [89] . The list of significant OSSC values was further restricted to only those shifts with a magnitude larger than a specified z-score (1.0) away from the squared mean displacement over the significant OSSC values. We defined the displacement of an OSSC value relative to the control as: (6) where denotes the mean OSSC value over the family of parameter sets for parameter j in the control while denotes the same quantity for algorithm q . A significant shift in OSSC value was accepted if: (7) where z denotes a desired z-score, denotes the standard deviation of the total displacement over all significant OSSC values for the q th numerical algorithm and denotes the mean of the significant displacements for algorithm q . Large statistically significant shifts in OSSC values, while perhaps indicative of the shifting importance of mechanisms, do not guarantee that mechanisms are qualitatively different between the algorithms considered (see Supplementary Material Table S1 ). The Spearman rank correlation denoted by ρ and defined as: (8) was used to measure the difference in qualitative ranking of mechanisms between algorithms considered. The quantity d i denotes the difference in the ordinal rank of mechanisms between algorithms or perturbation size, N denotes the number of pairs of values and P denotes the number of parameters considered. The Spearman rank is bounded by −1≥ρ≥1; a Spearman rank of one indicates that two ranked lists are identical, a Spearman rank of negative one indicates a perfect negative correlation, while a Spearman rank of zero indicates that two ranked lists are uncorrelated. The distributions of OSSC values obtained from monte-carlo sampling were clustered using a k-means algorithm [90] . The mean and standard deviation obtained from the monte-carlo sensitivity analysis was used to estimate the underlying OSSC distribution (N = 500 points) where the OSSC values were assumed to be normally distributed. One-hundred different clustering attempts were run for each model to control for clustering artifacts. The most probable configuration was reported. SUPPORTING INFORMATION (1.07 MB DOC) Qualitative comparison of simulations results of the model implementations used in this study. A–B: Free and bound Cyclin E versus time for the reimplementation (A) and published (B) the G1/S model of Qu et al., [31] . C–D: Concentration profiles of the Wee1, MPF and active CDC25 proteins versus time for the reimplementation (C) and published (D) G2/M DNA damage model of Aguda [30] . E–F: Concentration profiles for the Cdh1 protein and the Cdk1:CycB complex versus time for the reimplementation (E) and published whole-cycle model of Novak and Tyson [32] . In all cases the reimplemented models were qualitatively consistent with published results. (1.95 MB EPS) Cumulative Sensitivity as a function of parameter rank. The cumulative sensitivity contribution of each parameter was calculated by calculating the Area Under the Curve (AUC) using the trapazoid rule. Mechanisms responsible for 95% of the total sensitivity in each model were collected, clustered and analyzed. Panel A shows the result for G1/S model, Panel B - G2/DNA damage model and Panel C shows the plot for the whole cell model. (0.33 MB EPS) Statistically significant shifts of Overall State Sensitivity Coefficients (OSSCs) between solution methods computed using the Welch t-test. The mean and one standard deviation of the OSSC score computed over the family of random parameter sets is reported. Only shifts recorded with a p-value of 0.01 and z-score of 1 are shown. (0.04 MB DOC) REFERENCES [1] Fields S Sternglanz R 1994 The two-hybrid system: an assay for protein-protein interactions. Trends Genet 10 282 292 [2] Cagney G Uetz P Fields S 2000 High-throughput screening for protein-protein interactions using two-hybrid assay Methods. Enzymol 328 3 14 [3] You X Nguyen AW Jabaiah A Sheff MA Thorn KS 2006 Intracellular protein interaction mapping with FRET hybrids. Proc Natl Acad Sci USA 103 18458 18463 [4] Gavin A Bosche M Krause R Grandi P Marzioch M 2002 Functional organization of the yeast proteome by systematic analysis of protein complexes. Nature 415 141 147 [5] Lee TI Rinaldi NJ Robert F Odom DT Bar-Joseph Z 2002 Transcriptional Regulatory Networks in Saccharomyces cerevisiae . Science 298 799 804 [6] Csete ME Doyle JC 2002 Reverse Engineering of Biological Complexity. Science 295 1664 1669 [7] Kitano H 2004 Biological robustness. Nat Rev Genet 5 826 837 [8] Csete M Doyle J 2004 Bow ties, metabolism and disease. Trends Biotechnol 22 446 450 [9] Stelling J Sauer U Szallasi Z Doyle FJ III Doyle J 2004 Robustness of cellular function. Cell 118 675 685 [10] Carlson J Doyle J 2002 Complexity and robustness. Proc Natl Acad Sci U S A 99 2358 2545 [11] Venkatasubramanian V Katare S Patkar PR Mu FP 2004 Spontaneous emergence of complex optimal networks through evolutionary adaptation. Comput Chem Eng 28 1789 1798 [12] You L Yin J 2006 Evolutionary design on a budget: robustness and optimality of bacteriophage T7. IEE Proc Sys Biol 153 46 52 [13] Alon U Surette MG Barkai N Leibler S 1999 Robustness in bacterial chemotaxis. Nature 397 168 171 [14] Sherr CJ 1996 Cancer Cell Cycles. Science 274 1672 1677 [15] Cho KH Shin SY Kolch W Wolkenhauer O 2003 Experimental Design in Systems Biology, Based on Parameter Sensitivity Analysis Using a Monte Carlo Method: A Case Study for the TNFá-Mediated NF-â-Signal Transduction Pathway. Simul-Trans Soc Model Simul Int 79 726 739 [16] Eissing T Allgöwer F Bullinger E 2005 Robustness properties of apoptosis models with respect to parameter variations and intrinsic noise. IEE Proc Sys Biol 152 221 228 [17] Stelling J Gilles ED Doyle FJ III 2004 Robustness properties of circadian clock architectures. Proc Natl Acad Sci U S A 101 13210 13215 [18] Mahdavi A Davey RE Bhola P Yin T Zandstra PW 2007 Sensitivity Analysis of Intracellular Signaling Pathway Kinetics Predicts Targets for Stem Cell Fate Control. PLoS Comput Biol 3 1257 1267 [19] Luan D Zai M Varner J 2007 Computationally Derived Points of Fragility of a Human Cascade are Consistent with Current Therapeutic Strategies. PLoS Comput Biol 3 1347 1359 [20] Kholodenko BN Kiyatkin A Bruggeman FJ Sontag E Westerhoff HV 2002 Untangling the wires: a strategy to trace functional interactions in signaling and gene networks. Proc Natl Acad Sci U S A 99 12841 12846 [21] Kremling A Fischer S Gadkar K Doyle FJ III Sauter T 2004 A Benchmark for Methods in Reverse Engineering and Model Discrimination: Problem Formulation and Solutions. Genome Res 14 1773 1785 [22] Gadkar KG Varner J Doyle FJ III 2005 Model identification of signal transduction networks from data using a state regulator problem. IEE Proc Syst Biol 2 17 30 [23] Gadkar KG Gunawan R Doyle FJ III 2005 Iterative approach to model identification of biological networks. BMC Bioinformatics 6 155 175 [24] Gutenkunst RN Waterfall JJ Casey FP Brown KS Myers CR 2007 Universally Sloppy Parameter Sensitivities in Systems Biology. PLoS Comput Biol 3 e198 [25] Dougherty EP Rabitz H 1979 A computational algorithm for the Green's function method of sensitvity analysis in chemical kinetics. Int J Chem Kinet 11 1237 1248 [26] Kramer MA Rabitz H Calo JM Kee RJ 1984 Sensitivity analysis in chemical kinetics: Recent developments and computational comparisons. Int J Chem Kinet 16 559 578 [27] Leis JR Kramer MA 1985 Sensitivity analysis of systems of differential and algebraic equations. Comput Chem Eng 9 93 96 [28] Gunawan R Cao Y Petzold L Doyle FJ III 2005 Sensitivity Analysis of Discrete Stochastic Systems. Biophys J 88 2530 2540 [29] Kitano H 2007 A robustness based approach to systems-oriented drug design. Nat Rev Drug Discov 6 202 210 [30] Aguda BD 1999 A qualitative analysis of the kinetics of the G2 DNA damage checkpoint system. Proc Natl Acad Sci U S A 96 11352 11357 [31] Qu Z Weiss JN MacLellan WR 2003 Regulation of the mammalian cell cycle: a model of the G1-to-S transition. Am J Physiol-Cell Physiol 284 C349 C364 [32] Novak M Tyson JJ 2004 A model for restriction point control of the mammalian cell cycle. J Theor Biol 230 563 579 [33] Aguda BD Tang Y 1999 The kinetic origins of the restriction point in the mammalian cell cycle. Cell Proliferation 32 321 335 [34] Aguda BD 1999 Instabilities in phosphorylation-dephosphorylation cascades and cell cycle checkpoints. Oncogene 18 2846 2851 [35] Boutros R Lobjois V Ducommun B 2007 CDC25 phosphatases in cancer cells: key players? Good targets? Nat Rev Cancer 7 495 507 [36] Kar S Wang MF Yao W Michejda CJ Carr BI 2006 PM-20, a novel inhibitor of Cdc25A, induces extracellular signal-regulated kinase 1/2 phosphorylation and inhibits hepatocellular carcinoma growth in vitro and in vivo . Mol Cancer Ther 5 1511 1519 [37] Brezak MC Quaranta M Contour-Galcera MO Lavergne O Mondesert O 2005 Inhibition of human tumor cell growth in vivo by an orally bioavailable inhibitor of CDC25 phosphatases. Mol Cancer Ther 4 1378 1387 [38] Tamura K Southwick EC Kerns J Rosi K Carr BI 2000 Cdc25 Inhibition and Cell Cycle Arrest by a Synthetic Thioalkyl Vitamin K Analogue 1. Cancer Res 60 1317 1325 [39] Schwartz GK Shah MA 2005 Targeting the Cell Cycle: A New Approach to Cancer Therapy. J Clin Oncol 23 9408 9421 [40] McCormick J Gadgeel S Helmke W Chaplen R van Leeuwen B 2003 Phase I study of BMS-387032, a cyclin dependent kinase (CDK) 2 inhibitor. Proc Am Soc Clin Oncol 22 208 [41] Senderowicz AM 1999 Flavopiridol: the First Cyclin-Dependent Kinase Inhibitor in Human Clinical Trials. Invest New Drugs 17 313 320 [42] NCI 2007 A Phase II Study of Flavopiridol (HMR 1275; NSC 649890) in Patients With Previously Untreated Metastatic or Locally Advanced Soft Tissue Sarcoma (Trial NCT00005974). [43] NCI 2007 A Pilot Study of Flavopiridol Administered as a 30-Minute Bolus Followed by a 4-Hour Infusion in Lymphomas and Multiple Myeloma (Trial NCT00112723). [44] NCI 2007 A Phase I Study Of Herceptin/Flavopiridol In HER-2 Positive Metatatic Breast Cancer (Trial NCT00039455). [45] NCI 2007 Flavopiridol Plus Cisplatin or Carboplatin in Treating Patients With Advanced Solid Tumors (Trial NCT00003690). [46] NCI Phase I Dose-Finding Study of E7070 in Combination With Irinotecan (Trial NCT00060567) [47] Van Kesteren C Beijnen JH Schellens JHM 2002 E7070: a novel synthetic sulfonamide targeting the cell cycle progression for the treatment of cancer. Anti-Cancer Drugs 13 989 997 [48] NCI 2007 Phase II Clinical Evaluation of BRYOSTATIN 1 in Patients with Relaped Multiple Myeloma (Trial NCT00002907). [49] Varterasian ML Mohammad RM Eilender DS Hulburd K Rodriguez DH 1998 Phase I study of bryostatin 1 in patients with relapsed non-Hodgkin's lymphoma and chronic lymphocytic leukemia. J Clin Oncol 16 56 62 [50] Hornung RL Pearson JW Bechwith M Longo DL 1992 Preclinical evaluation of bryostatin-1 as an anticancer agent against several murine tumor cell lines: in vitro versus in vivo activity. Cancer Res 52 101 107 [51] Asiedu C Biggs J Lilly M Kraft AS 1995 Inhibition of leukemic cell growth by the protein kinase C activator bryostatin 1 correlates with the dephosphorylation of cyclin dependent kinase 2. Cancer Res 55 3716 3720 [52] Hayun M Okun E Hayun R Gafter U Albeck M 2007 Synergistic effect of AS101 and Bryostatin-1 on myeloid leukemia cell differentiation in vitro and in an animal model. Leukemia 21 1504 1513 [53] Richter JD Sonenberg N 2005 Regulation of cap-dependent translation by eIF4E inhibitory proteins. Nature 433 477 480 [54] Li BDL Liu L Dawson M De Benedetti A 1997 Overexpression of eukaryotic initiation factor 4 E(eIF4E) in breast carcinoma. Cancer 79 2385 2390 [55] Soderlund G Haarhaus M Chisalita S Arnqvist HJ 2004 Inhibition of puromycin-induced apoptosis in breast cancer cells by IGF-1 occurs simultaneously with increase protein synthesis. Neoplasma 51 1 11 [56] Bjornsti MA Houghton PJ 2004 The TOR pathway: a target for cancer therapy. Nat Rev Cancer 4 335 348 [57] Houchens DP Ovejera AA Riblet SM Slagel DE 1983 Human brain tumor xenografts in nude mice as a chemotherapy model. Eur J Cancer Clin Oncol 19 799 805 [58] Eng CP Sehgal SN Vezina C 1984 Activity of rapamycin (AY-22,989) against transplanted tumors. J Antibiot 37 1231 1237 [59] Atkins MB Hidalgo M Stadler WM Logan TF Dutcher JP 2004 Randomized Phase II Study of Multiple Dose Levels of CCI-779, a Novel Mammalian Target of Rapamycin Kinase Inhibitor, in Patients With Advanced Refractory Renal Cell Carcinoma. J Clin Oncol 22 909 918 [60] Bang S Nagata S Onda M Kreitman RJ Pastan I 2005 HA22 (R490A) is a recombinant immunotoxin with Increased Antitumor Activity without and increase in Animal Toxicity. Clin Cancer Res 11 1545 1550 [61] Glotzer M Murray AW Kirschner MW 1991 Cyclin is degraded by the ubiquitin pathway. Nature 349 132 138 [62] Nalepa G Rolfe M Harper JW 2006 Drug discovery in the ubiquitin– proteasome system. Nat Rev Drug Discov 5 596 613 [63] Nakayama KI Nakayama K 2006 Ubiquitin ligases - cell-cycle control and cancer. Nat Rev Cancer 6 369 381 [64] Hershko A Heller H Elias S Ciechanover A 1983 Components of ubiquitin-protein ligase system. Resolution, affinity purification, and role in protein breakdown. J Biol Chem 258 8206 8214 [65] Harper JW Burton JL Solomon MJ 2002 The anaphase promoting complex - Its not just for mitosis any more. Genes Dev 16 2179 2206 [66] Castro A Bernis C Vigneron S Labbe JC Lorca T 2005 The anaphase-promoting complex - a key factor in the regulation of cell-cycle. Oncogene 24 314 325 [67] Garber K 2005 Missing the Target - Ubiquitin Ligase Drugs Stall. J Natl Cancer Inst 97 166 167 [68] Vassilev LT Vu BT Graves B Carvajal D Podlaski F 2004 In Vivo Activation of the p53 Pathway by Small-Molecule Antagonists of MDM2. Science 303 844 848 [69] Koff A Giordano A Desai D Yamashita K Harper JW 1992 Formation and activation of a cyclin E-cdk2 complex during the G1 phase of the human cell cycle. Science 257 1689 1694 [70] Ohtsubo M Theodoras AM Schumacher J Roberts JM Pagano M 1995 Human cyclin E, a nuclear protein essential for the G1-to-S phase transition. Mol Cell Biol 15 2612 2624 [71] Lukas J Herzinger T Hansen K Moroni MC Resnitzky D 1997 Cyclin E-induced S phase without activation of the pRb/E2F pathway. Genes Dev 11 1479 1492 [72] Keyomarsi K Conte D Toyofuku W Fox MP 1995 Deregulation of cyclin E in breast cancer. Oncogene 11 941 950 [73] Porter DC Zhang N Danes C McGahren MJ Harwell RM 2001 Tumor-specific proteolytic processing of cyclin E generates hyperactive lower-molecular-weight forms. Mol Cell Biol 21 6254 6269 [74] Geng Y Whoriskey W Park MY Bronson RT Medema RH 1999 Rescue of cyclin D1 deficiency by knocking cyclin E. Cell 97 767 777 [75] Ortega S Prieto I Odajima J Martín A Dubus P 2003 Cyclin-dependent kinase 2 is essential for meiosis but not for mitotic cell division in mice. Nature Genet 35 25 31 [76] Cote RJ Dunn MD Chatterjee SJ Stein JP Shi SR 1998 Elevated and Absent pRb Expression Is Associated with Bladder Cancer Progression and Has Cooperative Effects with p53. Cancer Res 58 1090 1094 [77] Lukas J Petersen BO Holm K Bartek J Helin K 1996 Deregulated expression of E2F family members induces S-phase entry and overcomes p16INK4A-mediated growth suppression. Mol Cell Biol 16 1047 1057 [78] Keenan SM Lents NH Baldassare JJ 2004 Expression of Cyclin E Renders Cyclin D-CDK4 Dispensable for Inactivation of the Retinoblastoma Tumor Suppressor Protein, Activation of E2F, and G1-S Phase Progression. J Biol Chem 279 5387 5396 [79] Fredersdorf S Burns J Milne AM Packham G Fallis L 1997 High level expression of p27kip1 and cyclin D1 in some human breast cancer cells: Inverse correlation between the expression of p27kip1 and degree of malignancy in human breast and colorectal cancers. Proc Natl Acad Sci U S A 94 6380 6385 [80] Donnellan R Chetty R 1998 Cyclin D1 and human neoplasia. J Clin Pathol 51 1 7 [81] Sicinski P Donaher JL Parker SB Li T Fazeli A 1995 Cyclin D1 provides a link between development and oncogenesis in the retina and the breast. Cell 82 621 630 [82] Ciemerych MA Kenney AM Sicinska E Kalaszczynska I Bronson RT 2002 Development of mice expressing a single D-type cyclin. Genes Dev 16 3277 3289 [83] Sicinski P Donaher JL Geng Y Parker SB Gardner H 1996 Cyclin D2 is an FSH-responsive gene involved in gonadal cell proliferation and oncogenesis. Nature 384 470 474 [84] Kozar K Ciemerych MA Rebel VI Shigematsu H Zagozdzon A 2004 Mouse Development and Cell Proliferation in the Absence of D-Cyclins. Cell 118 477 491 [85] Gunawan R Doyle FJ III 2006 Isochron-based Phase Response Analysis of Circadian Rhythms. Biophys J 91 2131 2141 [86] Gunawan R Doyle FJ III 2007 Phase sensitivity analysis of circadian rhythm entrainment. J Biol Rhythms 22 180 194 [87] Bresalier RS Sandler RS Quan H Bolognese JA Oxenius B 2005 Cardiovascular Events Associated with Rofecoxib in a Colorectal Adenoma Chemoprevention. Trial N Engl J Med 352 1092 1102 [88] Newsam GN Ramsdell JD 1983 Estimation of Sparse Jacobian Matrices. Siam J Alg Disc Meth 4 404 418 [89] Welch BL 1947 The generalization of students problem when several different population variances are involved. Biometrika 34 28 35 [90] Kanungo T Mount DM Netanyahu NS Piatko CD Silverman R 2002 An efficient k-means clustering algorithm: Analysis and implementation. IEEE Trans Pattern Anal Mach Intell 24 881 892