ParetoEnsembles.jl: A Julia Package for Multiobjective Parameter Estimation Using Pareto Optimal Ensemble Techniques
Jeffrey D. Varner · 2026
Read ParetoEnsembles.jl: A Julia Package for Multiobjective Parameter Estimation Using Pareto Optimal Ensemble Techniques by Jeffrey D. Varner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29986.txt.
Introduction
Varner presents ParetoEnsembles.jl, a Julia package for fitting models against several goals at once. A single best fit hides trade-offs when datasets conflict. His package builds ensembles that map those trade-offs instead. Its simulated annealing method needs no gradient data. Fixes include strict Pareto dominance and cheaper ranking steps. Multi-chain parallel runs widen front coverage. Tests cover gene expression and blood clotting models. Held-out clotting data is predicted within ten percent.
Catalog record
| CREATOR | Jeffrey D. Varner |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66784 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.29986
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ParetoEnsembles.jl: A Julia Package for Multiobjective Parameter Estimation Using Pareto Optimal Ensemble Techniques Jeffrey D. Varner Abstract Mathematical models of natural and man-made systems often have many adjustable parameters that must be estimated from multiple, potentially conflicting datasets. Rather than reporting a single best-fit parameter vector, it is often more informative to generate an ensemble of parameter sets that collectively map out the trade-offs among competing objectives. This paper presents ParetoEnsembles.jl, an open-source Julia package that generates such ensembles using Pareto Optimal Ensemble Techniques (POETs), a simulated-annealing-based algorithm that requires no gradient information. The implementation corrects the original dominance relation from weak to strict Pareto dominance, reduces the per-iteration ranking cost from O ( n 2 m ) O(n^{2}m) to O ( n m ) O(nm) through an incremental update scheme, and adds multi-chain parallel execution for improved front coverage. We demonstrate the package on a cell-free gene expression model fitted to experimental data and a blood coagulation cascade model with ten estimated rate constants and three objectives. A controlled synthetic-data study reveals parameter identifiability structure, with individual rate constants off by several-fold yet model predictions accurate to 6–7%. A five-replicate coverage analysis confirms that timing features are reliably covered while peak amplitude is systematically overconfident. Validation against published experimental thrombin generation data demonstrates that the ensemble predicts held-out conditions to within 1–10% despite inherent model approximation error. By making ensemble generation lightweight and accessible, ParetoEnsembles.jl aims to lower the barrier to routine uncertainty characterization in mechanistic modeling. Keywords: multiobjective optimization, Pareto front, simulated annealing, ensemble methods, parameter estimation, uncertainty characterization 1 Introduction Mathematical models of biological and engineering systems typically contain many adjustable parameters that must be estimated from experimental data. When multiple datasets measure different aspects of the same system (for example, mRNA and protein concentrations in a gene expression circuit, or yield and selectivity in a reactor), calibrating parameters to one dataset often degrades the fit to another. This gives rise to a multiobjective optimization (MOO) problem [ 20 , 12 , 8 ] . Compounding this difficulty, many models exhibit “sloppy” parameter sensitivities: broad, flat valleys in objective space where large regions of parameter space produce nearly equivalent fits [ 16 ] . In such settings, a single best-fit parameter vector gives no indication of how tightly the data actually constrain the parameters; instead, one needs an ensemble of parameter sets that collectively map out the trade-offs among competing objectives. The boundary of this ensemble in objective space is the Pareto front, the set of solutions for which no objective can be improved without degrading at least one other, and the full cloud of near-optimal solutions surrounding it characterizes the range of model behaviors consistent with the available data. Several algorithm families have been developed to approximate Pareto fronts. Population-based evolutionary methods maintain a generation of candidate solutions that are selected, recombined, and mutated toward the front. Prominent examples include the Non-dominated Sorting Genetic Algorithm II (NSGA-II) [ 11 ] , its many-objective successor NSGA-III [ 10 ] , and the Multiobjective Evolutionary Algorithm Based on Decomposition (MOEA/D), which decomposes the MOO problem into a set of scalar subproblems solved cooperatively [ 23 ] . An alternative trajectory-based strategy is multiobjective simulated annealing (SA), which extends the classical SA framework [ 18 ] to multiple objectives by using Pareto dominance to guide acceptance decisions; early formulations include the Pareto SA method of Czyżak and Jaszkiewicz [ 9 ] and the Archived Multiobjective Simulated Annealing (AMOSA) algorithm of Bandyopadhyay et al. [ 2 ] . Pareto Optimal Ensemble Techniques (POETs), introduced by Song et al. [ 22 ] and later implemented in the Julia programming language by Bassen and colleagues [ 3 ] , belongs to this SA-based family. The POETs algorithm ranks the current archive by counting how many other solutions dominate each candidate, then uses the rank as the energy in a Metropolis-type acceptance criterion. Mature software implementations of these and related algorithms are available in several languages, including pymoo in Python [ 5 ] and Metaheuristics.jl in Julia [ 19 ] , both of which focus primarily on population-based evolutionary strategies. A complementary approach to characterizing parametric uncertainty is Bayesian inference, where Markov chain Monte Carlo (MCMC) or sequential Monte Carlo (SMC) methods sample from the posterior distribution over parameters given the data. Widely used implementations include Stan [ 7 ] , Turing.jl [ 15 ] , and the ensemble MCMC sampler emcee [ 14 ] . While Bayesian methods provide a formal probabilistic interpretation of parameter uncertainty, they require specification of prior distributions and a scalar likelihood, scale poorly with the number of objectives, and can be expensive for stiff ODE models. On the other hand, multiobjective ensemble methods such as POETs offer a lightweight alternative that naturally handles multiple competing objectives and returns a cloud of near-optimal solutions without requiring probabilistic modeling assumptions. In this study, we present ParetoEnsembles.jl, a substantially rewritten Julia implementation of the POETs algorithm [ 22 , 3 ] . The package takes a user-defined model and a set of objective functions, each measuring how well a candidate parameter vector reproduces a particular dataset, and returns a collection of parameter sets spanning the trade-off surface, along with their objective values and dominance ranks. Several algorithmic corrections and improvements have been made relative to the original implementation: the dominance check has been corrected from weak to strict Pareto dominance, the per-iteration ranking cost has been reduced from O(n^{2}m) to O(nm) through an incremental update scheme (where n is the archive size and m is the number of objectives), and multi-chain parallel execution has been added to improve front coverage. We demonstrate the package on two biological systems of increasing complexity ( Section 3 ), validate it against standard benchmarks and NSGA-II, and assess hyperparameter sensitivity ( Appendices S4 , S5 and S6 ). By making ensemble generation lightweight and accessible, the package lowers the barrier to routine uncertainty characterization in mechanistic modeling. 2 Methods 2.1 Pareto dominance and ranking Consider an archive of n solutions evaluated on m objectives, where lower values are preferred. Solution \mathbf{x}_{j} strictly dominates solution \mathbf{x}_{i} , written \mathbf{x}_{j}\prec\mathbf{x}_{i} , if and only if f_{k}(\mathbf{x}_{j})\leq f_{k}(\mathbf{x}_{i}) for all k\in\{1,\ldots,m\} and there exists at least one objective k for which f_{k}(\mathbf{x}_{j})<f_{k}(\mathbf{x}_{i}) ( Equation 1 ). The Pareto rank of solution \mathbf{x}_{i} is the number of archive members that strictly dominate it ( Equation 2 ), so that solutions with rank zero lie on the Pareto front and identical solutions, which do not dominate each other under strict dominance, share the same rank. The original POETs implementation [ 22 , 3 ] used weak dominance, checking only that f_{k}(\mathbf{x}_{j})\leq f_{k}(\mathbf{x}_{i}) for all k without requiring strict inequality in at least one objective; under weak dominance, identical solutions count as dominating each other, which inflates their ranks and causes excessive pruning of good solutions from the archive. The current implementation enforces strict Pareto dominance. The pairwise test iterates over objectives with an early-exit condition that terminates as soon as any objective of j is found to be worse than i , avoiding unnecessary comparisons (pseudocode in Algorithm S2 ). f_{k}(\mathbf{x}_{j})\leq f_{k}(\mathbf{x}_{i})\quad\forall\,k\in\{1,\ldots,m\}\qquad\text{and}\qquad\exists\,k:f_{k}(\mathbf{x}_{j})<f_{k}(\mathbf{x}_{i}). (1) R(\mathbf{x}_{i})=\bigl|\{\,j\neq i\mid\mathbf{x}_{j}\prec\mathbf{x}_{i}\,\}\bigr|.