Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions CCS: Information systems Data management systems CCS: Computing methodologies Ensemble methods CCS: Computing methodologies Search methodologies

Yuanhao Lai, Pengfei Zheng, Chenpeng Ji, Yan Li, Songhan Zhang, Rutao Zhang, Zhengang Wang, Yunfei Du · 2025

Read Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions CCS: Information systems Data management systems CCS: Computing methodologies Ensemble methods CCS: Computing methodologies Search methodologies by Yuanhao Lai, Pengfei Zheng, Chenpeng Ji, Yan Li, Songhan Zhang, Rutao Zhang, Zhengang Wang, Yunfei Du (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22734.txt.

Introduction

Database tuning tools often rely on a Gaussian process model. That model makes strong shape assumptions. Yuanhao Lai leads a team with seven co-authors. In 2025 they argue those assumptions often fail in practice. Tree based models can avoid many of those pitfalls.

Still, tree models have their own limits. They give point estimates with weak uncertainty claims. New boosting methods also stay unused. The team proposes Centrum to fix these gaps. It aims for better surrogate modeling of database speed. Better modeling should guide tuning choices more soundly. The goal is faster, more effective auto tuning.

Catalog record

CREATORYuanhao Lai, Pengfei Zheng, Chenpeng Ji, Yan Li, Songhan Zhang, Rutao Zhang, Zhengang Wang, Yunfei Du
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22734

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions CCS: Information systems Data management systems CCS: Computing methodologies Ensemble methods CCS: Computing methodologies Search methodologies Yuanhao Lai, Pengfei Zheng, Chenpeng Ji, Yan Li, Songhan Zhang, Rutao Zhang, Zhengang Wang, Yunfei Du Abstract . Gaussian Process (GP)-based Bayesian optimization (BO), i.e., GP-BO, emerges as a prevailing model-based framework for DBMS (Database Management System) auto-tuning. However, recent work shows GP-BO-based DBMS auto-tuners are significantly outperformed by auto-tuners based on SMAC, which features random forest surrogate models; such results motivate us to rethink and investigate the limitations of GP-BO in auto-tuner design. We find that the fundamental assumptions of GP-BO are widely violated when modeling and optimizing DBMS performance, while tree-ensemble-BOs (e.g., SMAC) can avoid the assumption pitfalls and deliver improved tuning efficiency and effectiveness. Moreover, we argue that existing tree-ensemble-BOs restrict further advancement in DBMS auto-tuning. First, existing tree-ensemble-BOs can only achieve distribution-free point estimates, but still impose unrealistic distributional assumptions on uncertainty (interval) estimates, which can compromise surrogate modeling and distort the acquisition function. Second, recent advances in (ensemble) gradient boosting, which can further enhance surrogate modeling against vanilla GP and random forest counterparts, have rarely been applied in optimizing DBMS auto-tuners. To address these issues, we propose a novel model-based DBMS auto-tuner, Centrum . Centrum achieves and improves distribution-free point and interval estimation in surrogate modeling with a two-phase learning procedure of stochastic gradient boosting ensembles (SGBE). Moreover, Centrum adopts a generalized SGBE-estimated locally-adaptive conformal prediction to facilitate a distribution-free interval (uncertainty) estimation and acquisition function. To our knowledge, Centrum is the first auto-tuner that realizes distribution-freeness to stress and enhance BO’s practicality in DBMS auto-tuning, and the first to seamlessly fuse gradient boosting ensembles and conformal inference in BO. Extensive physical and simulation experiments on two DBMSs and three workloads show that Centrum outperforms 21 state-of-the-art (SOTA) DBMS auto-tuners based on BO with GP, random forest, gradient boosting, OOB (Out-Of-Bag) conformal ensemble and other surrogates, as well as that based on reinforcement learning and genetic algorithms. 1. Introduction Cloud data platforms serve largely diverse data analytics workloads over heterogeneous hardware. Such scale and complexity significantly challenge DBMS performance engineering, as correctly configuring DBMSs to adapt to varied workloads and hardware characteristics is a herculean task. Traditionally, DBMS tuning laboriously relies on DBA (Database Administrator)’s domain knowledge and trial-and-errors. Such human efforts can fail to scale and generalize for tremendous DBMS instances in the cloud. Moreover, modern DBMS is built with multiple hundreds of tunable knobs; the entangled interdependence between knobs and their combinatorially complex impact on DBMS performance severely challenge human reasoning and their final tuning efficacy. To address these problems, and motivated by the viral success of model-based optimization, i.e., Bayesian Optimization (BO) ( Snoek et al. 2012 ; Frazier 2018 ) in real-world applications (e.g., AutoML), database practitioners ( Duan et al. 2009 ; Van Aken et al. 2017 ; Fekry et al. 2020 ; Zhang et al. 2021 ; Kanellis et al. 2022 ; Zhang et al. 2022a ) have initiated a wave of building DBMS auto-tuners with BO-centric techniques. The surrogate model plays a crucial role as it directly influences the effectiveness and efficiency of BO. BO fits a surrogate model to predict the mean (point estimate) and uncertainty (interval estimate) of DBMS performance under different configurations, then with the surrogate model, composes an acquisition function that, in each iteration of trials and errors, suggests the most promising configuration of the highest acquisition value. Acquisition function balances BO’s exploitation and exploration and surrogates’ point and interval estimation accuracy are decisive to BO’s performance. Low point-estimate accuracy of the surrogate model incurs faulty exploitation that misguides the optimizer to erroneously enter regions with less-performant configurations. While low interval(uncertainty)-estimate accuracy incurs blind exploration with either under- or over-confidence. However, existing DBMS auto-tuners, whether they use Gaussian Processes-surrogate-based BO (GP-BO) ( Seeger 2004 ) or tree-ensemble-surrogate-based (tree-ensemble-BO) ( Lindauer et al. 2022 ; Hutter et al. 2011 ; Sprangers et al. 2021 ) , still lack sufficient justification for their selected surrogate models. In this study, we find the accuracy of their surrogates can be severely undermined due to misspecified model assumptions , which fails to meet the intrinsic complex distributional characteristics of real DBMS performance measurements 1 1 1 This study focuses on the surrogate modeling component of existing database auto-tuning systems for DBMS performance. Other components such as knob selection and knowledge transfer, are important but out of the scope. . We detail the limitations of existing DBMS auto-tuners as follows. Limitations of GP-BO-centric DBMS auto-tuners. GP-BO predominately prevails in DBMS auto-tuner design, which includes iTuned ( Duan et al. 2009 ) , OtterTune ( Van Aken et al. 2017 ) , Tuneful ( Fekry et al. 2020 ) , ResTune ( Zhang et al. 2021 ) , OnlineTune ( Zhang et al. 2022b ) , ReLM ( Kunjir and Babu 2020 ) , LlamaTune ( Kanellis et al. 2022 ) , and LOCAT ( Xin et al. 2022 ) . However, Figures 1(a) , 1(b) , 1(c) and 1(d) shows that, in real PostgreSQL (v10.5) tuning, GP-BO’s assumptions, (a) continuity (b) Gaussianaity (c) homoscedasticity and (d) stationarity fail to capture real DBMS performance characteristics that feature continuous-discrete-mixed, arbitrarily-distributed, heteroscedastic, non-stationary and noisy system measurements. Such systematic assumption violation can invalidate GP’s point and interval estimations and undermine the optimization effectiveness as stated by previous studies ( Deshwal et al. 2021 ; wie 2022 ; Cowen-Rivers et al. 2022 ; Snoek et al. 2014 ) . As a result, the R^{2} of GP-surrogate’s point-estimate is as low as 0.1 (cf., Figure 2(a) ; its poorly estimated interval is too loose (cf., Figure 2(b) ), to correctly navigate configuration exploration and severely distorts BO’s acquisition function; finally, inaccurate surrogate modeling results in sub-optimal tuned DBMS performance (cf., Figure 2(c) ). The response surface between throughput measurements from PostgreSQL and different configurations, which shows their relationship is non-continuous and disjoint. (a) Non-Continuity The response surface between throughput measurements from PostgreSQL and different configurations, which shows their relationship is non-continuous and disjoint. The histogram of throughput measurements from PostgreSQL at a given configuration under Sysbench workload, which shows the probability distribution of the performance metric is highly non-Gaussian. (b) Non-Gaussianity The histogram of throughput measurements from PostgreSQL at a given configuration under Sysbench workload, which shows the probability distribution of the performance metric is highly non-Gaussian. The bar chart of standard deviations for throughput measurements from PostgreSQL at different configuration settings under Sysbench Workload, which shows the performance metric is heteroscedastic. (c) Heteroscedasticity The bar chart of standard deviations for throughput measurements from PostgreSQL at different configuration settings under Sysbench Workload, which shows the performance metric is heteroscedastic. (d) Non-stationarity The bar chart of the length scales regarding the parameter shared\_buffers, estimated by RBF kernel, varied by the other parameter wal\_buffers, showing non-stationary characteristics. Figure 1 . Exemplify the violation of Gaussian Process’s assumptions against PostgreSQL-v10.5-Sysbench auto-tuning - (a) non-smooth TPS (Transaction Per Second) surface over varying configurations; - (b) empirical distribution of TPS is strikingly non-Gaussian and multi-modal; - (c) and (d) heterogeneous noise levels and length scales. Motivation examples to show the distributional characteristics of DBMS performance measurements

Read the complete text