Exposure-averaged Gaussian Processes for Combining Overlapping Datasets NestedSamplers.jl ( 31 ) Jacob K. Luhn, Ryan A. Rubenzahl, Samuel Halverson, Lily L. Zhao Abstract Physically motivated Gaussian process (GP) kernels for stellar variability, like the commonly used damped, driven simple harmonic oscillators that model stellar granulation and p-mode oscillations, quantify the instantaneous covariance between any two points. For kernels whose timescales are significantly longer than the typical exposure times, such GP kernels are sufficient. For time series where the exposure time is comparable to the kernel timescale, the observed signal represents an exposure-averaged version of the true underlying signal. This distinction is important in the context of recent data streams from Extreme Precision Radial Velocity (EPRV) spectrographs like fast readout stellar data of asteroseismology targets and solar data to monitor the Sun’s variability during daytime observations. Current solar EPRV facilities have significantly different exposure times per-site, owing to the different design choices made. Consequently, each instrument traces different binned versions of the same “latent” signal. Here we present a GP framework that accounts for exposure times by computing integrated forms of the instantaneous kernels typically used. These functions allow one to predict the true latent oscillation signals and the exposure-binned version expected by each instrument. We extend the framework to work for instruments with significant time overlap (i.e., similar longitude) by including relative instrumental drift components that can be predicted and separated from the stellar variability components. We use Sun-as-a-star EPRV datasets as our primary example, but present these approaches in a generalized way for application to any dataset where exposure times are a relevant factor or combining instruments with significant overlap. show]jacob.luhn@jpl.nasa.gov I Introduction Gaussian processes (GPs) have become a useful tool for characterizing and modeling stellar variability in astronomical time series (see 2 for a thorough review). A GP framework allows one to model stochastic signals in a flexible, nonparametric way via a fully Bayesian approach that properly propagates parameter uncertainties. The conditioned posterior specifies the prediction for the mean and Gaussian uncertainties for the latent process (i.e. the “predictive mean” and “predictive variance”) given an observed dataset, providing a powerful framework for predicting future (or past) observations and interpolating between observations via informed models. Modeling the observed manifestations of stellar variability as a GP largely stems from the desire to treat intrinsic stellar “noise” as a stochastic signal that complicates fitting an underlying model of interest, e.g., rotational modulation affecting exoplanet transit models (transit depth/ planet radius) ( 7 ; 19 ; 4 , e.g.) , or radial velocity (RV) curves ( 1 ; 26 ; 44 , e.g.) . In the era of extreme precision radial velocity (EPRV) surveys, using GPs to model stellar variability has become increasingly popular ( 21 ; 28 ; 24 ) . This is because stellar variability represents the largest remaining hurdle to routinely detecting and characterizing low-mass planets in the habitable zones of their host stars ( 9 ) now that existing EPRV spectrographs are approaching or have achieved the required precision and stability ( 48 ; 20 ; 5 ; 41 ) for such detections in the absence of stellar variability ( 32 ) . As a result, characterizing and mitigating stellar variability is an active area of research ( 9 ; 53 ) . One challenging aspect of stellar variability is the multitude of astrophysical sources, each with their own amplitude and timescale ( 33 , e.g.,) . While sources of variability that operate on timescales longer than a day (e.g., rotational modulation from spots/faculae, years-long activity cycles) can be reasonably sampled with existing RV surveys, sources of variability that operate on daily timescales or less (e.g., 12-24 hr supergranulation, hours-long granulation, and minutes-long p-mode oscillations) require significantly higher-cadence observations, which becomes unfeasible for large-scale surveys that target an appreciable number of stars ( 37 ; 32 ) . To combat the challenges of stellar variability, many existing EPRV spectrographs are now equipped with a solar feed that obtains daytime Sun-as-a-star observations ( 12 ; 29 ; 46 ; 30 ) . The solar feeds operate “for free” during the day and, since we can independently precisely and accurately remove the RV signals due to solar system planets, provide high-cadence time series of purely solar variability and instrumental drift. Consequently, these data streams do not suffer from the same limitations in terms of cadence as nighttime data, and as a result have been extremely valuable for studying solar signals ( 34 ; 27 ; 17 ; 39 , see, e.g.,) . Solar feeds now exist on the High-Accuracy Radial-velocity Planet Searcher (HARPS), the High-Accuracy Radial-velocity Planet Searcher in the North ( 43 , HARPS-N;) , the EXtreme PREcision SPectrograph ( 30 , EXPRES;) , the NEID spectrograph ( 29 ) , and the Keck Planet Finder ( 46 , KPF;) . The earliest solar telescope on-sky, feeding into HARPS-N, was commissioned in 2015. Typical exposure times for the different solar feeds can vary from five seconds to over five minutes. The solar datasets are even more useful in combination. The longitudinal distribution of existing solar telescopes results in a 15-hour continuous segment of solar data from UT0900 (HARPS-N) to UT2400 (EXPRES) in the summer, with multiple instances of overlapping coverage between instruments 1 1 1 In the winter, the continuous segment is reduced to 11 hours from UT1100 (HARPS-N) to UT2200 (KPF). Note that KPF does not currently operate in the afternoon; extending KPF solar observations into the afternoons would result in 19-hour segments in the summer and 15-hour segments in the winter. . In some cases, instruments at nearly the same longitude yield completely overlapping datasets, though of course the continuous coverage and overlap will vary day to day due to weather conditions at each location. The overlap between successive and co-located instruments adds an additional use case beyond studying stellar variability: the ability to perform cross-instrument comparisons. 52 provided the first attempt to combine solar data from multiple instruments to perform such cross-comparisons. Another recent cross-instrument comparison in 46 examined the newly commissioned KPF/SoCal observations against NEID. However, these combined analyses require some care, as not all spectrographs observe with the same cadence and exposure times. HARPS-N and EXPRES observations have exposure times on the order of minutes (roughly 5 and 3 minutes respectively) while HARPS, NEID, and KPF have sub-minute exposure times (30 s, 55 s, and 12 s respectively). To address the different exposure times and time stamps, 52 binned all observations onto common time stamps with 16.2-minute-wide bins spaced by 5.4 minutes. As a result, the time series of the combined data set was insensitive to the shortest-period sources of variability, namely p-mode oscillations and the high-frequency tail of granulation. Given the higher cadence and shorter exposures of KPF and NEID, 46 used a cubic Hermite spline to interpolate the faster-cadence KPF data at the NEID timestamps to compute relative residuals between instruments. While sufficient for comparing instrument performance between KPF and NEID, such interpolation schemes are not informed by physically motivated processes, nor can they be extended to compare two data sets with significantly different exposure times, where each instrument will trace different exposure-averaged manifestations of the true underlying signal. Here we aim to build on these previous two analyses with a more robust framework that leverages the capabilities of GP modeling. We will start with physically motivated kernels for stellar variability that have been used extensively in the literature ( 18 ; 42 ; 22 ; 32 ; 23 ) . Importantly, these GP kernels represent the instantaneous covariance functions, and thus do not contain exposure-time information. Naively combining datasets from multiple instruments with different exposure times using such kernels will introduce spurious signals, since the GP model cannot reconcile two closely spaced observations that have significant, real RV differences from their different exposure times. Instead, we will build a GP framework from the integrated GP kernels that properly accounts for the effects of finite exposure times to predict the common latent process uniquely traced by each instrument. The manuscript is laid out as follows. In Section II , we provide an overview of GPs and their limitations when considering exposure-time effects. In Section III , we describe the ingredients necessary to build a GP framework that accounts for exposure-time effects, and provide the analytic functions for the integrated forms of the typical damped and driven Simple Harmonic Oscillator (SHO) kernels used to model astrophysical stellar granulation and p-mode oscillations. Section IV reviews the methodology for decomposing a multicomponent GP model into its individual components. Building toward a full GP model to combine solar EPRV datasets from multiple instruments, Section V introduces the framework for accounting for instrumental drifts between each spectrograph. We put these pieces together into a full model with synthetic data as a proof of concept in Section VI , and in Section VII we apply it to two cases of real solar data. We finish with some possible applications of exposure-time-informed GP kernels to other domains in Section VIII , discuss current limitations and next steps in Section IX , and summarize our conclusions in Section X . II Gaussian Process Notation A Gaussian process is a stochastic process where the joint probability distribution of a set of \bm{y}=\left\{y_{i}\right\}_{i=1...N} is a Gaussian distribution p(\bm{y})=\mathcal{N}(\bm{m},\mathbf{K}), (1) where \bm{m} is the mean vector given by the mean function {m}_{i}=m(x_{i},\bm{\theta}) and \mathbf{K} is the covariance matrix defined by the kernel function K_{i,j}=k(x_{i},x_{j},\bm{\phi}) . In this case, x_{i} is the input independent variable corresponding to the i^{\rm th} sample, t_{i} in time series data. While the mean function m can be any function, the kernel function k and its hyperparameters \bm{\phi} are what define the GP; considerable care must be taken when choosing a kernel function, as it must produce a positive definite covariance matrix. As such, one typically chooses from a family of established kernel functions (squared exponential, periodic, Matérn, etc.). Conveniently, any affine transformation of a positive-definite kernel results in another positive-definite kernel, so custom kernels can be created from sums and products of these “base” kernels. The mean function, \bm{m} can often be a constant or even zero (e.g., “zero mean” when modeling data solely with a GP). However, GPs are also typically used to model a “nuisance signal” (or a sum of multiple such signals) that contaminates the actual signal of interest ( 45 ) , such as the case of modeling stellar variability as a GP when fitting a Keplerian model to RV data. In that case, the Keplerian model is the mean function. In addition to using GP regression to estimate the hyperparameters of the mean and kernel functions ( \bm{\hat{\theta}} , \bm{\hat{\phi}} , respectively), GPs allow us to predict behavior at any set of test points using conditional probabilities. Using the example of time series data, given a set of noisy observations \bm{y} at times \bm{t} with measurement uncertainties \bm{\sigma} , the behavior at a new set of times, t_{\ast} , is a Gaussian \bm{y}_{{\ast}}\mid\bm{y}=\mathcal{N}(\bm{\mu}_{\rm{\ast}},\mathbf{C}_{\rm{\ast}}) (2) with mean \bm{\mu}_{\rm{\ast}}=\bm{m}_{\rm{\ast}}+\mathbf{K}_{\rm{\ast}}^{\intercal}\left(\mathbf{K}+\mathbf{R}\right)^{-1}(\bm{y}-\bm{m}) (3) and covariance \mathbf{C}_{\ast}=\mathbf{K}_{\ast\ast}-\mathbf{K}_{\rm{\ast}}^{\intercal}\left(\mathbf{K}+\mathbf{R}\right)^{-1}\mathbf{K}_{\rm{\ast}}, (4) where \mathbf{R} is the noise matrix containing the measurement variances and is most often diagonal, (e.g., \mathbf{R}\equiv\bm{\sigma}\mathbf{I} ). Here we have used \ast notation such that \bm{m}_{\ast}\equiv m(\bm{t}_{\ast},\bm{\theta}) , that is, the mean function evaluated at test points \bm{t_{\ast}} , and \mathbf{K}_{\ast} is the covariance between input observations and the test points \left[K_{\ast}\right]_{i,j}\equiv k(t_{i},t_{\ast,j};\bm{\phi}). (5) Likewise \mathbf{K}_{\ast\ast} is the covariance between all pairs of test points \left[K_{\ast\ast}\right]_{i,j}\equiv k(t_{\ast,i},t_{\ast,j};\bm{\phi}). (6) III Kernel Integration Framework III.1 Requisite Kernel Integrations Here we closely follow the steps outlined by 50 to describe the ingredients necessary for a Gaussian process framework to predict a latent function from binned data. We begin with the knowledge that our observed data come from an integration over a latent function f(t) , which we wish to predict. We assume a function F(t_{1},t_{2}) describes the integral of f(t) between time t_{1} and t_{2} , which for example represent the start and stop times of an exposure. Then our observations y(t_{1},t_{2}) are noisy samples of F(t_{1},t_{2}) . We can therefore construct a Gaussian process from which f(t) and F(t_{1},t_{2}) are jointly drawn. The Gaussian process posterior can be constructed for expressions for the covariance between f(t) and f(t^{\prime}) (covariance of the latent function), F(t_{1},t_{2}) and F(t_{1}^{\prime},t_{2}^{\prime}) (the covariance between integrated observations), and the cross-covariance between the latent function and the integrated observation F(t_{1},t_{2}) and f(t^{\prime}) . For now, we ignore the exact form of the kernel function and describe the requisite integrals needed. We assume we have a GP kernel to describe the ‘latent’ function k_{ff}(t,t^{\prime}) . As shown in 50 , our observations, which come from F(t_{1},t_{2})=\int_{t_{1}}^{t_{2}}f(t)dt is also a GP with covariance described by the integrated latent kernel k_{FF}((t_{1},t_{2}),(t_{1}^{\prime},t_{2}^{\prime}))=\int_{t_{1}}^{t_{2}}\int_{t_{1}^{\prime}}^{t_{2}^{\prime}}k_{ff}(t,t^{\prime})dt^{\prime}dt. (7) The cross covariance between an observation and the latent function is similarly k_{Ff}((t_{1},t_{2}),(t^{\prime}))=\int_{t_{1}}^{t_{2}}k_{ff}(t,t^{\prime})dt. (8) With the necessary covariance functions defined, we can evaluate the covariance matrix in the case of a latent function conditioned on a set of exposure-integrated observations. In the next sections, we will outline an algorithm for evaluating k_{FF} and k_{Ff} for overlapping exposures and provide analytic expressions for these functions in the case of kernels that describe stellar oscillations and granulation. III.2 Sub-exposure decomposition Before we derive the integrated kernel functions for specific latent kernels, it is important to consider how we plan to evaluate Equation 7 & Equation 8 for a given set of observations. The most common GP kernels are stationary; they only depend on the absolute time difference |t-t^{\prime}| . We must therefore handle the integrals with care to account for the sign flip between tt^{\prime} . These special cases occur any time we wish to evaluate the integral for a time that is within one of the observations, for example evaluating k_{FF} in the case of two observations with partial or complete overlap, or when evaluating k_{Ff} to predict the latent function during one of the observations. We note that the case of overlapping observations will always occur when evaluating the diagonal of the covariance matrix (the covariance between each observation and itself) even in a time series of observations from a single data stream of sequential observations. The double integral k_{FF} is simply a function of the two exposure times \delta_{i} , \delta_{j} and the time separation between observations \Delta . We define k_{FF,\rm{overlap}}(\delta_{i}=\delta_{j}\equiv\delta,\Delta=0) and k_{FF,\rm{separate}}\left(\delta_{i},\delta_{j},\Delta>(\delta_{i}+\delta_{j})/2\right) as the functions describing completely overlapping and completely separate observations, respectively. Still assuming stationary kernels, k_{FF} is invariant to t\leftrightarrow t^{\prime} , and so for simplicity, we redefine i and j such that \delta_{i}>\delta_{j} (i.e., observation i is the longer of the two exposures), and we define a coordinate system such that observation i begins at time t=0 (and therefore ends at t=\delta_{i} ). Any two observations i,j will therefore fall into 1 of 4 cases: 1) completely overlapping, 2) completely separate, 3) partially overlapping, 4) observation j is within observation i . The full integral k_{FF} for each of these cases can be decomposed into a sum of k_{FF,\rm{overlap}} and k_{FF,\rm{separate}} , as illustrated in Figure 1 . Figure 1: When computing the double integral k_{FF} , any two exposures can be decomposed into a sum of perfectly overlapping and separate sub-exposures; each sub-integral is evaluated with newly defined exposure times ( \delta s) and time separations ( \Delta s). Note that to compute the sum of the three sub-integrals, one must first multiply each sub-integral by the product of the two sub-exposure times before summing, and finally dividing by the original exposure time product to obtain the final result. For example, in Case 3, the total integral k_{FF}(\delta_{1},\delta_{2},\Delta)=1/({\delta_{1}\delta_{2}})\left(k_{FF,sep}(\delta_{a1},\delta_{a2},\Delta_{a})*\delta_{a1}\delta_{a2}+k_{FF,over}(\delta_{b})*\delta_{b}^{2}+k_{FF,sep}(\delta_{c1},\delta_{c2},\Delta_{c})*{\delta_{c1}\delta_{c2}}\right) . The single integral k_{Ff} follows a similar approach, however in this case we only need to derive one integrated function, and we have chosen to assume t>t^{\prime} . We again note that it is t\leftrightarrow t^{\prime} invariant, and thus, the single integrated function only depends on the exposure time \delta , and a time separation (the difference between the center of the observation and the time at which the latent kernel is being evaluated), \Delta . If evaluating k_{Ff} for a time t^{\prime} within an exposure, the integral is simply split into two sub-integrals at t^{\prime} , redefining \delta and \Delta for the left and right portions in turn, and summing each portion. III.3 Integrating the SHO Kernel Here we provide the analytic expressions for the integrated kernels where the latent kernel is a stochastically driven, damped simple harmonic oscillator (SHO). This choice of kernel is ideal for modeling convectively driven stellar processes like granulation and p-mode oscillations ( 18 ; 42 ; 32 ) . In particular, when the oscillator strength is sufficiently large, ( Q>1/2 ), the kernel takes the form: k_{ff}^{\rm{SHO}}(\Delta)=S_{0}\omega_{0}Q\,e^{-\frac{\omega_{0}\Delta}{2Q}}\left(\cos{\left(\eta\omega_{0}\Delta\right)}+\frac{1}{2\eta Q}\sin{\left(\eta\omega_{0}\Delta\right)}\right) (9) where \Delta is the the absolute value of the time between observations, \omega_{0} is the characteristic frequency of the undamped oscillator, S_{0} is proportional to the power of the spectrum at \omega=\omega_{0} , Q is the quality factor, and \eta=|1-(4Q^{2})^{-1}|^{1/2} . For the cross-covariance, the single integral of the latent kernel is k_{Ff}^{\rm{SHO}}(\delta,\Delta)=\frac{1}{\delta}\int_{0}^{\delta}k_{ff}^{\rm{SHO}}(\Delta)\,d\Delta=\left(\frac{-S_{0}Q}{\delta\eta}\right)\left(\frac{1}{1+a^{2}}\right)\,\,I_{0}^{\rm{SHO}}(u_{1},u_{2}), (10) where a=1/(2Q\eta) and we have defined the helper equation I_{0}^{\rm{SHO}}(u_{a},u_{b})=e^{-au}\left[\left(1-a^{2}\right)\sin{u}-2a\cos{u}\right]\Big|_{u=u_{a}}^{u=u_{b}} (11) with bounds u_{1}=\eta\omega_{0}\left(\Delta+\frac{\delta}{2}\right)\quad\text{and}\quad u_{2}=\eta\omega_{0}\left(\Delta-\frac{\delta}{2}\right) (12) The double integral of the latent kernel was derived in 32 , which we repeat here for completeness. In the case of perfectly overlapping observations, k_{FF,\rm{overlap}}^{\rm{SHO}}(\delta)=\frac{1}{\delta^{2}}\int_{0}^{\delta}dt^{\prime}\int_{0}^{\delta}k_{ff}^{\rm{SHO}}(t,t^{\prime})\,dt=\frac{2S_{0}Q}{\delta^{2}\eta\left(1+a^{2}\right)}\Big(I_{1}^{\rm{SHO}}\left(u_{1},u_{2}\right)-I_{2}^{\rm{SHO}}\left(u_{1},u_{2}\right)+2a\delta\Big) (13) using helper functions I_{1}^{\rm{SHO}}\left(u_{a},u_{b}\right)=\frac{e^{-au}\left(1-a^{2}\right)}{\eta\omega_{0}\left(1+a^{2}\right)}\left(\cos{u}+a\sin{u}\right)\Big|_{u=u_{a}}^{u=u_{b}} (14) and I_{2}^{\rm{SHO}}\left(u_{a},u_{b}\right)=-\frac{2ae^{-au}}{\eta\omega_{0}\left(1+a^{2}\right)}\left(\sin{u}-a\cos{u}\right)\Big|_{u=u_{a}}^{u=u_{b}} (15) with bounds u_{1}=\eta\omega_{0}\delta\quad\text{and}\quad u_{2}=0 (16) For two completely separate observations, \begin{split}k_{FF,\rm{separate}}^{\rm{SHO}}(\delta_{1},\delta_{2},\Delta)&=\frac{1}{\delta_{1}\delta_{2}}\int_{0}^{\delta_{1}}dt^{\prime}\int_{\frac{\delta_{1}-\delta_{2}}{2}+\Delta}^{\frac{\delta_{1}+\delta 2}{2}+\Delta}k_{ff}^{\rm{SHO}}(t,t^{\prime})\,dt\\ &=\frac{S_{0}Q}{\delta_{1}\delta_{2}\eta\left(1+a^{2}\right)}\Big(I_{1}^{\rm{SHO}}\left(u_{1},u_{2}\right)-I_{2}^{\rm{SHO}}\left(u_{1},u_{2}\right)-I_{1}^{\rm{SHO}}\left(u_{3},u_{4}\right)+I_{2}^{\rm{SHO}}\left(u_{3},u_{4}\right)\Big)\end{split} (17) using the same I_{1} and I_{2} as above for the overlapping integral, but with bounds \begin{split}u_{1}=\eta\omega_{0}\left(\frac{\delta_{1}+\delta_{2}}{2}+\Delta\right),\quad\quad u_{2}=\eta\omega_{0}\left(\frac{\delta_{1}+\delta_{2}}{2}+\Delta-\delta_{1}\right),\quad\quad\\ u_{3}=\eta\omega_{0}\left(\frac{\delta_{1}-\delta_{2}}{2}+\Delta\right),\quad\quad u_{4}=\eta\omega_{0}\left(\frac{\delta_{1}-\delta_{2}}{2}+\Delta-\delta_{1}\right).\quad\quad\end{split} (18) III.3.1 Stellar p-mode oscillations The kernel integrals given above can be used for modeling p-mode oscillations in a few different ways. 18 used a sum of SHO kernels with very large Q to model individual modes of oscillations, imitating the comb-like structure of Lorentzian modes observed in asteroseismic analyses of long-baseline time series. 42 and 32 instead used a single SHO kernel to model these modes as a Gaussian-like power envelope centered on the frequency of maximum power, \nu_{max} , as asteroseismic scaling relations exist for both the power and frequency of maximum oscillations. We will adopt the latter approach for its simplicity, but also because the time series we will model will not be sufficiently long enough to resolve individual modes of oscillation. Further, by properly computing the integrated kernels, the kernels are no longer strictly stationary, since they depend not just on \Delta\equiv\left|t-t^{\prime}\right| , but also on the individual exposure times \delta_{1} and \delta_{2} . Specifically in the case of overlapping measurements, the logic to decompose overlaps does not have an exploitable structure in the covariance matrix, and so to our knowledge we cannot make use of the scaling improvements outlined in 18 that enable efficient analyses of long-baseline time series with N_{obs}\gtrsim 1000 . III.3.2 Stellar granulation The PSD for a SHO kernel with Q=1/\sqrt{2} closely follows a Harvey-like ( 25 ) function, and so it is typically used to model granulation components ( 18 ; 42 ; 32 ) . Since 1/\sqrt{2}>1/2 , the equations above are also valid for granulation with Q fixed at 1/\sqrt{2} . Granulation is often modeled as a sum of two such kernels ( 22 ; 32 ) , or more to also include lower-frequency supergranulation structure ( 40 ) . We will adopt a 2-component model in this work, since the time series we will model will not be long enough to probe supergranulation timescales (12+ hours). IV Decomposing Multi-component GP Models The model we will employ for stellar variability will be a sum of several independent GPs, for example, f_{\star}(t)=f_{osc}(t)+f_{gran}(t)+f_{supergran}(t)+f_{rot}(t)\ +\ ...\ =\sum_{s=1}^{N_{S}}f_{s}(t), (19) where the subscript \star (or \odot in the case of the Sun) refers specifically to stellar processes, and the far right-hand side is a generalized sum over N_{S} stellar components. We therefore wish to describe the procedure we will use throughout to evaluate the predictive mean of each component in such a multi-component GP model. Following a similar notation to 13 , the standard GP result for how to condition data (i.e., compute the predictive mean) based on a set of observations shows that if \begin{bmatrix}\bm{y}_{A}\\ \bm{y}_{B}\end{bmatrix}\sim N\left(\begin{bmatrix}{\bm{m}_{A}}\\ {\bm{m}_{B}}\end{bmatrix},\begin{bmatrix}\mathbf{K}_{AA}&\mathbf{K}_{AB}\\ \mathbf{K}_{BA}&\mathbf{K}_{BB}\end{bmatrix}\right). (20) then \bm{y}_{A}\mid\bm{y}_{B}\sim N\left(\bm{m}_{A}+\mathbf{K}_{AB}\left(\mathbf{K}_{BB}+\mathbf{R}\right)^{-1}\left(\bm{y}_{B}-\bm{m}_{B}\right),\mathbf{K}_{AA}-\mathbf{K}_{AB}\left(\mathbf{K}_{BB}+\mathbf{R}\right)^{-1}\mathbf{K}_{BA}\right), (21) where \mathbf{R} is the noise matrix containing the measurement variances, \bm{y}_{B} represents a set of observations observed at times \{t_{1},t_{2},...t_{N}\} , and \bm{y}_{A} represents a set of test points over which to evaluate the predictive distribution, \{t_{\ast,1},t_{\ast,2},...t_{\ast,M} }. We have included the means \bm{m}_{A} and \bm{m}_{B} for completeness, though these are often simply 0. The relevant covariance matrices are \displaystyle\mathbf{K}_{AA} \displaystyle=k(\bm{t_{\ast}},\bm{t_{\ast}})\quad \displaystyle\mathbf{K}_{AB} \displaystyle=k(\bm{t_{\ast}},\bm{t}) (22) \displaystyle\mathbf{K}_{BA} \displaystyle=k(\bm{t},\bm{t_{\ast}})\quad \displaystyle\mathbf{K}_{BB} \displaystyle=k(\bm{t},\bm{t}). For a simple case of two independent GPs, f_{1}\sim GP(m_{1},K_{1}) and f_{2}\sim GP(m_{2},K_{2}) , then \begin{bmatrix}\bm{f}_{1}(x)\\ \bm{f}_{1}(x_{\ast})\\ \bm{f}_{2}(x)\\ \bm{f}_{2}(x_{\ast})\\ \bm{f}_{1}(x)+\bm{f}_{2}(x)\\ \bm{f}_{1}(x_{\ast})+\bm{f}_{2}(x_{\ast})\end{bmatrix}\sim N\left(\begin{bmatrix}{\bm{m}_{1}}\\ {\bm{m}_{1,\ast}}\\ {\bm{m}_{2}}\\ {\bm{m}_{2,\ast}}\\ {\bm{m}_{1}}+{\bm{m}_{2}}\\ {\bm{m}_{1,\ast}+\bm{m}_{2,\ast}}\end{bmatrix},\begin{bmatrix}\mathbf{K}_{1}&\mathbf{K}_{1,\ast}&0&0&\mathbf{K}_{1}&\mathbf{K}_{1,\ast}\\ \mathbf{K}_{1,\ast}^{\intercal}&\mathbf{K}_{1,\ast\ast}&0&0&\mathbf{K}_{1,\ast}&\mathbf{K}_{1,\ast\ast}\\ 0&0&\mathbf{K}_{2}&\mathbf{K}_{2,\ast}&\mathbf{K}_{2}&\mathbf{K}_{2,\ast}\\ 0&0&\mathbf{K}_{2,\ast}^{\intercal}&\mathbf{K}_{2,\ast\ast}&\mathbf{K}_{2,\ast}&\mathbf{K}_{2,\ast\ast}\\ \mathbf{K}_{1}&\mathbf{K}_{1,\ast}^{\intercal}&\mathbf{K}_{2}&\mathbf{K}_{2,\ast}^{\intercal}&\mathbf{K}_{1}+\mathbf{K}_{2}&\mathbf{K}_{1,\ast}+\mathbf{K}_{2,\ast}\\ \mathbf{K}_{1,\ast}^{\intercal}&\mathbf{K}_{1,\ast\ast}&\mathbf{K}_{2,\ast}^{\intercal}&\mathbf{K}_{2,\ast\ast}&\mathbf{K}_{1,\ast}+\mathbf{K}_{2,\ast}&\mathbf{K}_{1,\ast\ast}+\mathbf{K}_{2,\ast\ast}\end{bmatrix}\right). (23) Equations 20 and 21 then give the conditional probability and the predictive mean of one component given the observed data \begin{bmatrix}\bm{y}_{\ast,1}\\ \bm{y}_{1}+\bm{y}_{2}\end{bmatrix}\sim N\left(\begin{bmatrix}{\bm{m}_{\ast,1}}\\ \bm{m}_{1}+\bm{m}_{2}\end{bmatrix},\begin{bmatrix}\mathbf{K}_{\ast\ast,1}&\mathbf{K}_{\ast,1}\\ \mathbf{K}_{\ast,1}^{\intercal}&\mathbf{K}_{1}+\mathbf{K}_{2}\end{bmatrix}\right). (24) \displaystyle\bm{y}_{\ast,1}\mid\bm{y_{1}}+\bm{y_{2}} \displaystyle\sim N\left(\bm{\mu}_{\ast,1},\mathbf{C}_{\ast,1}\right) (25) \displaystyle\bm{\mu}_{\ast,1} \displaystyle=\bm{m}_{\ast,1}+\mathbf{K}_{\ast,1}^{\intercal}\left(\mathbf{K}_{1}+\mathbf{K}_{2}+\mathbf{R}\right)^{-1}\left(\bm{y}_{1}+\bm{y}_{2}-\bm{m}_{1}-\bm{m}_{2}\right) \displaystyle\mathbf{C}_{\ast,1} \displaystyle=\mathbf{K}_{\ast\ast,1}-\mathbf{K}_{\ast,1}^{\intercal}\left(\mathbf{K}_{1}+\mathbf{K}_{2}+\mathbf{R}\right)^{-1}\mathbf{K}_{\ast,1}, where we have again used \bm{\mu} and \mathbf{C} to denote the mean and covariance of a GP that has been conditioned on a given set of data. In the more general case where a GP model is built from a sum of S independent GPs, the covariance can be written as \mathbf{K}=\mathbf{K}_{1}+\mathbf{K}_{2}+...+\mathbf{K}_{S}=\sum_{k=1}^{S}\mathbf{K}_{k}, (26) the k th component along the predicted points \{t_{\ast,1},t_{\ast,2},...,t_{\ast,M}\} and observations of the total sum are distributed as \begin{bmatrix}\bm{y}_{\ast,k}\\ \sum_{k}{\bm{y}_{k}}\end{bmatrix}\sim N\left(\begin{bmatrix}{\bm{m}_{\ast,k}}\\ \sum_{k}{\bm{m}_{k}}\end{bmatrix},\begin{bmatrix}\mathbf{K}_{\ast\ast,k}&\mathbf{K}_{\ast,k}\\ \mathbf{K}_{\ast,k}^{\intercal}&\sum_{k}\mathbf{K}_{k}\end{bmatrix}\right), (27) and the mean of the k th component can be predicted via \displaystyle\bm{y}_{\ast,k}\mid\bm{y} \displaystyle\sim N\left(\bm{\mu}_{\ast,k},\mathbf{C}_{\ast,k}\right) (28) \displaystyle\bm{\mu}_{\ast,k} \displaystyle=\bm{m}_{\ast,k}+\mathbf{K}_{\ast,k}^{\intercal}\left(\sum_{k}\mathbf{K}_{k}+\mathbf{R}\right)^{-1}\left(\sum_{k}{\bm{y}_{k}}-\sum_{k}{\bm{m}_{k}}\right) \displaystyle\mathbf{C}_{\ast,k} \displaystyle=\mathbf{K}_{\ast\ast,k}-\mathbf{K}_{\ast,k}^{\intercal}\left(\sum_{k}\mathbf{K}_{k}+\mathbf{R}\right)^{-1}\mathbf{K}_{\ast,k}, When comparing the predictive mean of a component kernel \mu_{\ast,k} to the predictive mean from the full kernel in Equation 3 , the only practical difference is that \mathbf{K}^{\intercal}_{\ast,k} only contains the covariance due to a single component kernel; a similar statement for \mathbf{K}_{\ast\ast,k} , \mathbf{K}^{\intercal}_{\ast,k} , and \mathbf{K}_{\ast,k} is true for the conditioned covariance. Finally, we note that the associative property of addition makes the GP model flexible to arbitrary groupings of kernels. This is handy when individual astrophysical sources may be best represented with multiple components themselves, e.g., using multiple SHO kernels at the rotation period and its harmonics for a single “rotation” kernel, or as we will describe in the next section, grouping all stellar components together to separate “instrument” from “stellar” components. V Multi-instrument GP Framework and Full Model In the previous sections, we outlined how to account for finite exposure times to predict latent functions and reviewed how to compute the conditional predictive means for individual components of a multi-component GP model. Later, we will apply these radial velocity time series of the Sun from multiple instruments. Given that these datasets have significant overlap, it will be useful to construct a GP model that treats instrumental drifts as additional independent GPs, which we incorporate as a multivariate GP where each instrument is its own parallel time series. Thus, for N_{I} instruments, if each instrument’s drift GP is f_{i}(t) , the GP model q_{i}(t) for each instrument i is \displaystyle q_{1}(t) \displaystyle=f_{1}(t)+f_{\star}(t), (29) \displaystyle q_{2}(t) \displaystyle=f_{2}(t)+f_{\star}(t), \displaystyle q_{i}(t) \displaystyle=f_{i}(t)+f_{\star}(t), \displaystyle q_{N_{I}}(t) \displaystyle=f_{N_{I}}(t)+f_{\star}(t). Written in this way, it is easy to see that each instrument’s time series contains an intrinsic drift GP alongside a common stellar variability GP shared across all instruments. Moreover, this framework allows us to extract each instrument’s drift following the procedure outlined in Section IV without specifying or prescribing its functional form. The instrument model is implemented with independent kernels that behave as \displaystyle k_{\rm{inst}}(t_{i},t_{j}) \displaystyle=k(t_{i},t_{j})\delta_{\rm{inst}_{i},\rm{inst}_{j}}, (30) \displaystyle k_{\rm{inst}}(t_{i\ast},t_{j}) \displaystyle=k(t_{i\ast},t_{j}), \displaystyle k_{\rm{inst}}(t_{i},t_{j\ast}) \displaystyle=k(t_{i},t_{j\ast}), \displaystyle k_{\rm{inst}}(t_{i\ast},t_{j\ast}) \displaystyle=k(t_{i\ast},t_{j\ast}), where k(t_{i},t_{j}) is the kernel of choice to describe the instrumental drifts (e.g., squared exponential), and \delta_{\rm{inst}_{i},\rm{inst}_{j}} is the Kronecker delta such that \delta_{\rm{inst}_{i},\rm{inst}_{j}}=1 if observation i and j are from the same instrument, and \delta_{\rm{inst}_{i},\rm{inst}_{j}}=0 otherwise. This essentially acts as a mask in the covariance matrix of the observations, \bm{K}_{ij} , for each instrument GP; the mask does not act on the kernel functions if being computed for a test point ( \bm{K}_{\ast} or \bm{K}_{\ast\ast} ). This kernel construction is relatively simple, but requires some care when computing the predictive means. In particular, when computing \bm{K}_{\ast,i}^{\intercal} for an instrumental component, the test points \{t_{\ast,1},t_{\ast,2},...t_{\ast,N}\} are then assumed to be test points for that specific instrument. In summary, Equation 29 is the full general GP model we use, with N_{S} as the number of stellar components used in the model, and N_{I} as the number of instruments in the data. We note that for the instrument components, each instrument GP f_{k}(t) could itself be modeled as a sum of independent GPs akin to Equation 19 (e.g., to capture instrumental variations on multiple timescales; see discussion in Section IX.3 .), but for this work, we will only ever use a single kernel process per instrument. VI Application to Simulated Datasets We now have ingredients to build a full GP model that can properly combine datasets from multiple instruments while accounting for the differing exposure times (both within and between instruments), and output the predictive mean of each stellar variability kernel as well as drifts between instruments. Before turning to real data, we wish to demonstrate these improvements on simulated datasets. Our simulated datasets will closely mimic real stellar data but differ in that we have knowledge of the true input signals. Our stellar variability kernels are SHO kernels with solar oscillation hyperparameters from 32 and solar granulation hyperparameters from 39 : \displaystyle\textbf{Oscillation:} \displaystyle S_{0}=2.20~\text{m}^{2}\text{s}^{-2}\,\text{Hz}^{-1}\quad\quad \displaystyle\omega_{0}=0.0194~\text{rad}\,\text{s}^{-1} \displaystyle Q=7.26 (31) \displaystyle\textbf{Granulation:} \displaystyle S_{1}=65.25~\text{m}^{2}\text{s}^{-2}\,\text{Hz}^{-1}\quad\quad \displaystyle\omega_{1}=0.0023~\text{rad}\,\text{s}^{-1} \displaystyle Q\equiv 1/\sqrt{2} Note that the frequencies above are angular frequencies \omega=2\pi\nu and the amplitudes S are in normalized power units. Following 42 , we can convert the hyperparameters above to more intuitive \sigma and \lambda to describe the typical RMS amplitude of each kernel and the timescale over which each operates: \displaystyle\textbf{Oscillation:} \displaystyle\sigma_{0}=17~\text{cm}\,\text{s}^{-1}\quad\quad \displaystyle\lambda_{0}=5.39~\text{min} (32) \displaystyle\textbf{Granulation:} \displaystyle\sigma_{1}=33~\text{cm}\,\text{s}^{-1}\quad\quad \displaystyle\lambda_{1}=44.6~\text{min} The PSDs for these kernels are shown in Figure 2 along with a sample time series draw for each. These sample draws are evaluated at 1 s intervals and will be the “truth” astrophysical components for our simulation demonstration. Figure 2: Left: PSD for the solar variability kernels used in this work. We use a sum of a granulation kernel and an oscillation kernel. Right: Sample draws for each of the stellar variability kernels (arbitrary offsets added for clarity. We now wish to sample these stellar signals as would be observed by different instruments. We choose 4 instruments (Insts. “A”, “B”, “C”, and “D”) with increasing exposure times chosen to closely match real Sun-as-a-star RV instruments ( t_{exp,A}=12~\rm{s} , t_{exp,B}=55~\rm{s} , t_{exp,C}=178~\rm{s} and t_{exp,D}=300~\rm{s} ) so that the instruments A–D are “KPF-like” ( 46 ) , “NEID-like” ( 29 ) , “EXPRES-like” ( 30 ) , and “HARPSN-like” ( 12 ) , respectively (see also 52 for a summary of typical values for NEID, EXPRES, and HARPS-N solar feeds). The readout times for each simulated instrument time series are also chosen to match their real-world counterpart ( t_{read,A}=16~\rm{s} , t_{read,B}=28~\rm{s} , t_{read,C}=52~\rm{s} and t_{read,D}=26~\rm{s} ), where we have chosen the fast-readout mode of KPF 2 2 2 although fast-readout mode is not typical for KPF solar observations, it is useful to get a sense of “best case” sampling of stellar signals . We compute the time series for each instrument by binning the true stellar signals over each observation’s exposure. For our simulated case, we are most interested in demonstrating the performance of our kernel framework, so we limit the simulated time series to 2 hours. For this demonstration, we do not mimic the longitudinal spread of instruments and instead assume coverage from all 4 telescopes overlaps during this 3-hour spread. To summarize, our model for this demonstration contains N_{S}=2 stellar components and N_{I}=4 instruments for a total sum of 6 GP components. Figure 3 shows the noise-free observations from each of the 4 representative instrument cases and the resulting predictive mean after accounting for the exposure times with our GP model. While the KPF- and NEID-like instruments reliably trace the true signal, the EXPRES- and HARPSN-like instruments show clear effects from the extended exposure times that our GP model is able to account for. Typically, the predictive mean of noise-free data should pass directly through all observations, with uncertainties that shrink to zero at each observation—behavior that we expect to avoid with a model that is aware that each observation represents a time-averaged signal. Indeed, we see that our exposure-time accounting allows the predictive mean to be more extreme than the observations, especially evident when an observation is centered on an extrema, as seen in the dip before the 75-minute mark in the EXPRES-like time series. The HARPSN-like time series is a good demonstration of how the uncertainties do not collapse to zero at the time of observations and stay relatively wide throughout, reflecting the uncertainty from the family of functions whose binned average would result in the observed RV. Figure 3: Simulated time series for our 4 representative instruments, assuming no instrumental noise. The colored horizontal lines indicate each observation’s exposure time and lighter points display the observed RV centered within. The “true” stellar variability signal is shown in black in each panel (the sum of the components shown in Figure 2 ). For each instrument, we use the input GP model with fixed hyperparameters to compute the predictive mean for the latent signal (e.g., accounting for the exposure time of each observation), which is shown by the colored line in each panel, with the 1- \sigma confidence region shaded. We note that the curves in Figure 3 come from computing the predictive mean of the latent signal, which means evaluating the predictive mean at a finely sampled grid of points that are assumed to be instantaneous (i.e., exposure time = 0). We can alternatively compute the predictive mean of an integrated signal, for any choice of exposure time. In our simulated datasets, each instrument observes with a fixed exposure time 3 3 3 This is true for the real life instruments that our representative sample is modeled after, with the exception of EXPRES, which exposes to a fixed SNR rather than a fixed exposure time , and so we can separately compute the predictive mean for each instrument’s exposure-averaged signal. For the case above of noiseless data, the predictive mean of an instrument-specific integrated (or exposure-averaged ) signal behaves as we would expect, i.e., it must pass through each of that instrument’s observations exactly with uncertainty that collapses to zero at its observations. Finally, the integrated predictive mean can be computed for any combination of observation time and associated exposure time; this is particularly important for computing the predictive mean for each input observation, in order to produce meaningful residuals, as we describe below. The exposure-time accounting is also important when combining data from multiple instruments. Without the accounting, the GP will assume all time series are true samples from the latent process, which leads to extreme departures when two observations with different exposure times occur very close to one another. We show an example of this effect in Figure 4 using the combined datasets of instruments B, C, and D. We again emphasize the distinction that the fits in Figure 3 show the predicted latent signal; the residuals between the points and the latent curve are not particularly meaningful, as it contains only the difference resulting from the exposure-averaging process. Instead, to compute meaningful residuals, one should compute the predicted mean using the input observation times and exposure durations; this process will result in the residuals between each observation and the appropriate exposure-averaged signal at that time. In the noiseless data case, each instrument’s residuals are zero, demonstrating that the model accounts for the exposure times accurately. Figure 4: An example of computing the predictive mean on a combined dataset, combining the synthetic time series from Instruments B, C, and D. The top two panels show the predictive mean without exposure-time accounting (teal) as compared to the true signal (black), and the bottom two panels show the same predictive mean after properly accounting for the exposure times. For each case, the lower panel shows the residuals between the prediction and the true synthetic signal. Note the extreme departures when the model is forced to fit two nearby points if it does not account for the exposure times. We next add in photon noise to better simulate true observations. The photon noise is drawn from Normal(0, \sigma_{RV} ) distributions with \sigma_{RV,A}=0.21~\rm{m\,s^{-1}} 4 4 4 The precision improvement from 0.3 m s -1 in 46 is a result of changes to how KPF SoCal data is now taken: the exposure times have increased from 5 to 12 s, and fewer orders are masked out. 0.21 m s -1 represents the current typical single-measurement precision for 12 s KPF SoCal observations. , and from 52 for \sigma_{RV,B}=0.16~\rm{m\,s^{-1}} , \sigma_{RV,C}=0.19~\rm{m\,s^{-1}} , and \sigma_{RV,D}=0.26~\rm{m\,s^{-1}} . In general, we find that the differences between accounting for and not accounting for the exposure times are less extreme when noisy observations are used. This is because the model that does not account for exposure times now has some additional flexibility to account for the “discrepant” exposure-averaged observations, which it can attribute to the observational uncertainty. The observations with the longest exposure times will always observe a latent signal that has lower RMS amplitude as a result of the exposure averaging. Thus, the model that does not account for exposure times will split the difference between the instruments with different exposure times and lead to a predictive mean that underpredicts the true amplitude. However, the instruments with longer exposure times will typically have lower cadence, and therefore be underweighted relative to the higher-cadence dataset. Therefore, when not accounting for the exposure times, the fits typically end up latching on to the signal from the higher-cadence datasets, reducing the amplitude of the predicted signal slightly to reconcile the exposure-averaging. The degree of amplitude reduction will depend upon the relative number of observations between instruments with longer and shorter exposures, the degree to which each time series overlaps, and the exact uncertainties for each instrument. Next, we test our recovery of instrument drifts with the drift model described in Section V . We inject randomly-drawn synthetic drifts for each instrument, each drawn from a squared exponential (SE) kernel with lengthscale 7.2 minutes and amplitude 30 cm s -1 . As a simple test, we use the input hyperparameters as the hyperparameters used to condition the model; in practice, one would not know the underlying hyperparameters a priori and would need recover these via a fit, e.g., maximum likelihood estimation. Our simple test is meant to demonstrate our ability to recover instrument drifts under idealized conditions. We find that even in these conditions, absolute drifts are not well recovered; the top panel of Figure 5 shows that while the recovered drifts are decently correlated with the true drifts, there is considerable tradeoff between the different instruments. We conclude that even with perfect overlapping coverage between 4 instruments, there will always be ambiguity about which instrument is drifting in which direction at any given time. However, as we show in the bottom panel of Figure 5 , the relative drifts between any two instruments is constrained extremely well. Thus, we conclude that our instrument drift model is successful at distinguishing combined instrumental drifts from stellar signals; we refer to these drifts as “pairwise relative drifts.” Unfortunately, this suggests that the recovered absolute drifts of any simultaneous instruments will be strongly correlated (often anticorrelated as the model prefers to split the difference with each instrument drifting in opposite directions), significantly complicating any efforts to tie the recovered drift model to missing physics or unused telemetry in that instrument’s existing drift corrections as part of its data reduction pipeline. However, in a scenario where the true drifts have significantly different hyperparameters between each instrument (e.g., different drift timescales), the GP model will more easily identify each instrument’s absolute drift. In the limit of many instruments, the model will likewise gain confidence in assigning drift signals to the appropriate offending instrument(s). Figure 5: Recovery of instrument drifts from combining noise-free observations from 4 instruments with a model that includes both stellar signals and instrument drifts. Top panel: Recovered, or “predicted” instrument drifts (solid lines with 1- \sigma confidence regions) compared to the true synthetic drifts for each instrument in the drift model case. Recovered drifts are overall well correlated with the true drifts, however, large departures exist, particularly evident between 75 and 100 minutes in this example. Bottom panel: Instead, pairwise relative drifts (e.g., differential drifts between instrument pairs in the top panel) are extremely well constrained, with the recovered pairwise relative drifts (semi-transparent light teal line) only differing from the true relative drifts in the edges of the time series beyond the observations ( t<0 min. or t>120 min.); the residuals between the true relative drift and the recovered relative drift for 03000 ), which prevents us from performing MCMC fits to tune the GP kernel hyperparameters. Some workarounds exist, but most are inexact, only inferring the relevant covariance matrix structure, e.g., inducing points ( 51 ; 3 ; 16 ; 35 ) ; further, such methods are not ideal in the case of stellar variability, as the relevant timescales span many orders of magnitude and cannot handle exposure overlap. The methods that retain the exact structure of the covariance matrix require specific family of kernels ( 18 , e.g., “celerite”) or leverage semi-separable and “LEAF” structure ( 10 ; 11 ) ; while the latent kernels we use have a celerite form, the integrated form of the kernels are no longer stationary 7 7 7 We note that in the limiting case of non-overlapping and constant exposure times , the integrated kernel is stationary and celerite form can be used , and instead are a function of |t-t^{\prime}| and the two exposure times \delta_{1},\delta_{2} . Further, overlapping observations from multiple instruments break the “LEAF” structure of the matrix, as gaps can enter into the covariance matrix depending on whether subsequent observations have overlap or not. However, the integrated kernels are only semi-non-stationary; that is, while the covariance does not depend only on |t-t^{\prime}| , it is still invariant to t\leftrightarrow t^{\prime} (i.e., the kernels are not time dependent). It is possible that the resulting covariance matrix is semi-separable and there exist some creative solutions that allow us to use celerite kernels. Another promising solution could make use of sparsity-discovering kernels ( 38 ) , since the “complicated” part of the covariance matrix (exposure overlaps) are very close to the diagonal. We leave these these possible GP approaches to future studies. Fortunately, an alternative but equivalent representation of GPs does afford a scalable implementation of exposure-integrated measurements (including overlap). 47 developed the equivalent state-space model to our problem statement, which is solved by an augmented state and matching Kalman filter and RTS smoother; the solution has \mathcal{O}(N) complexity and is parallelizable. With a scalable framework in place, we are extending these investigations in upcoming studies of stellar variability and instrument drifts in a more robust way and on longer timescales ( 47 ) . IX.3 More Complicated Drift Frameworks For our demonstrations, the drift framework contained simple kernels specified by a single timescale. In reality, the instrument drifts will vary on many timescales, and with more complicated behavior. For instance, daytime solar observations often occur soon after daily liquid nitrogen fills as part of regular instrument operations and calibration sequences. As a result, the daily RVs often contain discontinuities or ramps near the same time of each day. To account for this and other effects, the instrument kernels will likely need to be a sum of multiple kernels that operate on different timescales and/or contain change points to handle discontinuities/ramps. We would also like to investigate the structure of differential extinction in various solar data sets, which should similarly be a shared latent (chromatic) signal across all instruments, with a time lag to account for each observing site’s geographic location. Such a model might instead use a kernel that maps each timestamps to disc-averaged airmass. This is an easy kernel to implement in the general GP framework, but may not be possible with a state-space model which requires sortable (i.e. monotonic) coordinates (e.g., a timeseries). X Summary and Conclusions In this paper we have presented a GP framework that (1) accounts for the integrated effects of discrete exposure times and overlapping observations, (2) decomposes the predictive mean of a multi-component model into its constituent kernels, and (3) incorporates drifts between multiple instruments for combined datasets. The framework was motivated by the growing number of EPRV instruments with solar feeds, each with differing and overlapping exposure times and relative drifts; however, it could be applied to any dataset where the observations have been binned over a lengthscale that is comparable to the relevant GP lengthscales. We constructed the integrated GP kernels using three ingredients. The first was the traditional instantaneous kernel that describes the covariance between any two instantaneous points (the latent function). The second was the singly integrated form of the kernel to describe the covariance between an instantaneous points and a binned observation. The final piece was the doubly integrated kernel for the covariance between any two binned observations. We further demonstrated how these integrals behave for stationary kernels, where the sign of |t-t^{\prime}| flips across the integral: we define each of the necessary integrals in the case of perfectly overlapping observations and separate observations and show that any two partially overlapping observations can be decomposed into sums of integrals of those forms. Together, these pieces allow one to properly account for the covariance between binned observations and evaluate the predictive mean of the latent function. We then derived the analytic expressions for the integrated kernels for the case of the simple harmonic oscillator, a kernel that is commonly used for modeling short-timescale solar variability, e.g., granulation and oscillations. Next, we reviewed the formalism for evaluating the predictive mean of each component of a multi-component GP model. We then introduced a simple method for accounting for drifts between overlapping datasets from multiple instruments by using independent kernels such that each kernel function only computes covariances between observations from the same instrument. With the complete framework, we first tested it on simulated noise-free data sets generated to mimic the cadence and exposure of real EPRV solar feeds from KPF, NEID, EXPRES, and HARPS-N. We show that not accounting for the exposure times leads to erroneous predicted signals; the errors are largest when two observations occur very close together with different exposure times. When including instrument drifts, we find that absolute drifts are recovered reasonably well, but with periods of ambiguity where the drift is incorrectly attributed to a different instrument. However, the relative drift between any instrument pair (which we refer to as the “pairwise relative drift”) is recovered to within 1.5 cm s -1 in the noise-free scenario. Next, we applied our framework to two real datasets. We started with a single day of overlapping RVs from KPF and NEID. We then applied it to a month of data from HARPS-N, HARPS, EXPRES, and NEID data from the Extreme Stellar Signals Project ( 52 ) . In both cases, we were able to compute predictive means of individual stellar components and verify that the framework properly handled the overlapping exposures and instrumental drifts. With this modeling framework in hand, and scalable approaches forthcoming ( 47 ) , future studies will explore the characteristics of stellar variability and instrument drift at finer resolution and longer timescales. J.K.L. is supported by an appointment to the NASA Postdoctoral Program at the NASA Jet Propulsion Laboratory, administered by Oak Ridge Associated Universities under contract with NASA. The research was carried out, in part, at the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration (80NM0018D0004) and funded through the President’s and Director’s Research & Development Fund Program. Support for this work was provided by NASA through the NASA Hubble Fellowship grant HST-HF2-51569 awarded by the Space Telescope Science Institute, which is operated by the Association of Universities for Research in Astronomy, Inc., for NASA, under contract NAS5-26555. The HELIOS solar telescope is located at the ESO 3.6m Telescope facility at the La Silla Observatory in Chile, and is connected to the HARPS and NIRPS spectrographs. HELIOS (PI: Xavier Dumusque & Pedro Figueira) was funded through Portuguese FCT funding and the Branco Weiss fellowship. The HARPS-N solar telescope is located at the TNG facility at the Roque de los Muchachos Observatory in La Palma, Spain, and is connected to the HARPS-N spectrograph. The HARPS-N solar telescope (PI: Xavier Dumusque & David Phillips) was funded with support from Smithsonian R&D internal funding and the Branco Weiss fellowship. The HARPS-N project was funded by the Prodex Program of the Swiss Space Office (SSO), the Harvard University Origin of Life Initiative (HUOLI), the Scottish Universities Physics Alliance (SUPA), the University of Geneva, the Smithsonian Astrophysical Observatory (SAO), the Italian National Astrophysical Institute (INAF), University of St. Andrews, Queen’s University Belfast, and University of Edinburgh. We thank the HARPS-N solar team and TNG staff for processing the solar data and maintaining the solar telescope. Maintenance and upgrade of both the HELIOS and the HARPS-N telescope was possible thanks to support from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement SCORE No 851555) and from the Swiss National Science Foundation under the grant SPECTRE (No 200021_215200). These results made use of the Lowell Discovery Telescope at Lowell Observatory. Lowell is a private, non-profit institution dedicated to astrophysical research and public appreciation of astronomy and operates the LDT in partnership with Boston University, the University of Maryland, the University of Toledo, Northern Arizona University and Yale University. The EXPRES team acknowledges support for the design and construction of EXPRES from NSF MRI-1429365, NSF ATI-1509436 and Yale University. DAF gratefully acknowledges support to carry out this research from NSF 2009528, NSF 1616086, NSF AST-2009528, the Heising-Simons Foundation, and an anonymous donor in the Yale alumni community. Some of the data presented herein were obtained at the W. M. Keck Observatory, which is operated as a scientific partnership among the California Institute of Technology, the University of California, and the National Aeronautics and Space Administration. The Observatory was made possible by the generous financial support of the W. M. Keck Foundation. This research has made use of the Keck Observatory Archive (KOA), which is operated by the W. M. Keck Observatory and the NASA Exoplanet Science Institute (NExScI), under contract with the National Aeronautics and Space Administration. The authors wish to recognize and acknowledge the very significant cultural role and reverence that the summit of Maunakea has always had within the Native Hawaiian community. We are most fortunate to have the opportunity to conduct observations from this mountain. This paper contains data taken with the NEID instrument, which was funded by the NASA-NSF Exoplanet Observational Research (NN-EXPLORE) partnership and built by Pennsylvania State University. NEID is installed on the WIYN telescope, which is operated by the NSF’s National Optical-Infrared Astronomy Research Laboratory (NOIRLab). The NEID archive is operated by the NASA Exoplanet Science Institute at the California Institute of Technology. Part of this work was performed for the Jet Propulsion Laboratory, California Institute of Technology, sponsored by the United States Government under the Prime Contract 80NM0018D0004 between Caltech and NASA. This paper is based in part on observations at Kitt Peak National Observatory, NSF’s NOIRLab, managed by the Association of Universities for Research in Astronomy (AURA) under a cooperative agreement with the National Science Foundation. The authors are honored to be permitted to conduct astronomical research on Iolkam Du’ag (Kitt Peak), a mountain with particular significance to the Tohono O’odham. Deepest gratitude to Zade Arnold, Joe Davis, Michelle Edwards, John Ehret, Tina Juan, Brian Pisarek, Aaron Rowe, Fred Wortman, the Eastern Area Incident Management Team, and all of the firefighters and air support crew who fought the recent Contreras fire. Against great odds, you saved Kitt Peak National Observatory. The Center for Exoplanets and Habitable Worlds and the Penn State Extraterrestrial Intelligence Center are supported by Penn State and the Eberly College of Science. Computations for this research were performed on the Penn State’s Institute for Computational and Data Sciences’ Advanced CyberInfrastructure (ICDS-ACI). This content is solely the responsibility of the authors and does not necessarily represent the views of the Institute for Computational and Data Sciences.