Implementation of full and simplified likelihoods in CheckMATE
2025
Read Implementation of full and simplified likelihoods in CheckMATE (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08565.txt.
Introduction
Iñaki Lara and Krzysztof Rolbiecki report new statistical tools inside a collider search program, in two thousand twenty-five. The program, called CheckMATE, tests new physics ideas against data from large particle colliders. Searches there often split results into many bins, and joining bins well can sharpen sensitivity.
The authors built both full and simplified likelihood models for multi-bin signal regions. Thirteen searches from the two big collider experiments are included. Several methods for building and evaluating the likelihood functions are presented. Joining searches this way can combine separate channels that do not overlap. That raises the reach of the program for ruling new models in or out.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08565
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Implementation of full and simplified likelihoods in CheckMATE Abstract We present the implementation of simplified and full likelihood models for multibin signal regions in CheckMATE . A total of 13 searches are included from ATLAS and CMS, and several methods are presented for the implementation and evaluation of likelihood functions. Statistical combinations increase the sensitivity of searches and open up the possibility of combining orthogonal search channels in the CheckMATE framework. Iñaki Lara and Krzysztof Rolbiecki Faculty of Physics, University of Warsaw ul. Pasteura 5, PL-02-093 Warsaw, Poland [email protected] , [email protected] August 8, 2026 1 Introduction The Run-3 at the LHC is now in full swing and by the end of the current run it is expected that the LHC would collect several hundreds of inverse femtobarns of data. Apart from the Higgs boson discovery [ 1 , 2 ] , which made the experimental picture of the Standard Model complete, no sign of new physics has been observed. However, the vast data has only been interpreted in the limited number of theoretical models by the LHC experiments. On many occasions, the interpretation is provided in terms of simplified models [ 3 ] which do not directly correspond to realistic TeV-scale physics. This situation has prompted several groups [ 4 , 5 , 6 , 7 , 8 , 9 ] to provide computer programs that would allow reinterpretation of experimental results in terms of an arbitrary new physics model [ 10 ] . Over the years, searches for new physics were becoming increasingly sophisticated, including the full use of complicated statistical models [ 11 ] and machine learning methods [ 12 , 13 ] . Instead of reporting results in a handful of bins, often optimized for a small class of models, and comparing observed and expected number of events, the experiments nowadays provide binned data in several observables in signal and control regions. On the one hand, this can significantly improve the sensitivity, but on the other hand, it greatly complicates the reinterpretation of the results. In this approach, experiments in high-energy physics test the compatibility of collision data with theoretical predictions, which can be described as a likelihood function. The function gives the probability of the data assuming a theoretical model and a certain set of parameters. The likelihood can therefore be used to constrain the parameters of the model. In this paper, we discuss the implementation of the full and simplified likelihoods in the CheckMATE framework [ 14 , 15 , 16 , 17 ] . For implementations in other tools, see eg. [ 18 , 19 ] . In this paper, we include 9 ATLAS and 4 CMS searches. The CMS searches use the correlated background model (covariance matrix) [ 20 ] . For ATLAS searches, we use simplified [ 21 ] and full likelihood [ 22 ] frameworks. In addition, some of the implementations of the ATLAS searches include the full set of control regions. Users have several ways of controlling the actual calculation of likelihoods. The default method of evaluation is based on the package Spey [ 23 ] . We provide validation plots for each of the searches. A comparison of three methods for the calculation of limits is presented: the best-expected signal region, the full likelihood model (if available), and the simplified likelihood. The paper is organized as follows. In Section 2 , we briefly discuss statistical models and their technical implementation in CheckMATE . We provide a list of implemented searches and options available to a user to control the program’s behavior. In Section 3 we present validation plots for each of the searches discussed. A brief summary and outlook are provided in the last section. 2 Technical implementation In this section, we introduce the methods for the implementation of simplified and full likelihoods in CheckMATE and user switches to control their execution. 2.1 ATLAS The functionality of combining signal regions for recasting in ATLAS searches can be implemented using either the full likelihood model [ 22 ] or following a simplified approach detailed in Ref. [ 21 ] . Table 1 lists the ATLAS analyses with likelihood functionality implemented in CheckMATE . The simplified likelihood method requires background rates and uncertainties that were already available in the implemented searches. The full likelihood requires an appropriate file in the JSON format and these files were released by ATLAS for 6 searches already implemented in CheckMATE . For the searches atlas_2004_14060 , atlas_2006_05880 , and atlas_2111_08372 the full model files are not available but using the published data one can still perform simplified model fitting in multibin signal regions. The full-likelihood statistical models are encoded in the JSON files by the ATLAS Collaboration. The files are not shipped with CheckMATE but are automatically downloaded during installation from the HEPData website, https://www.hepdata.net/ . The information provided includes the number of background events for all signal and control regions and for each major background category separately. This results in a large number of nuisance parameters and the complexity of the procedure makes the hypothesis testing very CPU-expensive. Additionally, on the recasting side, in order to fully exploit the method, one should also implement control regions (CRs), which was not a standard approach in CheckMATE . Currently, just two searches atlas_2010_14293 and atlas_1911_06660 has a complete implementation of all CRs. In other searches, it is assumed that the contribution of signal to CRs is negligible. This assumption is not obviously fulfilled in all imaginable new physics models. On the technical side, after the usual evaluation of events within CheckMATE , a JSON patchset is created that encapsulates signal contributions to signal regions (SRs) (and CRs if applicable). The patchset is then combined with the background-only input from ATLAS. Since the signal region names in CheckMATE do not usually exactly match the names in ATLAS conventions, an additional file is required, pyhf_conf.json , which provides a dictionary between two conventions. This is further evaluated using the package pyhf [ 24 , 25 , 26 ] , which is a Python implementation of the HistFactory specification for binned statistical models [ 27 , 28 ] . The signal strength \mu is the parameter of interest, where \mu=1 corresponds to the nominal cross section of a tested model. Depending on the user’s choices, the output can contain information about the expected and observed upper limit on \mu , with 2- \sigma bounds, along with the observed and expected \mathrm{CL}_{s} for \mu=1 . The default method of calculation is by using the asymptotic formulae; see [ 24 ] . By default, the above calculation will be executed using the Spey program [ 23 ] and spey-pyhf plugin [ 29 ] . Spey is a Python-based cross-platform package that allows statistical inference of hypotheses using different likelihood prescriptions. ♮ ♮\natural1 ♮ ♮\natural1 \natural 1 Installation of Spey is straightforward: pip install spey . Please refer to Spey online documentation and spey-pyhf for more details [ 30 ] . In our setup it gives a somewhat better control over the calculation than the above-mentioned CheckMATE - pyhf interface, but nevertheless the calculation is still performed in the pyhf framework. The main motivation, however, for using Spey was a possibility of