Nyxus: A Next Generation Image Feature Extraction Library for the Big Data and AI Era

Nicholas Schaub †, Andriy Kharchenko †, Hamdah Abbasi, Sameeul Samee, Hythem Sidky, Nathan Hotaling · 2026

Read Nyxus: A Next Generation Image Feature Extraction Library for the Big Data and AI Era by Nicholas Schaub †, Andriy Kharchenko †, Hamdah Abbasi, Sameeul Samee, Hythem Sidky, Nathan Hotaling (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12016.txt.

Introduction

Schaub and co-authors built Nyxus, a library that pulls rich features from very large image sets. Modern instruments can yield terabytes of image data in a single experiment, and old tools often run too slowly. Nyxus works out of core, so it can scale across CPUs and GPUs for 2D and 3D data. Its feature sets cover fields such as radiomics and cellular analysis. Users can run it as a Python package, a command line tool, a Napari plugin, or a container.

Catalog record

CREATORNicholas Schaub †, Andriy Kharchenko †, Hamdah Abbasi, Sameeul Samee, Hythem Sidky, Nathan Hotaling
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91755
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.12016

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nyxus: A Next Generation Image Feature Extraction Library for the Big Data and AI Era Nicholas Schaub †, Andriy Kharchenko †, Hamdah Abbasi, Sameeul Samee, Hythem Sidky, Nathan Hotaling Abstract Modern imaging instruments can produce terabytes to petabytes of data for a single experiment. The biggest barrier to processing big image datasets has been computational, where image analysis algorithms often lack the efficiency needed to process such large datasets or make tradeoffs in robustness and accuracy. Deep learning algorithms have vastly improved the accuracy of the first step in an analysis workflow (region segmentation), but the expansion of domain specific feature extraction libraries across scientific disciplines has made it difficult to compare the performance and accuracy of extracted features. To address these needs, we developed a novel feature extraction library called Nyxus. Nyxus is designed from the ground up for scalable out-of-core feature extraction for 2D and 3D image data and rigorously tested against established standards. The comprehensive feature set of Nyxus covers multiple biomedical domains including radiomics and cellular analysis, and is designed for computational scalability across CPUs and GPUs. Nyxus has been packaged to be accessible to users of various skill sets and needs: as a Python package for code developers, a command line tool, as a Napari plugin for low to no-code users or users that want to visualize results, and as an Open Container Initiative (OCI) compliant container that can be used in cloud or super-computing workflows aimed at processing large data sets. Further, Nyxus enables a new methodological approach to feature extraction allowing for programmatic tuning of many features sets for optimal computational efficiency or coverage for use in novel machine learning and deep learning applications. keywords machine learning, image analysis, feature extraction, feature engineering † These authors contributed equally to this work. 1 Main The size and complexity of scientific and clinical image data is growing rapidly. Bray and Carpenter 2018 Advances in scientific and clinical imaging equipment are producing images with higher spatial resolution, Kashani et al. 2023 ; Damstra et al. 2022 higher dimensionality (i.e. time and volume), Liu et al. 2021 multiplexing and hyperplexing (i.e. more spectral channels), Maric et al. 2021 coupled with greater automation (i.e. more replicates and sample conditions). Deng et al. 2023 ; Kundu et al. 2022 These improvements in equipment and automation are unlocking significantly larger experimental spaces, leading to massive increases in imaging dataset sizes (petabytes and beyond). Methods designed to extract measurements from images in the past were designed for significantly smaller scales of data, and as a result often lack one or several of the following capabilities: 1. All measurements can be made on images too large to fit into memory (improving reproducibility of big image analysis by organizations with less compute resources and enabling low resource communities to access state-of-the-art analysis algorithms). 2. Configurable and tunable feature hyperparameters (enabling different communities to set their profiles, or for novel profiles such as AI/ML use cases to be optimized for). 3. Highly optimized feature algorithms to dramatically increase measurement speed at scale. 4. Utilization of hardware acceleration (Graphical Processing Units – GPU). 5. Modular software architecture to ease new feature addition from the community (developers only need to understand their algorithm, not all of software infrastructure). 6. Diverse user interface availability making the method highly accessible for many use cases and user skill levels (available in common scripting language package managers (e.g. PyPI, Conda, etc.), Open Container Initiative (OCI) compliant packaging, command line interface (CLI), popular workflow language tools (e.g. Common Workflow Language - CWL - tool), and as a graphical user interface). Image feature extraction is the process of deriving quantitative measurements from images. Comprehensive feature extraction in the clinical imaging domain is often referred to as radiomic profiling Tomaszewski and Gillies 2021 and in the cellular microscopy domain as cell profiling. Stirling et al. 2021 These communities have developed extensive feature sets in parallel, and they can be broadly organized into five groups: morphological/shape, intensity, texture, volumetric, and miscellaneous. Across the radiomic and cell profiling domains there are generally two broad feature extraction use cases: (1) image features, which are features extracted from entire images (stitched together or individual acquisitions) and (2) regional features, or features extracted from regions of interest (ROIs) or masks within images. Image features are often used for assessments of image quality (e.g. blurriness, motion, contrast, etc.) but have also been shown to be useful in classification and predictive tasks. Uhlmann et al. The second use case is used for a wide variety of applications including biomarker identification, classification, and regression tasks. Despite the prevalence of these two use cases, current feature extraction methods are not designed to support extracting all supported features for both use cases. Most software libraries are optimized for one use case or another, or have optimized execution of a subset of features but not others. Further, feature extraction libraries often have custom implementations of identical features (e.g. perimeter) which leads to disparity in measurements across libraries. These disparities are especially apparent between the radiomic and cell profiling fields, where the two communities have not coordinated their implementations or standards and thus often produce different measures for the same feature. Bajcsy et al. ; Bettinelli et al. Given the above, a next generation feature‑extraction library is needed that supports both use cases, regardless of image dimensions, pixel‑intensity distributions or feature groups. It should incorporate common standards and methods from both the radiomic and cell‑profiling communities to bridge their divide, reduce parallel development, and increase the replicability and reproducibility of research. Here we present Nyxus, a feature extraction library focused on robust, scalable image feature extraction algorithms to support the analysis of big image data. Nyxus was designed from the ground up to address the issues above as well as many other challenges encountered with current feature extraction methods: execution parallelism, memory safety, configurable hardware resource utilization, logging, robust error handling, and/or extensive documentation of measurements and their implementation. Nyxus was designed to support current and future big data and AI needs but does not sacrifice on the strong measurement foundation of the past. The feature metrics used in Nyxus are rigorously tested for accuracy and precision against standardized datasets. Zwanenburg et al. ; Bettinelli et al. We also compare Nyxus to other tools used for clinical and scientific image feature extraction including PyRadiomics, MITK, Goch et al. 2017 ; Unknown and RadiomicsJ Kobayashi 2022 for clinical imaging, and CellProfiler, McQuin et al. 2018 Imea, imea: A Python package for extracting 2D and shape measurements from images 2021 NIST WIPP plugin, Unknown and WND-CHARM Unknown for cell profiling. We also compare to MatLab’s default image feature extraction library to compare to a domain agnostic library with a known focus on numerical accuracy of its measurements. A broad comparison of feature offerings of Nyxus as compared to other open libraries is provided in Figure 2 and in Supplementary Tables 1-5. Nyxus’s source code is publicly available and licensed under the highly permissive MIT license for use in public and private applications. Unknown Figure 1 : Nyxus feature set compared to other common image feature extraction Methods. Each racetrack plot compares features from 9 different feature extraction

Read the complete text