oneDAL Optimization for ARM Scalable Vector Extension: Maximizing Efficiency for High-Performance Data Science

Chandan Sharma, Rakshith GB, Ajay Kumar Patel, Dhanus M Lal, Darshan Patel, Ragesh Hajela, Masahiro Doteguchi, Priyanka Sharma · 2025

Read oneDAL Optimization for ARM Scalable Vector Extension: Maximizing Efficiency for High-Performance Data Science by Chandan Sharma, Rakshith GB, Ajay Kumar Patel, Dhanus M Lal, Darshan Patel, Ragesh Hajela, Masahiro Doteguchi, Priyanka Sharma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04241.txt.

Introduction

Chandan Sharma and co-authors port a major data analytics library to ARM chips in a 2025 paper. The oneDAL library speeds up machine learning and data work, but it leaned on Intel's math libraries and so ran only on x86 machines. ARM processors with Scalable Vector Extension now promise strong, efficient performance for science workloads.

The team rebuilt oneDAL on OpenBLAS and added ARM-specific tuning: custom sparse matrix routines, vectorized statistics, and a support vector machine rewritten for the flexible vector design. Some methods gained over twenty percent in speed, and some training jobs ran up to two hundred times faster on cloud ARM machines. The work widens the hardware choice for high-performance data science.

Catalog record

CREATORChandan Sharma, Rakshith GB, Ajay Kumar Patel, Dhanus M Lal, Darshan Patel, Ragesh Hajela, Masahiro Doteguchi, Priyanka Sharma
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-04241

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

oneDAL Optimization for ARM Scalable Vector Extension: Maximizing Efficiency for High-Performance Data Science Chandan Sharma, Rakshith GB, Ajay Kumar Patel, Dhanus M Lal, Darshan Patel, Ragesh Hajela, Masahiro Doteguchi, Priyanka Sharma Abstract The evolution of ARM-based architectures, particularly those incorporating Scalable Vector Extension (SVE), has introduced transformative opportunities for high-performance computing (HPC) and machine learning (ML) workloads. The Unified Acceleration Foundation’s (UXL’s) oneAPI Data Analytics Library (oneDAL) is a widely adopted library for accelerating ML and data analytics workflows, but its reliance on Intel®’s proprietary Math Kernel Library (MKL) has traditionally limited its compatibility to x86 platforms. This paper details the porting of oneDAL to ARM architectures with SVE support, using OpenBLAS as an alternative backend to overcome architectural and performance challenges. Beyond porting, the research introduces novel ARM-specific optimizations, including custom sparse matrix routines, vectorized statistical functions, and a Scalable Vector Extension (SVE)-optimized Support Vector Machine (SVM) algorithm. The SVM enhancements leverage SVE’s flexible vector lengths and predicate-driven execution, achieving notable performance gains 22% for the Boser method and 5% for the Thunder method. Benchmarks conducted on ARM SVE-enabled AWS Graviton3 instances showcase up to 200X acceleration in ML training and inference tasks compared to the original scikit-learn implementation on ARM platform. Moreover, the ARM-optimized oneDAL achieves performance parity with, and in some cases exceeds, the x86 oneDAL implementation (MKL backend) on Ice Lake x86 systems, which are nearly twice as costly as AWS Graviton3 ARM instances. These findings highlight ARM’s potential as a high-performance, energy-efficient platform for data-intensive ML applications. By expanding cross-architecture compatibility and contributing to the open-source ecosystem, this work reinforces ARM’s position as a competitive alternative in the HPC and ML domains, paving the way for future advancements in data-intensive computing. I Introduction The growing power of computing fuels scientific discovery and technical advancements, enabling enhanced applications in machine learning and big data analytics, with high-performance computing (HPC) systems depending on efficient hardware and software designs to drive these improvements [ 1 ] . X86-based architectures have historically dominated the HPC environment because of their software availability, robust performance, and wide ecosystem support [ 3 ] . However, this landscape is being redefined by the latest developments in ARM-based processors, such as the A64FX and FX700 [ 4 ] . Both the FX700 and the A64FX, which are powerful candidates for next-generation HPC systems because of their exceptional performance and energy efficiency, are employed in the Fugaku supercomputer [ 5 ] . The upcoming ARM processors [ 6 , 7 , 8 , 9 ] , which foresee advancements in the future and make use of complex microarchitecture to give improved performance and energy efficiency, further this trend. Energy-efficient computing is crucial to meet the increasing demands of data centers, and ARM CPUs represent a significant advancement in this area. This idea is aligns with global environmental objectives, aiming to significantly reduce energy consumption in data centers [ 10 ] . Among the significant contributions to the HPC and ML ecosystem, the oneAPI Data Analytics Library (oneDAL) [ 11 ] , developed under the UXL [ 12 ] . oneDAL provides highly optimized routines for data preprocessing, transformation, analysis, modeling, and validation, leveraging hardware acceleration techniques such as parallelism and vectorized computations. Widely integrated into Python-based workflows through daal4py [ 13 ] , oneDAL enables seamless adoption within popular data science and machine learning framework such as scikit-learn [ 14 ] . However, oneDAL’s reliance on MKL [ 15 ] restricts its applicability to x86 platforms [ 16 ] , creating challenges for adoption on ARM systems. As ARM processors continue to gain prominence in the HPC landscape, adapting oneDAL for ARM platforms is essential for achieving high-performance data analytics across a broader spectrum of hardware. ARM SVE introduces architectural innovations that overcome limitations inherent in traditional SIMD (Single Instruction, Multiple Data) architectures, such as Intel’s AVX [ 17 ] and ARM’s NEON [ 18 ] . Unlike fixed-width SIMD systems, SVE employs a Vector Length Agnostic (VLA) approach, allowing vector lengths to scale flexibly between 128 and 2048 bits in increments of 128 bits. This adaptability enables a single, vectorized implementation to operate efficiently across different ARM processors without architecture-specific modifications, making SVE particularly suitable for scientific and data analytics applications that demand high parallelism and scalability. A defining characteristic of Scalable Vector Extension (SVE) [ 19 ] is that it is a separate extension from Advanced SIMD (commonly known as Neon), with an entirely new set of instruction encodings specifically designed to address the needs of high-performance computing (HPC). Unlike Neon, which is more general-purpose, SVE is tailored to overcome traditional barriers to auto-vectorization in compilers, enabling more efficient and scalable parallel processing. SVE introduces several key features that significantly enhance flexibility and performance in vectorized computations, making it particularly suited for data-intensive applications such as machine learning and scientific computing, where complex and irregular data patterns are common. These features include: • Gather-load and scatter-store instructions for efficient memory access patterns. • Per-lane predication , enabling independent operations on different vector elements. • Predicate-driven loop control and management , providing fine-grained control over iterations in vectorized loops. To implement its advanced capabilities, SVE introduces two new types of registers designed to enhance flexibility and efficiency in vector processing: Z Registers: SVE provides 32 Z registers, which are configurable in width and can hold data elements interpreted as 8-bit, 16-bit, 32-bit, or 64-bit values. Each Z register’s width can range up to 2048 bits, with a 2048-bit Z register capable of holding 256 8-bit elements, 128 16-bit elements, 64 32-bit elements, or 32 64-bit elements. This adaptability allows Z registers to handle large datasets in parallel, optimizing performance for data-intensive applications, such as ML algorithms, where multiple elements are processed simultaneously. P Registers: SVE also introduces 15 predicate registers (P registers) that enable fine-grained control over vector operations by acting as masks. P registers serve the following purposes: • P0–P7 : Used as governing predicates for load/store and arithmetic operations. • P8–P15 : Serve additional roles in loop management and control. • FFR (First Fault Register) : Provides hardware support for speculative execution and assists in fault recovery during vectorized operations. The flexibility provided by SVE’s Vector Length Agnostic (VLA) processing model, combined with the selective computation capabilities enabled by P registers, makes SVE particularly suited for HPC and ML applications. Adapting oneDAL for ARM’s SVE architecture involves several challenges. First, a new backend needs to replace MKL, as it is incompatible with ARM systems. OpenBLAS [ 20 ] , an open-source alternative, provides fundamental BLAS and LAPACK functionalities for ARM, but lacks the advanced optimizations that MKL offers on x86 platforms. Thus, specific ARM-compatible implementations and optimizations are necessary to achieve comparable performance. Second, to fully leverage ARM SVE, key components of oneDAL must be re-engineered to exploit SVE’s unique capabilities, including the vectorized ML algorithm, optimized statistical functions, and custom sparse matrix routines. By implementing ARM-specific enhancements oneDAL can achieve efficient computation for ML tasks on ARM platforms. II Related Work The oneAPI initiative provides a unified programming model designed to support diverse hardware architectures, including CPUs, GPUs, and FPGAs. As part of this ecosystem, oneDNN has already been successfully ported

Read the complete text