KBest: Efficient Vector Search on Kunpeng CPU DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06
Kaihao Ma † , Meiling Wang † , Senkevich Oleg † , Zijian Li † , Daihao Xue † , Malyshev Dmitriy ¶ , Yangming Lv † , Shihai Xiao † , Xiao Yan ‡ , Radionov Alexander † , Weidi Zeng † , Yuanzhan Gao † , Zhiyu Zou † , Xin Yao † , Lin Liu † , Junhao Wu † , Yiding Liu † , Yaoyao Fu † , Gongyi Wang † , Gon · 2025
Read KBest: Efficient Vector Search on Kunpeng CPU DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 by Kaihao Ma † , Meiling Wang † , Senkevich Oleg † , Zijian Li † , Daihao Xue † , Malyshev Dmitriy ¶ , Yangming Lv † , Shihai Xiao † , Xiao Yan ‡ , Radionov Alexander † , Weidi Zeng † , Yuanzhan Gao † , Zhiyu Zou † , Xin Yao † , Lin Liu † , Junhao Wu † , Yiding Liu † , Yaoyao Fu † , Gongyi Wang † , Gon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03016.txt.
Introduction
Kaihao Ma and co-authors present a vector search library in a 2025 paper, built for Huawei Kunpeng processors. Vector search finds the stored items most similar to a query and powers search engines, recommenders, and language model tools. Popular libraries are tuned for Intel-style chips, while Kunpeng chips use the ARM design.
Their library, KBest, adapts the search math to Kunpeng hardware with chip-aware tricks and algorithm changes. The catalog record for the paper carries leftover template text in its title, but the paper itself is the KBest work described here. Fast search on ARM servers could cut costs for large AI services in regions where those chips are common.
Catalog record
| CREATOR | Kaihao Ma † , Meiling Wang † , Senkevich Oleg † , Zijian Li † , Daihao Xue † , Malyshev Dmitriy ¶ , Yangming Lv † , Shihai Xiao † , Xiao Yan ‡ , Radionov Alexander † , Weidi Zeng † , Yuanzhan Gao † , Zhiyu Zou † , Xin Yao † , Lin Liu † , Junhao Wu † , Yiding Liu † , Yaoyao Fu † , Gongyi Wang † , Gon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03016
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KBest: Efficient Vector Search on Kunpeng CPU DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Kaihao Ma † , Meiling Wang † , Senkevich Oleg † , Zijian Li † , Daihao Xue † , Malyshev Dmitriy ¶ , Yangming Lv † , Shihai Xiao † , Xiao Yan ‡ , Radionov Alexander † , Weidi Zeng † , Yuanzhan Gao † , Zhiyu Zou † , Xin Yao † , Lin Liu † , Junhao Wu † , Yiding Liu † , Yaoyao Fu † , Gongyi Wang † , Gong Zhang † , Fei Yi † , Yingfan Liu § Abstract . Vector search, which returns the vectors most similar to a given query vector from a large vector dataset, underlies many important applications such as search, recommendation, and LLMs. To be economic, vector search needs to be efficient to reduce the resources required by a given query workload. However, existing vector search libraries (e.g., Faiss and DiskANN) are optimized for x86 CPU architectures (i.e., Intel and AMD CPUs) while Huawei Kunpeng CPUs are based on the ARM architecture and competitive in compute power. In this paper, we present KBest as a vector search library tailored for the latest Kunpeng 920 CPUs. To be efficient, KBest incorporates extensive hardware-aware and algorithmic optimizations, which include single-instruction-multiple-data (SIMD) accelerated distance computation, data prefetch, index refinement, early termination, and vector quantization. Experiment results show that KBest outperforms SOTA vector search libraries running on x86 CPUs, and our optimizations can improve the query throughput by over 2x. Currently, KBest serves applications from both our internal business and external enterprise clients with tens of millions of queries on a daily basis. 1. Introduction With the development of machine learning, many embedding models ( Chen et al. 2024 ; Chen and Zou 2024 ; Radford et al. 2021 ; Zhao et al. 2021 ) are proposed to map data objects (e.g., texts, images, videos, and molecules) to vectors that encode their semantics. On these embedding vectors, similarity is a key notion. For instance, two images look similar if their embeddings are similar (e.g., as measured by Euclidean distance), a text description matches a video if their have similar embeddings, and a user may like a product if their embeddings are similar. Therefore, vector search, which returns the vectors most similar to a given query vector from a vector dataset, is a basic operation on embeddings ( Li et al. 2019 ) . As shown in Figure 1 , vector search underlies many important applications such as content search (e.g., for images and videos) ( Jégou et al. 2011 ; Kalantidis and Avrithis 2014 ; Zhang et al. 2018 ) , recommendation (e.g., for e-commerce or contents) ( Chen et al. 2021 ; Huang et al. 2020 ; Lee et al. 2022 ; Van Gysel et al. 2016 ) , medicine ( Harris et al. 2025 ; Shi et al. 2022 ; Cuevas-Tello et al. 2013 ) , finance ( Iacovides et al. 2025 ) , and even LLM chat-bots ( Sarmah et al. 2024 ; Liu et al. 2025 ) . Vector search usually needs to handle large vector datasets (e.g., with millions or even trillions of high-dimension vectors) ( Dobson et al. 2023 ) and meet stringent performance requirements (e.g., returning search results within 10ms and serving millions of queries per second) ( Li et al. 2020 ) . As such, vector search should be efficient (i.e., achieving a high query throughput) to reduce the required resources for serving a given workload and thus monetary cost. Figure 1 . Vector embeddings and applications of vector search Due to the importance of efficiency, there are several highly optimized libraries for vector search. For instance, HNSWlib ( Malkov and Yashunin 2018 ) provides an efficient implementation for HNSW ( Malkov and Yashunin 2020 ) , which is a proximity graph index for vector search and shown to achieve good performance. Developed by Meta, FAISS ( Johnson et al. 2021b ) supports both inverted file (IVF) ( Jégou et al. 2011 ) and proximity graph as the indexes and allows to use vector quantization for efficient distance computation. DiskANN ( Subramanya et al. 2019 ) is proposed by Microsoft and supports both memory-based and disk-based vector search with a novel proximity graph index called Vamana. Powered by Google, ScaNN ( Research 2020 ) uses registers to compute vector distance efficiently via table lookup. However, these vector search libraries target x86 (i.e., Intel and AMD) CPUs while ARM CPUs are becoming competitive. In particular, Huawei started the ARM-based Kunpeng CPU series ( HiSilicon 2024 ; Huawei Technologies Co., Ltd. 2023 ) in 2013 and the production lines maintains an annual capacity of hundreds of thousands of CPUs. With 80 cores at 2.9GHz, the latest Kunpeng 920 CPU matches AMD 9654 (with 96 cores and 2.4GHz) in compute power. Currently, Kunpeng 920 CPUs are widely deployed for both our internal business and external cloud services. As such, it is crucial to develop an efficient vector search library for Kunpeng CPUs in order to support the applications that rely on vector search. However, developing such a library is challenging because (i) ARM CPUs have different hardware characteristics and instruction sets from x86 CPUs, and thus a deep understanding of ARM CPUs and extensive engineering efforts are required; (ii) vector search has a long research history, and thus an extensive survey is required to understand the best practices and integrate them into our library. In this paper, we present KBest (Kunpeng Blazing-fast embedding similarity search thruster) as an efficient vector search library tailored for ARM-based Huawei Kunpeng CPUs. KBest targets memory-based vector search, which assumes that the vectors fit in the main memory of a machine and is the most common scenario, and adopts proximity graph indexes, which achieve the best performance for vector search. To improve efficiency, KBest incorporates comprehensive hardware-aware and algorithmic optimizations. In particular, we leverage the single-instruction-multiple-data (SIMD) instructions of ARM to implement efficient vector distance computation, which is the basic operation in vector search, and conducts software prefetch to reduce the cache miss when accessing vectors following the edges of proximity graph indexes. We also use huge memory pages and align the vectors with cache lines to reduce memory management overheads. From the algorithm perspective, we introduce a refinement step, which checks the 2-hop neighbors in an existing proximity graph index to improve its quality, and propose a lightweight graph reordering algorithm to renumber the vectors for improved data access locality. Besides, we also design a method to terminate the processing of a query early when its neighbors have been identified and allow users to flexibly configure their vector quantization algorithms, which reduce distance computation complexity by using compressed vectors and are crucial for efficiency. We evaluate KBest on 4 real-world vector datasets and compare with 3 SOTA x86-based vector search libraries. The results show that KBest running on Kunpeng 920 CPU outperforms existing vector search libraries running on AMD 9654 CPU, highlighting the huge performance potential of ARM-based platforms. Ablation studies also suggest that our optimizations are effective by