Semantic Search At LinkedIn Conference: Preprint; 2025; Preprint CCS: Computing methodologies Information retrieval CCS: Computing methodologies Natural language processing

Fedor Borisyuk, Sriram Vasudevan, Muchen Wu, Guoyao Li, Benjamin Le, Shaobo Zhang, Qianqi Kay Shen, Yuchin Juan, Kayhan Behdin, Liming Dong, Kaixu Yang, Shusen Jing, Ravi Pothamsetty, Rajat Arora, Sophie Yanying Sheng, Vitaly Abdrashitov, Yang Zhao, Lin Su, Xiaoqing Wang, Chujie Zheng, Sarang Metkar · 2026

Read Semantic Search At LinkedIn Conference: Preprint; 2025; Preprint CCS: Computing methodologies Information retrieval CCS: Computing methodologies Natural language processing by Fedor Borisyuk, Sriram Vasudevan, Muchen Wu, Guoyao Li, Benjamin Le, Shaobo Zhang, Qianqi Kay Shen, Yuchin Juan, Kayhan Behdin, Liming Dong, Kaixu Yang, Shusen Jing, Ravi Pothamsetty, Rajat Arora, Sophie Yanying Sheng, Vitaly Abdrashitov, Yang Zhao, Lin Su, Xiaoqing Wang, Chujie Zheng, Sarang Metkar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07309.txt.

Description

Keyword search misses meaning, but running large language models for ranking at LinkedIn scale demands extreme efficiency. A large team led by Fedor Borisyuk presents LinkedIn's production meaning search method for AI Job Search and AI People Search. It combines an LLM relevance judge, embedding retrieval, and a compact distilled model.

A prefill-oriented inference architecture, co-designed with pruning, context compression, and hybrid text-embedding interactions, lifts ranking throughput more than 75-fold under a fixed latency budget while keeping near-teacher ranking quality. The result is one of the first production LLM ranking systems matching traditional efficiency while improving quality and engagement. Search builders get a full-stack case study in making meaning ranking affordable.

Catalog record

CREATORFedor Borisyuk, Sriram Vasudevan, Muchen Wu, Guoyao Li, Benjamin Le, Shaobo Zhang, Qianqi Kay Shen, Yuchin Juan, Kayhan Behdin, Liming Dong, Kaixu Yang, Shusen Jing, Ravi Pothamsetty, Rajat Arora, Sophie Yanying Sheng, Vitaly Abdrashitov, Yang Zhao, Lin Su, Xiaoqing Wang, Chujie Zheng, Sarang Metkar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07309

Browse the full library · About the Tower of Babel