Refining Sentence Embedding Model through Ranking Sentences Generation with Large Language Models
Liyang He, Chenglong Liu, Rui Li, Zhenya Huang, Shulan Ruan, Jun Zhou, Enhong Chen · 2025
Read Refining Sentence Embedding Model through Ranking Sentences Generation with Large Language Models by Liyang He, Chenglong Liu, Rui Li, Zhenya Huang, Shulan Ruan, Jun Zhou, Enhong Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13656.txt.
Description
Liyang He and co-authors sharpen sentence embeddings with ranked examples in a 2025 paper. Sentence vectors power search and matching across language tools. Training them usually needs hand-labeled pairs, which caps scale.
Large models can write training sentences, but plain pairs miss the fine ranking signal that sorts near matches. The team steer the writer in its latent space so generated sentences spread in set directions. Ranked sets then refine an existing embedding model with both meaning and order. Benchmarks show new best scores at modest generation cost. Ranking, the paper argues, is the missing lesson in synthetic training.
Catalog record
| CREATOR | Liyang He, Chenglong Liu, Rui Li, Zhenya Huang, Shulan Ruan, Jun Zhou, Enhong Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-13656