Accurate and Efficient Statistical Testing for Word Semantic Breadth

Yo Ehara · 2026

Read Accurate and Efficient Statistical Testing for Word Semantic Breadth by Yo Ehara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08048.txt.

Description

Yo Ehara measures how broadly a word is used across contexts, a quantity that helps lexicographers decide when senses should be split in thesauri and dictionaries. Modern embeddings place each use of a word as a point in space, and the spread of those points acts as a proxy for breadth.

Ehara shows that naive tests can confuse a change in average direction with a change in spread, creating false significant results. The proposed fix is a permutation test aligned by a Householder reflection, which separates direction from dispersion. The method gives more accurate and efficient tests for comparing the semantic breadth of two words.

Catalog record

CREATORYo Ehara
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08048

Browse the full library · About the Tower of Babel