Scalable Multi-phase Word Embedding Using Conjunctive Propositional Clauses

Ahmed K. Kadhim, Lei Jiao, Rishad Shafik, Ole-Christoffer Granmo, Bimal Bhattarai · 2025

Read Scalable Multi-phase Word Embedding Using Conjunctive Propositional Clauses by Ahmed K. Kadhim, Lei Jiao, Rishad Shafik, Ole-Christoffer Granmo, Bimal Bhattarai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19018.txt.

Description

Ahmed Kadhim and co-authors present a scalable word embedding method in two thousand twenty-five built on a logic-based learning machine. The Tsetlin Machine learns rules as plain logical clauses, so its decisions stay readable. Earlier work used it to build word embeddings, but the approach slowed as inputs grew longer.

Their two-phase method first stores what each word in the vocabulary means, then builds sequence embeddings from that stored knowledge. The design scales better while keeping the transparency that sets the machine apart. Tests showed performance matching earlier approaches and comparing well against human-made benchmarks. Applied to movie review sentiment, the embedding plus readable classifiers gave an end-to-end solution that competes with black-box rivals.

Catalog record

CREATORAhmed K. Kadhim, Lei Jiao, Rishad Shafik, Ole-Christoffer Granmo, Bimal Bhattarai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-19018

Browse the full library · About the Tower of Babel