TensorCommitments: A Lightweight Verifiable Inference for Language Models

Oguzhan Baser, Elahe Sadeghi, Eric Wang, David Ribeiro Alves, Sam Kazemian, Hong Kang, Sandeep P. Chinchali, Sriram Vishwanath · 2026

Read TensorCommitments: A Lightweight Verifiable Inference for Language Models by Oguzhan Baser, Elahe Sadeghi, Eric Wang, David Ribeiro Alves, Sam Kazemian, Hong Kang, Sandeep P. Chinchali, Sriram Vishwanath (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-12630.txt.

Description

Most large language models run on outside clouds, where users must trust that a remote GPU runs the model without hostile tampering. Oguzhan Baser led this work with seven co-authors, asking how to achieve checkable LLM inference. A prover must convince a checker that an inference ran correctly without rerunning the model. Old crypto works are too slow at LLM scale, while non-crypto ones require a strong checker GPU.

Their scheme, TensorCommitments, binds LLM inference to a tag, an irreversible mark that breaks under tampering, organised in multivariate Terkle Trees. For LLaMA2, TensorCommitments add only 0 point 97 percent prover time and 0 point 12 percent checker time over inference. They improve toughness to tailored LLM attacks by up to 48 percent over the best prior work requiring a checker GPU. Readers get a light, tensor-native proof of inference for cloud language models.

Catalog record

CREATOROguzhan Baser, Elahe Sadeghi, Eric Wang, David Ribeiro Alves, Sam Kazemian, Hong Kang, Sandeep P. Chinchali, Sriram Vishwanath
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-12630

Browse the full library · About the Tower of Babel