Using Vision + Language Models to Predict Item Difficulty Conference: ; ;

Samin Khan Stanford Graduate School of Education [email protected] · 2026

Read Using Vision + Language Models to Predict Item Difficulty Conference: ; ; by Samin Khan Stanford Graduate School of Education [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04670.txt.

Description

Khan predicts item difficulty with vision plus language models. The project tests whether language models can judge difficulty of visualization literacy test items for American adults. Features from item text, image, or both are tried as difficulty predictors. A nano model analyzes items and generates predictions from feature sets. Using both visual and text features gives the lowest mean absolute error at 0.224, beating vision-only and text-only approaches. The best multimodal model achieves a small mean squared error on a held-out test set, showing potential for psychometric analysis.

Catalog record

CREATORSamin Khan Stanford Graduate School of Education [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE9991
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.04670

Browse the full library · About the Tower of Babel