Visual Personalization Turing Test
Rameen Abdal, James Burgess, Sergey Tulyakov, Kuan-Chieh Jackson Wang, https://snap-research.github.io/vptt · 2026
Read Visual Personalization Turing Test by Rameen Abdal, James Burgess, Sergey Tulyakov, Kuan-Chieh Jackson Wang, https://snap-research.github.io/vptt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22680.txt.
Introduction
Rameen Abdal, James Burgess, Sergey Tulyakov, and Kuan-Chieh Jackson Wang set a Turing-style test for personalized visuals. Their 2026 preprint, VPTT, judges a model by likeness of feel, not by copying a face. A model passes if its output could pass as content that person might plausibly make.
A human or a tuned model judge makes the call. The test fits an age of feeds tuned to each user's taste. It gives creators a fair bar for personal media tools. The work reframes what good personalization means. Plausible, not identical, is the bar.
Catalog record
| CREATOR | Rameen Abdal, James Burgess, Sergey Tulyakov, Kuan-Chieh Jackson Wang, https://snap-research.github.io/vptt |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22680
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Visual Personalization Turing Test Rameen Abdal, James Burgess, Sergey Tulyakov, Kuan-Chieh Jackson Wang, https://snap-research.github.io/vptt Abstract We introduce the Visual Personalization Turing Test (VPTT), a new paradigm for evaluating contextual visual personalization based on perceptual indistinguishability, rather than identity replication. A model passes the VPTT if its output (image, video, 3D asset, etc.) is indistinguishable to a human or calibrated VLM judge from content a given person might plausibly create or share. To operationalize VPTT, we present the VPTT Framework, integrating a 10k-persona benchmark (VPTT-Bench), a visual retrieval-augmented generator (VPRAG), and the VPTT Score, a text-only metric calibrated against human and VLM judgments. We show high correlation across human, VLM, and VPTT evaluations, validating the VPTT Score as a reliable perceptual proxy. Experiments demonstrate that VPRAG achieves the best alignment–originality balance, offering a scalable and privacy-safe foundation for personalized generative AI. Figure 1 : Visual Personalization Turing Test. We present the Visual Personalization Turing Test (VPTT), a new paradigm for contextual personalization at scale. A model passes the VPTT if its output is indistinguishable to a human or a calibrated VLM judge from what a given person might plausibly create or share. As one way to address this challenge, we introduce VPTT Framework consisting of privacy-safe benchmark VPTT-Bench for evaluating personalized generation and editing, and Visual Personalization RAG ( VPRAG ) that retrieves persona-aligned visual cues and converts them into personalized image generations or edits. To close the loop, we propose an automated \mathrm{VPTT_{score}} that achieves strong Spearman rank correlation ( \rho ) with humans and VLM Judges, establishing it as a cheap, reliable proxy for human perception of personalization. 1 Introduction Figure 2 : Contextual Image Generation and Editing using VPTT-Bench. Each row shows a distinct user profile: assets and style cues (left), personalized generations (social post, cultural site), and edits (garden, living room) guided by the same persona identity. All images are generated synthetically via our Visual Personalization RAG (VPRAG) by text, which retrieves persona-aligned cues. To show cross model personalization here the assets are generated by QWEN-image-model 65 and generations and edits by Nano-Banana 23 conditioned only on the first image. More results in are in Supplementary materials. Personalization in visual generation has so far focused on identity replication 51 ; 15 ; 32 ; 39 ; 61 ; 16 ; 3 ; 6 ; 2 ; 52 ; 1 , optimizing models to reproduce a subject across scenes. While effective at preserving appearance, these pipelines are computationally expensive 51 ; 2 ; 15 and miss the broader vision of personalization: how individuals perceive, stylize, and share their world . To instantiate this idea, personalization should capture the aesthetic preferences 54 ; 60 ; 41 , cultural context, and visual familiarity that constitute a person’s unique visual language. Yet, no benchmark exists to measure whether a model’s output truly feels like it could have been created by a particular person or a creator . This gap is increasingly important beyond research. Industry is actively trying to bridge the gap between GenAI and user-created content to make generative AI monetizable, trustworthy, and personally resonant 43 ; 11 . This challenge becomes even more pressing as powerful foundation models in image domain, such as Qwen 65 , NanoBanana 23 and GPT-Image-1 44 , already achieve near-photorealistic quality. As models master realism, the frontier of innovation shifts to what is personally relevant to the user 45 . To address this gap, we introduce the Visual Personalization Turing Test (VPTT) (Figure. 1 ): a new paradigm for evaluating generative models. A model passes the VPTT if its output (image, video, 3D asset etc.) is indistinguishable to a human or a calibrated VLM judge from that a given person might plausibly create or share . This reframes the goal from rote memorization of appearance to the far more challenging task of simulating a personal perspective. Solving the VPTT presents three fundamental challenges. First, it requires a benchmark with thousands of diverse, culturally, and stylistically rich user profiles, yet real-world user data is inaccessible due to privacy concerns, fundamentally limiting academic research. Second, it demands a new technical approach beyond the fine-tuning one that can interpret a user’s complex, multi-faceted style from their history and apply it to new generations in a scalable, efficient manner. Third, it requires a robust evaluation protocol to test VPTT at large scale. We introduce the VPTT framework , designed to address these challenges at scale. To overcome the data barrier, we construct VPTT-Bench , the first large-scale benchmark of about 10,000 synthetic personas, whose visual worlds (30 assets - images for the scope of this paper) are represented entirely in text as “deferred renderings,” (structured, attribute-rich intermediates like lighting , materials, environment, actions, forground, background, appearance etc. that defer visual realization, analogous to G-buffers 12 in graphics) enabling privacy-safe research at scale. Additionally, we render about 1000 synthetic personas to create a rich visual library. As a possible solution to personalization at scale, we propose a novel visual personalization retrieval-augmented generation ( VPRAG ) system. Instead of costly retraining, our method conditions generation on a persona’s existing assets through hierarchical semantic retrieval with an optional learnable feedback and composes a personalized prompt enriched with their unique stylistic elements. Our evaluation framework for image generation and editing is two fold. We first introduce \mathrm{VPTT_{score}} as a automatic proxy for VPTT. We conduct a visual-level evaluation through VPTT, validated by human study and extended with calibrated VLM judges. This helps us establish strong correlations among all three evaluators text-level ( \mathrm{VPTT_{score}} ), VLM, and human, confirming that the \mathrm{VPTT_{score}} is a reliable, perceptually grounded proxy for visual judgment. After establishing this, we perform a large-scale deferred rendering analysis (about 120,000 evaluations) using the \mathrm{VPTT_{score}} . Our results show that VPRAG’s structured design achieves the best trade-off between output alignment and novelty, addressing a key limitation of black-box baselines. Our contributions are: • A new task formulation, the Visual Personalization Turing Test (VPTT), redefines success in visual personalization as achieving human indistinguishable authenticity. • VPTT Framework, the first scalable, privacy-safe benchmark for contextual personalization, featuring 10,000 rich personas with 1,000 visually rendered agents. • A novel Visual Personalization Retrieval-Augmented Generation (VPRAG) system, a structured, zero-shot engine for personalization offering a possible scalable solution. • A rigorous new evaluation framework featuring the VPTT score validated against human and VLM judges, proving it is a reliable proxy for perceptual alignment. • A comprehensive analysis on our benchmark using a mix of closed- and open-source models with varying computational budgets, demonstrating that VPRAG offers a better trade-off between performance and efficiency. 2 Related Work Figure 3 : VPTT-Bench Data Generation Pipeline. Overview of the deferred rendering pipeline used to construct VPTT-Bench. (1) Personas are sampled from PersonaHub 21 with demographics. (2–3) Visual and scenario elements (lighting, actions, materials etc.) are extracted. (4) These cues are composed into structured captions and embedded via an LLM. (5) Generating 30 corresponding visual assets per persona, forming privacy-safe, semantically grounded data for evaluating contextual personalization. Figure 4 : Example Personas from VPTT-Bench. Each row shows a synthetic persona sampled from PersonaHub 21 (only short descriptions) with its corresponding visual assets generated via VPTT-Bench generation pipeline. Personas span diverse