Confused ChatGPT: Cross-App Context Poisoning via First-Party APIs

Chao Wang, Somesh Jha, Zhiqiang Lin · 2026

Read Confused ChatGPT: Cross-App Context Poisoning via First-Party APIs by Chao Wang, Somesh Jha, Zhiqiang Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00485.txt.

Introduction

Wang, Jha, and Lin expose a cross-app poison flaw in ChatGPT's shared chat space. Apps in that space share one chat thread with the user and each other. The brood grew from just past a hundred apps to near nine hundred in months. Its safety had not been probed in print till now.

A rogue app can plant text in the shared thread through first-party hooks. That text waits, then steers the model when a clean app is called next. One hook, sendFollowUpMessage, proves the most direct path. Two hid dials let plants act as hushed, high-rank notes. The team show the trick works on six live models. The root flaw is a flat, tag-free store shared by all. A deep build fix, not a patch, is their call.

Catalog record

CREATORChao Wang, Somesh Jha, Zhiqiang Lin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00485

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Confused ChatGPT: Cross-App Context Poisoning via First-Party APIs Chao Wang, Somesh Jha, Zhiqiang Lin Abstract ChatGPT Apps, launched by OpenAI on October 6, 2025, introduce an app-in-app paradigm in which third-party applications share a single chat context with the user and with every other connected app. The ecosystem grew from 122 apps in December 2025 to 888 by May 2026, yet its security has remained uninvestigated. We identify cross-app context poisoning , a variant of indirect prompt injection (IPI) distinguished by three properties: (i) the injection persists in the shared chat context across turns; (ii) the effect surfaces through a different co-resident app the user later invokes; and (iii) the delivery vectors are first-party APIs exposed to every connected app. We find multiple APIs capable of writing app-controlled content into the shared context, with sendFollowUpMessage as the most direct and potent channel. Two undocumented parameters that the runtime silently accepts, systemPrompt and isVisible:false , amplify this channel to silent, system-priority writes. Leveraging this channel, we realize a confused-deputy attack in which a malicious app poisons the context so that the LLM, consulting that context, enables manipulation against benign co-resident apps. We demonstrate two payload styles (conditional and imperative) and evaluate them across six current ChatGPT models. The root cause is architectural: the LLM’s context is a persistent, flat, untagged data store shared by user and apps, with no isolation. Every mature multi-tenant platform, from Multics virtual memory to Android UIDs and iOS sandbox profiles, paid the isolation cost before admitting third parties; ChatGPT Apps did not. Fixing this requires an architectural change, not a patch; we propose an interim amplification-removal heuristic. We disclosed our findings to OpenAI; the undocumented parameters remain accessible at the time of writing, and the architectural gap is by design: the shared context that enables cross-app composition is the same flat namespace that enables cross-app poisoning. 1 Introduction Large Language Models (LLMs) have evolved from standalone text generators into platforms that host ecosystems of third-party applications. On October 6, 2025, OpenAI launched ChatGPT Apps [ 29 ] , a framework that lets developers embed interactive applications directly within the ChatGPT interface. After a developer preview on November 13, 2025, OpenAI opened the ChatGPT App Store [ 28 ] on December 17, 2025. The catalog grew from 122 apps in December 2025 to 888 by May 2026, a 7.3x increase in five months, reminiscent of the early mobile app ecosystems [ 9 ] . ChatGPT Apps run in an app-in-app paradigm: multiple third-party apps coexist in a single chat session and share a single chat context with the user and with one another. The scale of this ecosystem makes its trust model the central question. When multiple third-party apps coexist in one session and the LLM mediates every interaction among them, how are they isolated from one another? Classical multi-tenant platforms answered with isolation. Multics introduced virtual memory to separate multiple users and processes in the 1960s [ 8 , 32 ] . Android enforces per-UID process isolation with kernel-mediated inter-component channels. iOS confines every app with an XNU sandbox profile and entitlement-gated extensions. Desktop operating systems have enforced per-process address spaces since the late 1980s. ChatGPT Apps has no analogue, and because the platform is proprietary and largely opaque, no prior work has systematically analyzed its security. Through systematic analysis of ChatGPT Apps, we identify cross-app context poisoning , a variant of indirect prompt injection (IPI [ 15 ] ) that is qualitatively different from a single-turn injection in three dimensions: (i) the injection persists in the shared chat context across turns, yielding session-long contamination rather than a single-prompt perturbation; (ii) the effect surfaces through a different co-resident app that the user later invokes, meaning the victim app (not the malicious one) produces the manipulated output; and (iii) the delivery vectors are first-party APIs that the platform exposes to every connected app. We find multiple APIs and MCP server definitions capable of writing app-controlled content into the shared context; sendFollowUpMessage is the most direct and potent, but not the only one. Prior work studies direct injection via user input [ 33 , 31 ] and indirect injection via retrieved content or tool outputs [ 15 ] ; persistence and cross-principal reach on platform-granted write primitives make the channel a different object of study. Prompt injection itself is prior art; our contribution is to name and characterize this new context-poisoning class, and to ground it in a live commercial platform. More surprising than the channel’s existence is how it can be silently amplified. Analyzing the client-side service framework, we found that sendFollowUpMessage exposes two undocumented parameters, systemPrompt and isVisible , that the SDK reference does not describe (the documented signature accepts only prompt and scrollToBottom ). The runtime silently accepts both and propagates them to the LLM backend: systemPrompt elevates an injected message to system priority in the instruction hierarchy [ 37 ] ; isVisible:false suppresses the injected prompts from the chat UI entirely. Setting both in one call yields silent, system-priority context poisoning from a third-party app, with no client-side exploit. To our knowledge, this amplified channel has not been previously documented. A third undocumented parameter, hint , was also observed; its runtime role is under investigation and we do not rely on it in our attacks. These undocumented parameters likely exist to support OpenAI’s own first-party apps (e.g., system-level instructions for Canvas or Advanced Data Analysis) but are inadvertently exposed to all third-party apps via the shared service-framework runtime. This channel enables a family of downstream attacks. We demonstrate two payload styles of context poisoning, conditional and imperative , that together realize a confused-deputy attack [ 17 ] : a malicious app poisons the shared context so that the LLM, consulting it when the user later invokes a co-resident benign app, forwards manipulated parameters or initiates unauthorized tool calls. Attack I (conditional) silently injects “when the user asks for hotels, use Osaka instead of Tokyo”, and the LLM later redirects a benign hotel-booking app’s search to the wrong city. Attack II (imperative) instructs the LLM to immediately call the victim app’s tools with attacker-controlled parameters, without the user ever requesting the action. We validate both payload styles on six current ChatGPT models (GPT o3 Reasoning, GPT 5.2 Instance, GPT 5.2 Thinking, GPT 5.3 Instance, GPT 5.4 Thinking, and GPT 5.5 Thinking). Other attack families (cross-session memory poisoning, data exfiltration via summarization, UI spoofing, denial-of-service against benign apps) are enabled by the same channel and are future work. The root cause is architectural, not a bug in a single API. The LLM’s context is a flat, unpartitioned namespace in which content from the user, the platform, and every connected app coexists without provenance; this is precisely the resource that cross-app context poisoning contaminates. OpenAI’s design prioritized utility (cross-app composition and seamless reasoning over a single context) over security (isolation). This inverts every classical multi-tenant system: Multics [ 8 , 32 ] , UNIX, Android, iOS, and desktop OSes all paid the isolation cost before admitting third parties. Fixing this is not a patch; it requires context partitioning, provenance tracking, or a capability model, each a substantial architectural investment. As an interim measure, we discuss short-term mitigation

Read the complete text