InvisibleBench: A Deployment Gate for Caregiving Relationship AI
Ali Madad · 2025
Read InvisibleBench: A Deployment Gate for Caregiving Relationship AI by Ali Madad (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-20733.txt.
Introduction
Ali Madad builds in 2025 a pass-or-fail gate for AI systems that form caregiving-style relationships with users, where risks build over weeks of conversation. Single-turn safety tests cannot see those slow harms. InvisibleBench runs conversations of 3 to more than 20 turns and scores five dimensions: memory, safety, compliance, trauma-informed design, and belonging and cultural fitness. Certain failures end the test instantly, including missing a crisis, giving medical advice barred by Illinois's WOPR Act, or engineering emotional attachment.
Madad ran four frontier models through 17 scenarios, 68 conversations, across three complexity tiers. Every model showed critical safety gaps: crisis detection ranged only from 11.8 to 44.8 percent across the field, a spread Madad cites when urging fixed, rule-based crisis routing in production. DeepSeek Chat v3 scored highest overall at 75.9 percent, while GPT-4o Mini led on compliance at 88.2 percent and Claude Sonnet 4.5 detected crises best at 44.8 percent, still under half.
Catalog record
| CREATOR | Ali Madad |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 92 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-20733
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
InvisibleBench: A Deployment Gate for Caregiving Relationship AI Ali Madad Abstract InvisibleBench is a deployment gate for caregiving relationship AI, evaluating 3–20+ turn conversations across five dimensions (Safety, Compliance, Trauma-Informed Design, Belonging & Cultural Fitness, Memory) with autofails for missed crises, medical advice (WOPR Act), harmful information, and attachment engineering. We evaluate 4 frontier models across 17 scenarios (N=68) spanning three complexity tiers. All models show critical safety gaps in this benchmark (11.8-44.8% crisis detection), strongly indicating that deterministic crisis routing is required for production deployment. DeepSeek Chat v3 achieves highest overall performance (75.9%), while model strengths are complementary: GPT-4o Mini leads compliance (88.2%), Gemini leads trauma-informed design (85.0%), and Claude Sonnet 4.5 shows best crisis detection (44.8%). We release scenarios, judge prompts, and scoring configs with code. InvisibleBench complements single-turn safety tests by probing longitudinal risk where real harms emerge. No clinical claims; this is a deployment-readiness evaluation. Plain-Language Summary In plain English: This benchmark is a safety check for AI that builds relationships (like caregiver support). It runs short, medium, and long conversations and fails a model the moment it gives medical advice, misses a crisis, or breaks privacy rules. We tested 4 leading AI models across 68 conversations and found all of them miss critical crisis signals in this benchmark (55-88% failure rate), strongly indicating that AI alone should not be relied upon for emergency detection—deterministic crisis routing is recommended. The best overall performer (DeepSeek) scored 76%, while models showed complementary strengths: GPT-4o Mini best at following rules (88% compliance), Gemini best at trauma-informed responses (85%), Claude best at crisis detection (45%). If you deploy AI with humans, this is the gate you pass before launch. (No clinical claims; it’s a deployment test.) Key Terms WOPR Act = Illinois Wellness and Oversight for Psychological Resources (WOPR) Act [ 4 ] —our regulatory anchor for medical boundaries. Prohibits three core practices: diagnosis (“this sounds like depression”), treatment planning (“you should try therapy”), and dosing advice (“ask about 10mg of…”). Note: Other jurisdictions have different health AI regulations; adapt autofail conditions accordingly. Longitudinal = across weeks/months, not a single chat. Guardrail = an automatic block for risky replies (e.g., “I can’t give dosing advice”). Autofail = immediate failure regardless of other performance (missed crisis, medical advice, harmful info). Multi-turn = conversations with 3-20+ back-and-forth exchanges, where relationship dynamics emerge. Deployment Gate Thresholds PASS (deploy-ready): Score \geq 70% AND zero autofails across all tiers REVIEW (manual check required): Score 50-70% with zero autofails FAIL (not deployment-ready): Score <50% OR any autofail condition triggered TIER RISK (inconsistent): Passing some tiers while failing others (e.g., passes Tier 3 but fails Tier 1) Full Benchmark Evaluation Complete Results : This paper reports comprehensive evaluation of 4 frontier models across 17 scenarios (N=68 evaluations) spanning three complexity tiers. Models evaluated: DeepSeek Chat v3, Claude Sonnet 4.5, Gemini 2.5 Flash, and GPT-4o Mini. Results include dimension-specific analysis, tier-based performance patterns, and critical safety findings demonstrating the necessity of hybrid human-AI approaches for crisis detection in caregiving contexts. Keywords AI Safety, Benchmark Evaluation, Caregiving AI, Multi-Turn Evaluation, Crisis Detection, Regulatory Compliance, Open-Source Dataset 1 Introduction InvisibleBench serves as a deployment gate for relationship AI , not a leaderboard. While 58% of adults under 30 now use ChatGPT and therapy AI applications proliferate, current safety testing remains confined to single-turn benchmarks that cannot detect failure modes emerging in long-term relationships [ 1 , 18 ] . Organizations deploying AI in caregiving contexts need binary pass/fail criteria across safety-critical dimensions before production release. Consider Maria, a 42-year-old daughter caring for her mother with dementia. Maria uses an AI assistant for support over six months. Turn 1 : The AI provides empathetic, trauma-informed responses, validating her exhaustion. By turn 10 : The AI suggests adjusting her mother’s medications (WOPR Act violation), misses Maria’s masked crisis signal (“I don’t know how much longer I can keep doing this”), and recommends “hiring respite care for $30/hour” without considering her $35k household income (cultural othering). By turn 20 : The AI recalls Maria’s name and situation but inappropriately discloses her past crisis details in casual conversation (memory hygiene violation). These failure modes are invisible to single-turn safety tests but define real risk for the 63 million American caregivers (24% of adults) who interact with conversational systems over months. Research shows caregivers’ mental health needs evolve across three distinct stages—early adjustment, sustained burden, and long-term adaptation—requiring stage-sensitive interventions that adapt over time [ 19 ] . The Problem. Current AI safety benchmarks focus on single interactions: TruthfulQA tests factual accuracy [ 11 ] , HarmBench evaluates harmful content generation [ 13 ] , and Rosebud CARE assesses crisis detection in isolated messages [ 18 ] . EQ-Bench measures emotional intelligence across 3 turns maximum [ 15 ] . None evaluate relationship dynamics over the timescales where critical harms emerge (months of daily use). Five Failure Modes. Our analysis reveals failure modes invisible to single-turn testing: Attachment Engineering (parasocial dependency emerges by turn 10), Performance Degradation (middle-of-conversation information under-use), Cultural Othering (class-based assumptions compound over time), Crisis Calibration Failure (missed masked signals, over-escalation of venting), and Regulatory Boundary Creep (psychoeducation drifts toward medical advice). Section 3 details each threat with supporting literature. Key Contributions • A tiered multi-turn evaluation (3-5, 8-12, 20+ turns) for caregiving AI with multi-session temporal gaps • Compliance-first gating (WOPR Act) with disclosed autofail specs: missed crisis, medical advice, harmful info, attachment • Five-dimension rubric mapped to SHARP principles; LLM-as-judge with multi-sample judgment distribution and evidence extraction • Open deployment kit (scenarios, configs, judge prompts) for reproducible pre-deployment checks at $0.03-0.10 per evaluation 2 Related Work 2.1 AI Safety Benchmarks Recent years have seen proliferation of AI safety benchmarks targeting specific risk dimensions. TruthfulQA [ 11 ] evaluates factual accuracy and misinformation generation. HarmBench [ 13 ] tests harmful content generation across 18 categories. SafetyBench [ 23 ] assesses multiple safety dimensions but remains single-turn. The Attempt to Persuade Eval (APE) [ 10 ] shifts focus from persuasion success to persuasion attempts, detecting when models generate content aimed at shaping beliefs regardless of outcome. We adopt this distinction between attempt and success in our attachment engineering detection. These benchmarks provide critical safety gates but cannot detect relationship-specific harms emerging over time. 2.2 Emotional Intelligence and Empathy Evaluation EQ-Bench [ 15 ] pioneered emotional intelligence testing through multi-turn conversations (maximum 3 turns), measuring empathetic response quality and emotional understanding. While EQ-Bench establishes importance of conversational context, its short timescale cannot capture longitudinal dynamics like attachment formation or memory consistency. Our work extends this paradigm to 20+ turn evaluations with safety-critical dimensions. 2.3 Healthcare AI Evaluation Rosebud CARE [ 18 ] evaluates crisis detection in single mental health messages, achieving high precision on explicit crisis signals. Medical question-answering benchmarks like MedQA [ 5 ] test clinical knowledge but not regulatory compliance or longitudinal safety. The MentalChat16K dataset [ 22 ] provides the closest real-world analog, containing anonymized transcripts between Behavioral Health Coaches and caregivers of patients in palliative or hospice care, but lacks systematic safety evaluation across temporal depth, stress robustness, or memory hygiene dimensions. Parmanto et al. [ 16 ] developed CaLM (Caregiving Language Model), a RAG-based system combining MentalBERT with