JANUS: Anatomy-Conditioned Gating for Robust CT Triage Under Distribution Shift
Lavsen Dahal, Yubraj Bhandari, Geoffrey Rubin, Joseph Y. Lo · 2026
Read JANUS: Anatomy-Conditioned Gating for Robust CT Triage Under Distribution Shift by Lavsen Dahal, Yubraj Bhandari, Geoffrey Rubin, Joseph Y. Lo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13813.txt.
Introduction
Lavsen Dahal and three colleagues introduce JANUS, a body-guided dual-stream design for robust CT triage under spread shift. It tunes visual codes on macro-scan priors via body-map Guided Gating. On the MERLIN test set of 5,082 cases, JANUS attains macro-AUROC 0.88 and AUPRC 0.74, beating all copied rivals. The team further counts guess blocking with the body Veto Rate, showing JANUS reduces high-surety false hits under domain shift much more often than true hits.
Catalog record
| CREATOR | Lavsen Dahal, Yubraj Bhandari, Geoffrey Rubin, Joseph Y. Lo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21914 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13813
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
JANUS: Anatomy-Conditioned Gating for Robust CT Triage Under Distribution Shift Lavsen Dahal, Yubraj Bhandari, Geoffrey Rubin, Joseph Y. Lo Abstract Automated CT triage requires models that are simultaneously accurate across diverse pathologies and reliable under institutional shift. While Vision Transformers provide strong visual representations, many clinically significant findings are defined by quantitative imaging biomarkers rather than appearance alone. We introduce JANUS , a physiology-guided dual-stream architecture that conditions visual embeddings on macro-radiomic priors via Anatomically Guided Gating . On the MERLIN test set ( N = 5,082 N{=}5{,}082 ), JANUS attains macro-AUROC 0.88 0.88 and AUPRC 0.74 0.74 , outperforming all reproduced baselines. It generalizes to an external dataset ( N = 2,000 N{=}2{,}000 ; AUROC 0.87 0.87 ), with the largest gains on findings defined by size and attenuation as well as improved calibration on both datasets. We further quantify prediction suppression using the Physiological Veto Rate (PVR), showing that under domain shift JANUS reduces high-confidence false positives substantially more often than true positives. Together, these results are consistent with physically grounded conditioning that improves both discrimination and reliability in CT triage. Code is made publicly available at github repository https://github.com/lavsendahal/janus and model weights are at https://huggingface.co/lavsendahal/janus . 1 Introduction Automated CT triage seeks to flag clinically significant findings, many defined by quantitative thresholds rather than appearance alone: organomegaly by size, aneurysm by vessel caliber, calcific burden by HU density [ 12 , 7 , 17 , 15 ] . Missing such measurement-defined findings can have major consequences, e.g., an undetected aneurysm can rapidly escalate to a life-threatening event. As CT utilization grows and radiologist workloads intensify, reliable automated triage becomes a clinical necessity [ 13 , 22 ] . CT foundation models have emerged to meet this need, learning rich visual representations via large-scale pretraining [ 14 , 13 , 2 , 19 ] , yet lack explicit mechanisms for the measurement cues that define many urgent findings [ 11 ] . Under distribution shift, this gap becomes consequential: underlying anatomy is protocol-invariant, but visual appearance can shift with scanner and reconstruction settings [ 8 ] . Prior attempts to bridge this gap incorporated only coarse organ-level statistics (mean volume and mean HU) as auxiliary inputs to visual embeddings [ 3 ] , demonstrating that quantitative priors carry signal beyond visual features. Macro-Radiomics [ 5 ] enables a richer, clinically aligned measurement space, including organ-level descriptors, diameters, densitometry profiles, calcific burden, and fluid volumes. Unlike microscopic texture features, Macro-radiomics operate at the scale of radiological decision-making and are reliably computable for large, well-defined organs via modern segmentation models [ 21 , 4 ] . Yet how to enforce such measurements as structural constraints remains unaddressed. Additive fusion lacks an explicit suppression mechanism: under distribution shift, visual models could latch onto spurious correlations [ 6 ] and concatenation may not encourage selective suppression when predictions conflict with available quantitative priors. Multiplicative gating [ 16 , 10 ] provides this inductive bias: physical measurements modulate visual evidence through a learned bottleneck, structurally enabling suppression rather than merely shifting predictions. We introduce JANUS , a physiology-guided architecture that operationalizes this principle: quantitative measurements should constrain visual predictions, not merely augment them. Contributions. • Architecture. JANUS integrates the full macro-radiomic phenotype space with a visual stream via Anatomically Guided Gating : a disease-specific multiplicative bottleneck that modulates visual evidence through scalar priors, providing an explicit suppression mechanism. • Metric. We introduce the Physiological Veto Rate (PVR) to quantify suppression of high-confidence baseline false positives at fixed thresholds. To assess whether suppression is selective rather than uniform, we additionally report veto selectivity , defined as the ratio of false-positive suppression to true-positive suppression. On the external dataset, veto selectivity reaches 10.8\times , indicating suppression is strongly concentrated on high-confidence false positives while largely preserving true positives. • Empirical. JANUS achieves the highest macro-AUROC among reproduced baselines on MERLIN and maintains performance on an external dataset, while improving calibration (lower ECE) on both; results support macro-radiomic priors improving discrimination and reliability. 2 Methods Figure 1: JANUS Architecture. (a) A 3D CT volume is sampled into N 2.5D tri-slices; segmentation masks yield macro-radiomic scalar priors. (b) A DINOv3 backbone extracts patch embeddings condensed into a label-specific visual feature z_{v} via Organ-Masked Attention Pooling. (c) Scalar priors are projected and sigmoid-bounded to form a physiological gate g . (d) g modulates z_{v} via Hadamard product ( \odot ), acting as a Physiological Veto ; gated features z_{\text{gated}} are passed to a label-specific linear head. 2.1 Problem Formulation and the Geometric Gap We consider automated triage as a multi-label classification problem over a CT volume X\in\mathbb{R}^{D\times H\times W} with partially observed targets \mathbf{y}\in\{0,1,\emptyset\}^{L} , where \emptyset denotes missing labels. Let \delta_{\ell}=\mathbbm{1}[y_{\ell}\neq\emptyset] indicate label availability. Our goal is to learn a physiologically conditioned predictor P(\mathbf{y}\mid X,S) , where S encodes segmentation-derived macro-radiomic priors that provide explicit quantitative measurement context spanning anatomical scale and tissue densitometry. We initialize the visual backbone with DINOv3 weights [ 20 ] . Standard attention pooling is invariant to token count by construction: geometric quantities such as organ volume or vessel diameter are encoded in how many tokens an organ occupies, not per-token appearance, and is thus not explicitly represented in the pooled embedding, the pooling-induced geometric gap . We address this by conditioning visual evidence on explicit scalar priors S derived from segmentation. 2.2 JANUS Architecture We introduce JANUS (Fig. 1 ), a dual-stream physiology-guided model that couples (i) a visual stream extracting appearance features from X and (ii) a symbolic stream encoding macro-radiomic priors. JANUS fuses the two streams through a multiplicative gate that modulates the visual embedding using explicit anatomical measurements. Visual Stream: 2.5D Tri-slice Encoding. Given X , we construct a 2.5D representation by sampling axial slice centers \{t\}_{t=1}^{T} with stride s and forming a 3-channel input at each center by stacking adjacent slices: [X_{t-1},X_{t},X_{t+1}] (boundary slices are replicated). Each tri-slice is resized to a fixed resolution and normalized with ImageNet statistics. Passing all tri-slices through a DINOv3 ViT produces patch token embeddings. We discard the CLS token and DINOv3 register tokens and reshape tokens as \{u_{i}\}_{i=1}^{N} per tri-slice, yielding u\in\mathbb{R}^{B\times T\times N\times d} , where B is the batch size, N is the number of spatial patch tokens per tri-slice, and d is the embedding dimension ( d{=}768 for ViT-B). Dilated ROI-Masked Attention Pooling. For each label \ell , we define a disease-specific 3D ROI mask M_{\ell} by composing segmentation channels relevant to that pathology: a single organ for focal findings (e.g., aorta for Abdominal Aortic Aneurysm), a multi-organ union where appropriate (e.g., liver and spleen for hepatic steatosis), or a localization box where no organ proxy exists (e.g., appendicitis). To capture peri-organ context (e.g., fat stranding), we apply a resolution-adaptive morphological dilation of M_{\ell} by a physical radius r_{\ell} (mm), using voxel spacing to convert millimeters to per-axis kernel sizes. We align the 3D ROI mask with the tri-slice sampling by extracting a 2D mask at each tri-slice center t and resizing it to the encoder input grid. We then downsample this ROI to the ViT patch grid via nearest-neighbor interpolation to obtain a binary token mask m_{t,i,\ell}\in\{0,1\} indicating whether spatial position i in tri-slice t lies inside