TRUST: Token‑dRiven Ultrasound Style Transfer for Cross‑Device Adaptation
Nhat-Tuong Do-Tran \authorrefmark 1, Ngoc-Hoang-Lam Le \authorrefmark 1, Ian Chiu \authorrefmark 2, Po-Tsun Paul Kuo \authorrefmark 3, and Ching-Chun Huang \authorrefmark 1 \authorrefmark 1National Yang Ming Chiao Tung University, Taiwan \authorrefmark 2Advantech Company, Taiwan \authorrefmark 3Adva · 2025
Read TRUST: Token‑dRiven Ultrasound Style Transfer for Cross‑Device Adaptation by Nhat-Tuong Do-Tran \authorrefmark 1, Ngoc-Hoang-Lam Le \authorrefmark 1, Ian Chiu \authorrefmark 2, Po-Tsun Paul Kuo \authorrefmark 3, and Ching-Chun Huang \authorrefmark 1 \authorrefmark 1National Yang Ming Chiao Tung University, Taiwan \authorrefmark 2Advantech Company, Taiwan \authorrefmark 3Adva (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00508.txt.
Introduction
Nhat-Tuong Do-Tran leads five authors in total, with Ngoc-Hoang-Lam Le, Ian Chiu, Po-Tsun Paul Kuo, and Ching-Chun Huang, on ultrasound style transfer. Scans from different devices look different in style, which lowers the accuracy of models trained on one device when used on another.
Do-Tran and his co-authors propose TRUST, a token-driven method that keeps source content while taking on the shared style of a target device. Their module picks suitable target tokens for each source token and optimal ones for the downstream model, guided by a behavior mirror loss, a penalty that matches model behavior. Added prompts help match content to that behavior. Tests beat prior unpaired translation methods on image quality and task scores.
Catalog record
| CREATOR | Nhat-Tuong Do-Tran \authorrefmark 1, Ngoc-Hoang-Lam Le \authorrefmark 1, Ian Chiu \authorrefmark 2, Po-Tsun Paul Kuo \authorrefmark 3, and Ching-Chun Huang \authorrefmark 1 \authorrefmark 1National Yang Ming Chiao Tung University, Taiwan \authorrefmark 2Advantech Company, Taiwan \authorrefmark 3Adva |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-00508
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TRUST: Token‑dRiven Ultrasound Style Transfer for Cross‑Device Adaptation Nhat-Tuong Do-Tran \authorrefmark 1, Ngoc-Hoang-Lam Le \authorrefmark 1, Ian Chiu \authorrefmark 2, Po-Tsun Paul Kuo \authorrefmark 3, and Ching-Chun Huang \authorrefmark 1 \authorrefmark 1National Yang Ming Chiao Tung University, Taiwan \authorrefmark 2Advantech Company, Taiwan \authorrefmark 3Advanced Operational Development, Delta Electronics, Inc, Taiwan \authorrefmark 1{tuongdotn.ee12, lengochoanglam.ee12, chingchun}@nycu.edu.tw, \authorrefmark [email protected], \authorrefmark [email protected] Abstract Ultrasound images acquired from different devices exhibit diverse styles, resulting in decreased performance of downstream tasks. To mitigate the style gap, unpaired image-to-image (UI2I) translation methods aim to transfer images from a source domain, corresponding to new device acquisitions, to a target domain where a frozen task model has been trained for downstream applications. However, existing UI2I methods have not explicitly considered filtering the most relevant style features, which may result in translated images misaligned with the needs of downstream tasks. In this work, we propose TRUST, a token-driven dual-stream framework that preserves source content while transferring the common style of the target domain, ensuring that content and style remain unblended. Given multiple styles in the target domain, we introduce a Token-dRiven (TR) module that operates from two perspectives: (1) a data view–selecting “suitable” target tokens corresponding to each source token, and (2) a model view–identifying “optimal” target tokens for the downstream model, guided by a behavior mirror loss. Additionally, we inject auxiliary prompts into the source encoder to match content representation with downstream behavior. Experimental results on ultrasound datasets demonstrate that TRUST outperforms existing UI2I methods in both visual quality and downstream task performance. † † Equal contribution: Nhat-Tuong Do-Tran and Ngoc-Hoang-Lam Le. † † Corresponding author: Ching-Chun Huang. 1 Introduction Ultrasound (US) imaging is widely adopted in clinical diagnosis due to its efficiency, affordability, safety, and real-time capability [ 1 , 2 ] . However, images acquired from different devices or medical centers often exhibit substantial variation in visual characteristics—such as intensity, contrast, resolution, and speckle patterns—due to differences in hardware configurations and acquisition protocols. These cross-device discrepancies pose serious challenges to both automated systems and human interpretation. Deep learning models, once trained on a specific source domain, tend to suffer significant performance degradation when deployed in unseen domains. Similarly, doctors—accustomed to images from familiar devices—may face difficulty interpreting cases from new devices that display unfamiliar style distributions. While retraining on new devices is a possible solution, it is often impractical: (1) For doctors , adapting to new device styles requires considerable effort in diagnosing new image characteristics. (2) For deployed AI models , fine-tuning is typically not feasible due to proprietary software constraints (i.e., cannot be reconfigured model parameters). To mitigate such domain shifts, Ultrasound Style Transfer (UST) has emerged as a promising solution. Instead of retraining, UST translates the source-domain images to match the style of the target domain while preserving their structural content. In this way, both doctors and downstream models operate in a target-style environment without altering their original behavior. Figure 1 : TRUST selects the most appropriate style token for each content token by considering both the data view (e.g., texture, pattern) and the model view (e.g., classification, segmentation), the latter enabled by auxiliary prompts injected into the content encoder. During the last decades, unpaired image-to-image translation methods have been explored, aiming to adapt images from the source domain to the target domain without requiring paired data. Among these, GAN-based methods [ 3 , 4 , 5 ] have been early solutions for bridging domain gaps, but are mainly effective for small shifts. Moreover, their shared discriminator often entangles content and style. Transformer-based models [ 6 , 7 ] have shown strong capabilities in disentangling content and style by separating their respective branches, effectively preventing undesired blending. Their self-attention mechanism enables a global understanding of spatial structure, which helps preserve content integrity and maintain consistent patterns across layers [ 8 , 9 ] . Despite these advantages, existing transformer-based methods often rely on pairwise style translation, which limits their ability to capture diverse styles, especially when the target domain exhibits multiple stylistic variations. Furthermore, transformer-based methods lack trustworthy token alignments, which are key to reliable downstream performance. To address the above challenges, we propose the TRUST , a T oken-d R iven U ltrasound S tyle T ransfer for Cross-Device Adaptation. Our method begins with a disentangling strategy that separates the source and target into content and style branches, respectively. This strategy enables explicit extraction and independent processing of style and content features, allowing finer control over the transfer. Inspired by Einstein’s mindset that “not all information is knowledge!” , TRUST recognizes that not all style features are beneficial for transfer. Naively integrating global style tokens can lead to artifacts, such as overly bright tumor regions or suppressed tissue contrast. To this end, TRUST employs a selective mechanism that searches through a pool of style tokens to identify those best aligned with each content token ( Figure 1 ). Crucially, the selection of style features is guided not only by the content tokens but also by auxiliary prompts injected into the content encoder layers. These prompts help the TR module more effectively retain task-specific and highly relevant style features. Together, the TR module and auxiliary prompts strengthen the connection between content and style branches, both at the data and model levels, enabling more accurate knowledge transfer. enabling more accurate knowledge transfer. Additionally, to align the output with the downstream task, we construct a mimic model that replicates the behavior of the black-box downstream model. Then, we use the mimic model’s predictions as supervision to align the styled image output through a behavior mirror loss. We summarize the key contributions of TRUST as follows: 1. The Token-dRiven (TR) module employs attention to identify trustworthy style tokens and selectively fuses them based on content relevance, enabling more precise and natural style integration. 2. We inject auxiliary prompts into the content encoder to enhance feature representation and more effectively minimize the domain gap. 3. We introduce a behavior mirror loss that uses a mimic downstream to replicate black-box behavior and supervise the styled image output. 4. Comprehensive experiments demonstrate that TRUST consistently outperforms baseline methods across multiple datasets, achieving outstanding results with well-preserved content structures and desirable style patterns. Figure 2 : Overview of the proposed TRUST framework for ultrasound style transfer . The architecture consists of a content branch with multi-layer auxiliary prompts for data adaptation, a style branch for extracting target style features, a Token-dRiven (TR) module that fuses latent source content tokens with target style tokens to perform style transfer, and a decoder that reconstructs the stylized ultrasound images. Given a frozen downstream task network, a behavior mirror loss ( \mathcal{L}_{bm} ) is introduced to provide task-specific supervision, encouraging the source content tokens to align with downstream objectives originally tailored for the target domain. 2 Proposed method 2.1 Problem definition We formulate the ultrasound style transfer for cross-device adaptation as an unpaired image-to-image translation problem. Let \mathcal{D}_{S}=\{(x_{s}^{i},y_{s}^{i})\}_{i=1}^{N_{labeled}}\cup\{x_{s}^{k}\}_{k=1}^{N_{unlabeled}} represent the source domain dataset, where a few x_{s}^{i} denotes an labeled image with corresponding annotations y_{s}^{i} , while the majority of source samples x_{s}^{k} are unlabeled. Similarly, \mathcal{D}_{T}=\{x_{t}^{j}\}_{j=1}^{N_{T}} represents the target domain dataset without annotations, where images x_{t}^{j} are acquired from different ultrasound scanners. Our goal