Semantic Scene Graph for Ultrasound Image Explanation and Scanning Guidance

Xuesong Li, Dianye Huang, Yameng Zhang, Nassir Navab, Zhongliang Jiang · 2025

Read Semantic Scene Graph for Ultrasound Image Explanation and Scanning Guidance by Xuesong Li, Dianye Huang, Yameng Zhang, Nassir Navab, Zhongliang Jiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19683.txt.

Description

Xuesong Li and co-authors translate ultrasound images into scene graphs so laypeople can understand them. Ultrasound varies wildly with settings and skill, and current AI summaries speak only to clinicians. A scene graph lists the anatomies present and how they relate. Their transformer builds that graph in one step, with no separate object detection.

A language model then turns the graph into plain answers shaped by the user's question. The same graph can coach scanning: if an expected structure is missing from view, the system nudges the user to find it. Tested on neck images, carotid and thyroid, from five volunteers, the approach made scans more complete and readings easier for non-experts.

Catalog record

CREATORXuesong Li, Dianye Huang, Yameng Zhang, Nassir Navab, Zhongliang Jiang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-19683

Browse the full library · About the Tower of Babel