Singpath-VL Technical Report

Zhen Qiu, Kaiwen Xiao, Zhengwei Lu, Xiangyu Liu, Lei Zhao, Hao Zhang · 2026

Read Singpath-VL Technical Report by Zhen Qiu, Kaiwen Xiao, Zhengwei Lu, Xiangyu Liu, Lei Zhao, Hao Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09523.txt.

Introduction

Cervix screening still lacks an AI assistant, largely because large, high-quality labeled sets are scarce. Zhen Qiu and five co-authors present Singpath-VL, a 2026 report on a vision-language model built to fill that gap. Gains in mixed-media models have pushed disease study forward, but cell study, and cervix screening in particular, remains little studied.

The team first builds a three-stage chain to build a million-scale image-notes dataset. General-purpose mixed-media models act as weak labelers, their outputs refined by shared verdict and expert knowledge adding into high-truth cell shape notes. Fine-tuning a four-billion-weight vision-language base through multiple stages yields Singpath-VL, which excels at fine-grained shape reading and cell-level diagnosis sorting. Part of the dataset and benchmark will be open-sourced.

Catalog record

CREATORZhen Qiu, Kaiwen Xiao, Zhengwei Lu, Xiangyu Liu, Lei Zhao, Hao Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09523

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Singpath-VL Technical Report Zhen Qiu, Kaiwen Xiao, Zhengwei Lu, Xiangyu Liu, Lei Zhao, Hao Zhang Abstract We present Singpath-VL , a vision-language large model, to fill the vacancy of AI assistant in cervical cytology. Recent advances in multi-modal large language models (MLLMs) have significantly propelled the field of computational pathology. However, their application in cytopathology, particularly cervical cytology, remains underexplored, primarily due to the scarcity of large-scale, high-quality annotated datasets. To bridge this gap, we first develop a novel three-stage pipeline to synthesize a million-scale image-description dataset. The pipeline leverages multiple general-purpose MLLMs as weak annotators, refines their outputs through consensus fusion and expert knowledge injection, and produces high-fidelity descriptions of cell morphology. Using this dataset, we then fine-tune the Qwen3-VL-4B model via a multi-stage strategy to create a specialized cytopathology MLLM. The resulting model, named Singpath-VL, demonstrates superior performance in fine-grained morphological perception and cell-level diagnostic classification. To advance the field, we will open-source a portion of the synthetic dataset and benchmark. 1 Introduction The advent of multimodal large language models (MLLMs) has marked a paradigm shift in artificial intelligence, enabling unified understanding and generation across vision, language, and other modalities. General-purpose MLLMs, pre-trained on vast and diverse corpora, have demonstrated remarkable zero-shot capabilities in describing medical images and answering related questions. For computational pathology, this technology holds transformative potential, offering avenues for automated diagnostic assistance, comprehensive slide analysis, and interactive educational tools. Despite this progress, the application of MLLMs in the specialized sub-field of cytopathology —particularly in cervical cytology screening based on The Bethesda System (TBS)—remains significantly underexplored. A primary and formidable bottleneck is the acute scarcity of large-scale, high-quality, publicly available datasets that pair cytopathology images with detailed, expert-level morphological descriptions. Unlike histopathology, where tissue architecture provides rich, contextual visual information, cytopathology diagnosis relies on the precise interpretation of subtle cellular and nuclear features (e.g., nuclear hyperchromasia, irregular nuclear membranes, and increased nuclear-to-cytoplasmic ratio) from individual cells or small cell clusters. This demands a model with an exceptionally fine-grained visual grounding capability, for which generic medical image-text data is insufficient. Current approaches often rely on manually curated, small-scale datasets or adapt general vision-language models with limited success, failing to capture the nuanced expertise required for accurate cytodiagnosis. While some studies have leveraged foundation models as weak annotators to generate data in other domains, a tailored, robust pipeline for the high-stakes, detail-sensitive domain of cytopathology is lacking. The need, therefore, is twofold: (1) a scalable method to generate faithful and rich cytology-specific image-text data, and (2) a specialized model trained effectively on such data to master the domain’s visual lexicon and diagnostic logic. To address these challenges, we present Singpath-VL , a novel vision-language assistant for cervical cytology. Our work makes three key contributions: • Novel Data Generation Pipeline: We introduce an automated, three-stage pipeline to synthesize a million-scale, high-fidelity image-description dataset ( Singpath-CytoText ) from an internal repository of cervical cytology image tiles. This pipeline strategically employs multiple open-source MLLMs (e.g., Qwen3-VL, InternVL-3.5) as weak annotators , fuses their consensus descriptions via a large language model, and finally refines the output with a domain-specific expert model to ensure accuracy and completeness. • Specialized Model Training: We develop Singpath-VL by fine-tuning the Qwen3-VL-4B foundation model on our generated dataset through a multi-stage training recipe. This regimen includes vision-language alignment, supervised fine-tuning for instruction following, and a knowledge replay strategy to mitigate catastrophic forgetting, thereby balancing deep domain adaptation with the retention of beneficial general knowledge. • Superior Performance & Open-Source Contribution: We demonstrate that the proposed method significantly outperforms baseline general-purpose MLLMs in the perception of fine-grained morphological patterns and in cell-level diagnostic classification tasks. To promote further research and transparency, we commit to open-sourcing a portion of the Singpath-CytoText dataset. The remainder of this paper is organized as follows: Section 2 details our data generation pipeline and model training strategy. Section 3 presents experimental results and analysis. Finally, Section 4 discusses future directions. 2 Method In this section, we detail the proposed data curation pipeline and training recipe. 2.1 Data Curation The development of a specialized vision-language model for cervical cytology is fundamentally constrained by the scarcity of large-scale, high-quality annotated datasets. Given that general-purpose MLLMs have been trained on some cytological content, we exploit them to generate image description data. We begin by evaluating a suite of the latest open-source MLLMs, including Qwen3-VL-32B, InternVL-3.5-38B, Baichuan-Omni-1.5, and Medgemma-27B. Our preliminary study reveals significant disparities in their ability to accurately identify different morphological features ( e.g., nuclear-to-cytoplasmic ratio, chromatin pattern). To this end, we propose to leverage the complementary strengths of these state-of-the-art, open-source MLLMs as weak annotators to synthesize caption for image tiles. To synthesize a large-scale high-fidelity dataset, we designed a novel three-stage generation pipeline. This pipeline intelligently aggregates and refines outputs from multiple foundation models, followed by targeted expert refinement. Stage 1: Parallel Image Caption Generation Given an image tile cropped from a cervical cytology WSI, we query three distinct, powerful MLLMs, i.e., Qwen3-VL-32B, InternVL-3.5-38B, and Baichuan-Omni-1.5, in parallel. Each model is prompted to generate a textual description focused on a predefined set of key morphological analysis dimensions relevant to TBS-based cell classification. This yields three independent, and potentially diverse, preliminary descriptions. Stage 2: Consensus Fusion and Coherent Summarization The three descriptions from Stage 1 are fed into a large language model (LLM) acting as an information integrator . The LLM is instructed to perform two key tasks: • Consensus Extraction and Conflict Resolution: Identify morphological features consistently described across the majority of the input texts. • Feature Filtering and Text Rewriting: Automatically filter out feature points that the foundation models consistently fail to perceive correctly due to a lack of model capability, deeming them model-missing dimensions . The LLM then synthesizes the consensus information into a single, fluent, and structured paragraph. Stage 3: Expert Knowledge Injection To address the model-missing dimensions filtered out in Stage 2 and to inject domain-specific precision, we introduce a final refinement stage. A smaller, finely-tuned expert model —specialized in cervical cytopathology—analyzes the original image patch and the fused description of the Stage 2. Its role is to supplement the description with any critical, fine-grained morphological details that the generalist MLLMs may have overlooked or described inadequately, producing the final, high-quality description. Generated Dataset By applying this pipeline to our extensive internal repository of cervical cytology image tiles, we successfully constructed Singpath-CytoText , a million-scale multimodal dataset. Each data point consists of an image tile paired with a description that combines structured morphological insights with coherent narrative summary text, providing a robust foundation for training sophisticated cytopathology-specific MLLMs. 2.2 Training Recipe Figure 1 : Overview of the multi-stage training recipe for Singpath-VL. The pipeline consists of three consecutive stages: (1) Vision-Language Alignment for domain grounding, (2) Supervised Fine-Tuning for instruction following, and (3) Knowledge Replay for mitigating catastrophic forgetting, resulting in a specialized and robust cervical cytology MLLM. To develop a multimodal large language model (MLLM) for cytopathology, we employ the latest Qwen3-VL-4B as our base model. Our fine-tuning strategy consists of three sequential stages designed to endow the model with domain-specific visual understanding, instruction-following capability, while mitigating catastrophic forgetting. The overall pipeline is illustrated in Figure 1 . Stage

Read the complete text