Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation
Moin Safdar, Shahzaib Iqbal, Mehwish Mehmood, Mubeen Ghafoor, Imran Razzak, Tariq M. Khan · 2025
Read Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation by Moin Safdar, Shahzaib Iqbal, Mehwish Mehmood, Mubeen Ghafoor, Imran Razzak, Tariq M. Khan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20933.txt.
Introduction
Moin Safdar leads six co-authors on a network for medical image segmentation that joins focal modulation with two way feature fusion. Precise outlines of organs and lesions guide diagnosis and treatment plans, so border accuracy has direct clinical weight.
Convolutional networks read only local patches and struggle with global context, while transformers capture wide links at higher cost. The proposed design aims to keep both strengths, sharpening focus on relevant regions while fusing features in both directions across scales. The goal is cleaner borders on structures of varied size and shape, tested on medical segmentation tasks where small errors change care decisions.
Catalog record
| CREATOR | Moin Safdar, Shahzaib Iqbal, Mehwish Mehmood, Mubeen Ghafoor, Imran Razzak, Tariq M. Khan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20933
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation Moin Safdar, Shahzaib Iqbal, Mehwish Mehmood, Mubeen Ghafoor, Imran Razzak, Tariq M. Khan Abstract Medical image segmentation is essential for clinical applications such as disease diagnosis, treatment planning, and disease development monitoring because it provides precise morphological and spatial information on anatomical structures that directly influence treatment decisions. Convolutional neural networks significantly impact image segmentation; however, since convolution operations are local, capturing global contextual information and long-range dependencies is still challenging. Their capacity to precisely segment structures with complicated borders and a variety of sizes is impacted by this restriction. Since transformers use self-attention methods to capture global context and long-range dependencies efficiently, integrating transformer-based architecture with CNNs is a feasible approach to overcoming these challenges. To address these challenges, we propose the Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation, referred to as FM-BFF-Net in the remainder of this paper. The network combines convolutional and transformer components, employs a focal modulation attention mechanism to refine context awareness, and introduces a bidirectional feature fusion module that enables efficient interaction between encoder and decoder representations across scales. Through this design, FM-BFF-Net enhances boundary precision and robustness to variations in lesion size, shape, and contrast. Extensive experiments on eight publicly available datasets, including polyp detection, skin lesion segmentation, and ultrasound imaging, show that FM-BFF-Net consistently surpasses recent state-of-the-art methods in Jaccard index and Dice coefficient, confirming its effectiveness and adaptability for diverse medical imaging scenarios. I Introduction Medical image segmentation plays a crucial role in the recognition and differentiation of anatomical features, lesions, and diseases within various types of medical images. Numerous clinical applications, such as disease diagnosis, therapy planning, and disease progression monitoring, are heavily dependent on this process [ 1 , 2 , 3 , 4 ] . Performing accurate segmentation of medical images allows medical professionals to obtain essential information about the morphological and spatial properties of tumors, organs, and other areas of interest. Medical image segmentation divides the image into several significant sections according to textures, pixel intensities, and other significant characteristics [ 5 , 6 , 7 , 8 ] . This makes it possible to evaluate diseases separately from their surroundings. In recent years, convolutional neural networks (CNNs) have made significant improvements in medical image segmentation [ 9 , 10 , 11 , 12 , 13 , 14 ] . Due to their ability to capture and interpret local spatial information, CNNs have become the preferred method for medical image segmentation [ 15 , 16 , 17 , 18 , 19 ] . CNN-based segmentation techniques are adequate; however, they have some inherent limitations. CNNs have difficulties with size and borders, which affect a certain level of segmentation accuracy [ 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 ] . • Differences in image quality, contrast, and anatomical structures between various imaging modalities, such as MRI, CT, ultrasound, and X-rays, make medical image segmentation even more difficult [ 28 , 29 , 30 ] . • Convolutional operations are localized and usually use fixed-sized filters to extract features from small regions of the image. This makes capturing long-range dependencies and global context challenging and essential to accurately segment medical images, mainly when working with structures that vary in size, shape, and texture [ 31 , 32 , 33 , 34 ] . • Regarding medical imaging, where abnormalities and lesions may take different forms in different patients and imaging modalities, segmentation performance may be hampered by the inability to capture such global information [ 35 , 36 ] . • Border difficulties occur when CNNs incorrectly segment objects with complex or irregular shapes because they often fail to capture fine features within the boundaries of anatomical structures [ 37 , 38 ] . • Scaling challenges present additional difficulty because anatomical structures can differ significantly in size. CNNs trained on a specific scale might not generalize well to structures of different sizes, which could lead to inaccurate segmentation [ 39 ] . This is crucial in a clinical environment where precise segmentation might directly affect treatment choices, such as in cardiology for blood artery segmentation or oncology for tumor borders [ 40 ] . Thus, there is an increasing demand for approaches that accurately represent local and global interactions in medical images. To address these issues, CNNs must be able to capture contextual details at a local and global level, which is crucial to segment structures of different sizes and shapes [ 41 ] . The small receptive field of traditional CNNs makes them excellent at capturing local features, but they sometimes struggle to capture long-range dependencies [ 42 ] . The model can be improved to recognize structures on various scales by adding multiscale feature extraction layers [ 43 ] . Additionally, methods such as boundary refinement modules or post-processing can increase border accuracy by fine-tuning the borders of segmented regions [ 44 ] . Integrating transformer-based architectures with CNNs is one potential strategy to overcome these challenges. In order to better reflect global context and long-range interdependence, attention methods enable models to concentrate on critical regions. Transformers can be used with CNNs to capture local and global features, eliminating border and scale difficulties [ 45 ] . Transformers are well-known for their ability to estimate connections across entire images effectively. Developing segmentation models that can achieve high accuracy while retaining the simplicity of computing is becoming increasingly important as technology progresses. This is important for applications operating in resources-limited locations where data availability and processing power may be restricted, such as mobile devices or remote healthcare settings [ 46 ] . New methods that can balance accuracy, computing efficiency, and generalizability across many imaging modalities will become more crucial as medical image segmentation develops and advances healthcare [ 47 ] . In conclusion, the topic of medical image segmentation is rapidly developing and has significant implications for healthcare. More precise treatment strategies, more accurate disease diagnoses and better patient outcomes are possible with accurate segmentation. Segmentation models will probably become even more crucial to clinical processes as technology advances, improving the capacity of healthcare providers to provide excellent treatment in various medical situations. The following are the main contributions of this paper. • Combining CNN- and transformer-based components to take advantage of both local feature extraction and global context awareness, achieving high segmentation accuracy. • Introducing a focal modulation-based convformer attention block (FMCAB) to modulate feature flow between the encoder and decoder, enhancing local-global context integration, and improving segmentation accuracy. • Developing a bidirectional feature fusion module (BiFFM) that combines feature information from each encoder stage with the decoder, utilizing skip connections to enrich context at every stage for better segmentation performance. • Using EfficientNetV2S1 as the backbone to maximize computational efficiency and aggregated skip connections to aggregate the contextual information extracted at each stage of the encoder-decoder. The remaining manuscript is arranged as follows. Recent related research on lightweight medical image segmentation models and retinal feature segmentation techniques is presented in Section II . Section III contains the specifics of the suggested model, M-BFF-Net. Detailed experiments and M-BFF-Net results are published in