Predicting Region of Interest in Human Visual Search Based on Statistical Texture and Gabor Features
Hongwei Lin, Diego Andrade, Mini Das, Howard C. Gifford · 2026
Read Predicting Region of Interest in Human Visual Search Based on Statistical Texture and Gabor Features by Hongwei Lin, Diego Andrade, Mini Das, Howard C. Gifford (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-07998.txt.
Introduction
Hongwei Lin and colleagues predict where people will look in a visual search, using texture and oriented filter features. Understanding human visual search matters for vision science and computer vision. It also models how observers allocate attention when a target's location is unknown. Their 2026 preprint studies the link between Gabor features and texture features from gray-level co-occurrence matrices. The focus is early-stage search behavior.
Early attention decides which regions get examined at all. Statistical texture may tell the visual system where a target is plausible. Comparing two feature families shows which better tracks human gaze. Such models feed image quality assessment and interface design. The paper serves vision scientists and medical imaging scholars. It continues a line of work on predicting regions of interest in search tasks.
Catalog record
| CREATOR | Hongwei Lin, Diego Andrade, Mini Das, Howard C. Gifford |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-07998
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Predicting Region of Interest in Human Visual Search Based on Statistical Texture and Gabor Features Hongwei Lin, Diego Andrade, Mini Das, Howard C. Gifford Abstract Understanding human visual search behavior is a fundamental problem in vision science and computer vision, with direct implications for modeling how observers allocate attention in location-unknown search tasks. In this study, we investigate the relationship between Gabor-based features and gray-level co-occurrence matrix (GLCM)–based texture features in modeling early-stage visual search behavior. Two feature-combination pipelines are proposed to integrate Gabor and GLCM features for narrowing the region of possible human fixations. The pipelines are evaluated using simulated digital breast tomosynthesis images. Results show qualitative agreement among fixation candidates predicted by the proposed pipelines and a threshold-based model observer. A strong correlation ( r = 0.765 r=0.765 ) is observed between GLCM mean and Gabor feature responses, indicating that these features encode related image information despite their different formulations. Eye-tracking data from human observers further suggest consistency between predicted fixation regions and early-stage gaze behavior. These findings highlight the value of combining structural and texture-based features for modeling visual search and support the development of perceptually informed observer models. K eywords Visual Search \cdot Texture Features \cdot Gabor Features \cdot Model Observer \cdot Eye-tracking 1 Introduction Human visual search is a fundamental problem in vision science, concerned with how observers allocate attention and extract relevant information from complex visual scenes. In many applied settings, including medical imaging, effective system evaluation and optimization depend on observer performance, since human observers are the ultimate interpreters of image data. Understanding visual search behavior during image interpretation is therefore critical for predicting observer performance and for the development of perceptually informed model observers. Model observers have been developed as an essential tool for task-based image quality assessment [ 4 , 18 , 20 , 22 , 9 , 15 ] . Among various forms of model observers, the Visual Search Model Observer (VSMO) has been introduced to predict observer performance in location-unknown tasks in medical image interpretation by simulating how radiologists search for and detect abnormalities in images using a two-stage search-and-decision process [ 11 , 8 , 16 , 21 , 5 , 12 , 6 , 10 ] . In the first stage of VSMO, the fixation locations are estimated using difference-of-Gaussian (DoG) functions or Gabor functions. These features work as morphological match filters in the spatial domain and as band-pass filters in the frequency domain. Recently, an ideal observer to handle thresholded data in the location-unknown task has been proposed to further narrow down the possible fixation locations [ 17 ] . Meanwhile, it has been shown that certain second-order statistical image texture features can predict signal detection difficulty in tomographic breast images [ 19 , 13 , 14 ] . Texture features provide a quantitative description of spatial intensity patterns in images, capturing properties such as granularity, regularity, and local structural variation that are not fully characterized by simple intensity or edge-based measures. Among these, gray-level co-occurrence matrix (GLCM)–based features characterize texture by modeling the joint statistical distribution of gray-level pairs at specified spatial relationships, enabling sensitivity to both local contrast and spatial organization. The GLCM-based features have been shown to enhance the performance of fixation pattern prediction [ 1 , 2 ] . In this study, two pipelines have been designed to test the effect of combining GLCM–based features and Gabor features to narrow down the region of possible human fixations. The Gaussian mixture model is used in both pipelines to assist in the classification of either GLCM–based features or Gabor features. Simulated digital breast tomosynthesis 2D images are used to test the pipelines. The results are validated by visual exam and correlation calculations. 2 Materials and Methods 2.1 Data Simulation The DBT simulations were generated using the VICTRE pipeline [ 3 ] . We used the VICTRE software tools for phantom generation, X-ray production, and volume reconstruction. The X-ray projection was modeled using the Monte Carlo method based on tissue-radiation interaction physics. Simulated digital breast tomosynthesis (DBT) images were generated using an X-ray source operating at 30 kVp. The acquisition protocol included 25 projection images uniformly distributed over a 50-degree angular range. Image reconstruction was performed using a filtered back projection (FBP) algorithm, producing a voxel size of 0.1 \text{cm}^{3} . We generated breast images for three different breast densities, corresponding to the "mostly fatty", "scattered areas of dense" and "heterogeneously dense" categories described in the BI-RADS report. A spiculated mass (10 mm radius) was created at random locations near terminal duct lobular units. Examples are shown in Figs. 1(a) – 1(c) (a) Example of a 2D DBT slice of a breast phantom with density “mostly fatty”. (b) Example of a 2D DBT slice of a breast phantom with density “scattered areas of dense”. (c) Example of a 2D DBT slice of a breast phantom with density “heterogeneously dense”. Figure 1: Examples of 2D DBT slices of breast phantoms with different density categories. 2.2 Texture Features Texture features describe spatial patterns of intensity variation in images and provide information beyond individual pixel values, capturing local structure and contrast that are relevant to visual perception. In medical imaging, such features are commonly used to characterize background complexity and tissue heterogeneity. In this study, texture information was quantified using features derived from the gray-level co-occurrence matrix (GLCM). For a given image region, the GLCM is defined as the normalized joint probability of observing two pixels with gray levels i and j separated by a specified spatial offset \boldsymbol{\delta} . Let N(i,j\mid\boldsymbol{\delta}) denote the number of pixel pairs with gray levels i and j at offset \boldsymbol{\delta} , where i,j\in\{0,\ldots,G-1\} . The normalized GLCM is given by P(i,j\mid\boldsymbol{\delta})=\frac{N(i,j\mid\boldsymbol{\delta})}{\sum_{i=0}^{G-1}\sum_{j=0}^{G-1}N(i,j\mid\boldsymbol{\delta})}. (1) The first texture feature used was the GLCM mean, defined as the expected gray level of the reference pixel, \mathrm{GLCM}_{\text{mean}}=\sum_{i=0}^{G-1}\sum_{j=0}^{G-1}i\,P(i,j\mid\boldsymbol{\delta}). (2) The second texture feature was the GLCM contrast, which measures the degree of local intensity variation between neighboring pixels, \mathrm{GLCM}_{\text{contrast}}=\sum_{i=0}^{G-1}\sum_{j=0}^{G-1}(i-j)^{2}\,P(i,j\mid\boldsymbol{\delta}). (3) These features provide complementary descriptions of texture, with the GLCM mean capturing average gray-level structure and the GLCM contrast capturing local intensity differences that are relevant to visual search behavior. 2.3 Gabor Features The 2D Gabor function is an essential tool for localized frequency and orientation analysis in image processing. It is defined as follows: \begin{split}G(x,y)=\exp\left[-4(\ln 2)\frac{(x-x_{0})^{2}+(y-y_{0})^{2}}{W_{s}^{2}}\right]\\ \cdot\cos\left[2\pi f_{c}\left((x-x_{0})\cos(\theta)+(y-y_{0})\sin(\theta)\right)+\phi\right]\end{split}, (4) where (x,y) are the spatial coordinates of the image, and (x_{0},y_{0}) represent the center of the Gabor filter in the spatial domain. The parameter W_{s} denotes the width of the Gaussian envelope, which controls the spatial spread of the filter. The term f_{c} specifies the central frequency of the sinusoidal component, determining the filter’s frequency sensitivity. The orientation of the sinusoidal wave is given by \theta , allowing the filter to be tuned to specific edge directions, while \phi is the phase offset, shifting the cosine wave to match particular features in the image. These parameters were set to fit the size of images and targets. 2.4 Gaussian Mixture Model A Gaussian mixture model (GMM) is an unsupervised clustering method that models data as a combination of multiple Gaussian components. It assigns data points to multiple clusters to identify underlying group structure in feature spaces without requiring