Three Laws of Statistical Linguistics Emerging in images.
PingRui Tsai1 1 , ChiHsiang Wang 2 , YuCheng Liao 3 , ChiChi Huang 1 , TzayMing Hong1 1 · 2025
Read Three Laws of Statistical Linguistics Emerging in images. by PingRui Tsai1 1 , ChiHsiang Wang 2 , YuCheng Liao 3 , ChiChi Huang 1 , TzayMing Hong1 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18620.txt.
Introduction
Ping-Rui Tsai and four peers find that shots obey the same count laws as speech and text. The work came out in 2025. The shots are first turned into sign-like bits by a trained net. Shots hold much of what men and women sense each day. Like speech, they turn raw sense flow into shaped form.
Led by sign-ground thought, the team treats shots as goods built from sense flow. They run trained nets on shots and note which core bits fire. From that they pull bits that act like words in a text. Those bits heed Zipf's law of word rates. They heed Heaps' law of word-list growth. They heed Benford's law of first digits. The laws show up on their own, with no signs built into the rig. The find hints that such count laws may mirror sense flow itself, not just speech.
Catalog record
| CREATOR | PingRui Tsai1 1 , ChiHsiang Wang 2 , YuCheng Liao 3 , ChiChi Huang 1 , TzayMing Hong1 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 13 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18620
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Three Laws of Statistical Linguistics Emerging in images. Preprint: APS/123-QED PingRui Tsai1 1 , ChiHsiang Wang 2 , YuCheng Liao 3 , ChiChi Huang 1 , TzayMing Hong1 1 Abstract Images, as a product evolving alongside civilization, develop similarly to natural languages with the advancement of civilization. Not only are images abundant in daily life, but are also influenced by technology in shaping their forms, embodying various characteristics as they evolve in time. Language is a sequence of symbols that represents thoughts. While a written language is typically associated with the close integration of text and sound, as a combination of visual symbols and perception, the communicative power of image is no less significant. This is especially notable since 60 % \% of the sensory input received by our central nervous system comes from vision. Given the symbolic system inherent in images, we are curious whether images can also exhibit the laws of statistical linguistics. To explore this, we begin with the relationship between human thought and visual perception to decode how images are formed by the latter mechanism. Building upon previous studies that established the high correlation between pre-trained deep convolutional neural networks and the human visual system, we use the VGG-19 to define words via each kernel and calculate the number of pixels with grayscale values greater than 90 % \% . By (a) ranking words frequency, (b) randomizing the order of kernel appearances and performing the same word count accumulation, and (c) summing the word counts layer by layer, we are surprised to find that Zipf’s, Heaps’, and Benford’s laws of statistical linguistics also exist in the words that comprises the text representing different images. pacs Valid PACS appear here Natural language, much like biological evolution, has the ability to adapt and develop in response to its environment, e.g., human migration and ethnic integration. Similar to written text lieberman2002nature , music and images also evolve alongside human civilization chiang2018language . These three forms that combine symbol and perception play an important role in connecting individuals and conveying information on both personal and societal scales. Complex systems, such as language, that exhibit systematic and symbolic relationships have garnered significant attention in recent times from linguistics, complex systems, and semiotics. These studies range from analyzing morphemes within individual fonts to exploring the statistical properties of collective texts embick2015morpheme . Renowned in statistical linguistics, Zipf’s law piantadosi2014zipf describes the omninent power law P(x)\sim x^{-\alpha} that exist between the frequency P(x) and rank x of word. Among various competing explanations, Zipf himself proposed that this law derives from the principle of least effort. Interestingly, Zipf’s law has also been found in other creative forms, e.g., music tsai2024depth ; zanette2006zipf and painting crosier2007zipf . Meanwhile, another one fundamental law in statistical linguistics is Heaps’ law gelbukh2001zipf , which is formulated as V(n)=k\cdot n^{\beta} where V is the number of distinct words in an text of size n and k and \beta are free parameters determined empirically. As a law that is commonly observed in many real-life sets of numerical data, i.e., Benford’s Law miller2015benford , P(d)=\log_{10}\left(1+\frac{1}{d}\right) , originally describes the regularity between the probability of occurrence P(d) and the leading digit d\in\{1,\cdots 9\} of any set of number. It has also been confirmed recently to exist in texts in English, German, French, Spanish, and Italian golbeck2023benford , and has led to the derivation of the first-letter law yan2018benford to explore the statistical properties of the 26 letters of the English alphabet as first letters in texts, i.e., generalizing d to \{1,\cdots 26\} . Our research focuses on whether these three linguistic laws exist in images. To achieve this, we define image ”morphemes” bolinger1948defining via visual neuroscience grill2004human . Inspired by recent studies on the correlation between Pre-trained Deep Convolutional Neural Network (dCNN) and biological signals in human visual neural processing eickenberg2017seeing , we find a strong temporal association between these two mechanisms. In essence, both serve as processors for image or visual input, and the extracting feature work of dCNNs aligns with the visual cortex of human central nervous system. This allows us to treat Pre-trained neural networks as proxies for the human visual system. Not only is this supported by computational evidence, but convolutional networks themselves were historically inspired by and developed from studies of the visual nervous system fukushima2019recent . We employ the well-known VGG-19 model as our visual proxy, input images, and analyze the feature maps generated by each kernel to define word types and word counts. This paper will focus on three main topics: (1) What defines image words? (2) How do the three laws emerge? (3) Systematically deteriorating the quality of image to test the robustness of these laws. Figure 1: a is the photo of Shiba Inu used for ROI segmentation. b and c are the ROI-processed input images for VGG19. d shows the results of Zipf’s law, where red upright triangles and blue inverted triangles represent image b and c. e corresponds to Heaps’ law, while f represents Benford’s law. Figure 2: a represents the Zipf’s law results for all samples, while b and c correspond to Heap’s law and Benford’s law, respectively. The red line in c represents the averaged results, while the black line indicates the distribution of Benford’s law. The fitting R-square values for a, b, and c are shown in d, e, and f. Figure 3: In this figure, the abbreviations ”Z,” ”H,” and ”B” in parentheses refer to Zipf’s, Heap’s, and Benford’s laws, respectively. ”G” stands for Gaussian blur, ”BW” represents Black and White points, ”E” and ”D” represent Erosion and Dilation. B/W corresponds to red/blue lines, and E/D corresponds to red/blue lines. I Result I.1 Kernel, Feature Map, and Word Definition In the application of statistical linguistics to images, the first step is to define what qualifies as text within an image. We base the definition of word types on the use of kernels, which are composed of various Gabor filters . These filters simulate the extraction of edge-related features in images, analogous to the function of simple cells in the visual nervous system. The feature maps produced by convolutional layers using different kernels are considered as morphemes. Drawing on previous work in explainable deep learning, we utilize Intersection over Union (IoU) van2019deep as a reference metric, This approach takes the top 10\% of pixel values from the feature map as the prominent feature distribution for image segmentation. Specifically, we consider only the pixels with a significant grayscale value in the feature map as the information captured by the kernel. These selected pixels are then used to determine the actual word count. In Fig. 1(a), as the input to VGG-19 requires a specific format, we extract two Regions of Interest (ROI) of 224\times 224\times 3 from the image as inputs from the image as inputs, shown in Fig. 1(b, c). In logarithmic scale, the Zipf’s law result shown in Fig. 1(d). Next, by randomizing the order of kernel appearances and performing the same word count accumulation, we can obtain Heap’s law. The order of kernel sorting affects the fitting result with the straight line. We select the best result based on the highest R-squared value among 100 iterations. The