No Intelligence Without Statistics: The Invisible Backbone of Artificial Intelligence
Ernest Fokoué · 2025
Read No Intelligence Without Statistics: The Invisible Backbone of Artificial Intelligence by Ernest Fokoué (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19212.txt.
Introduction
Ernest Fokoué argues that statistics is the hidden base of artificial intelligence. The common story credits computer science and engineering. He says that story misses the core. The theory and methods of these systems are statistical. They have been so from the start.
His case runs pillar by pillar. The pillars span inference, density estimation, and sequential learning. They also span generalization, representation learning, and interpretability. Causality, optimization, and unification close the list. Each pillar rests on statistical ideas from the past century. The essay asks teachers to give statistics its central place.
Catalog record
| CREATOR | Ernest Fokoué |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19212
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
No Intelligence Without Statistics: The Invisible Backbone of Artificial Intelligence Ernest Fokoué Abstract The rapid ascent of artificial intelligence (AI) is often portrayed as a revolution born from computer science and engineering. This narrative, however, obscures a fundamental truth: the theoretical and methodological core of AI is, and has always been, statistical. This paper systematically argues that the field of statistics provides the indispensable foundation for machine learning and modern AI. We deconstruct AI into nine foundational pillars—Inference, Density Estimation, Sequential Learning, Generalization, Representation Learning, Interpretability, Causality, Optimization, and Unification—demonstrating that each is built upon century-old statistical principles. From the inferential frameworks of hypothesis testing and estimation that underpin model evaluation, to the density estimation roots of clustering and generative AI; from the time-series analysis inspiring recurrent networks to the causal models that promise true understanding, we trace an unbroken statistical lineage. While celebrating the computational engines that power modern AI, we contend that statistics provides the brain —the theoretical frameworks, uncertainty quantification, and inferential goals—while computer science provides the brawn —the scalable algorithms and hardware. Recognizing this statistical backbone is not merely an academic exercise, but a necessary step for developing more robust, interpretable, and trustworthy intelligent systems. We issue a call to action for education, research, and practice to re-embrace this statistical foundation. Ignoring these roots risks building a fragile future; embracing them is the path to truly intelligent machines. There is no machine learning without statistical learning; no artificial intelligence without statistical thought. 1 From the Grammar of Science to the Engine of AI: The Statistical Imperative If we wish to build intelligent systems, we must first ask: what is intelligence, but the capacity to find meaningful patterns and make reliable predictions in a complex, uncertain world? This is not a new problem; it is the fundamental problem of science itself. Karl Pearson, in his seminal work The Grammar of Science ( Pearson 1930 ) , asserted that "the whole field of scientific investigation is co-extensive with the applications of statistics." In this light, statistics is not merely a branch of mathematics; it is the very grammar—the underlying logical structure—for reasoning from empirical evidence. This pursuit is rooted in the human condition. We are, by nature, pattern-seeking creatures, instinctively calculating central tendencies and assessing variances in our environment. Our philosophical traditions have long grappled with the chasm between observation and truth. Plato’s allegory of the cave reminds us that we see but shadows of a deeper reality—shadows that statistics treats as data, from which we must infer the nature of the true forms. William of Ockham’s razor, a principle of parsimony, finds its formal expression in statistical regularization and model selection, penalizing unnecessary complexity. Karl Popper’s doctrine of falsification is operationalized through statistical hypothesis testing, where we can never confirm a model, only fail to reject it ( Fisher 1935 ) . The mathematical machinery for this endeavor was forged in the fires of uncertainty. The correspondence between Blaise Pascal and Pierre de Fermat gave birth to probability theory. Thomas Bayes and Pierre-Simon Laplace laid the groundwork for inductive inference, providing a formal mechanism for updating beliefs in the light of new data ( Laplace 1951 ) . This lineage culminated in the work of Francis Galton, Karl Pearson, and R.A. Fisher, who transformed these ideas into the modern discipline of statistics, with its core concepts of correlation, regression, and maximum likelihood estimation ( Pearson 1901 ; Fisher 1922 ) . Eugene Wigner marveled at the "unreasonable effectiveness of mathematics in the natural sciences" ( Wigner 1960 ) ; we contend that it is the reasonable effectiveness of statistics that is truly indispensable, for it provides the framework to manage the uncertainty that Wigner’s idealized mathematics often ignores. The 20th century witnessed a symbiotic convergence. The theoretical foundations of computation, laid by Alan Turing and John von Neumann, provided the physical engine. Yet, it is crucial to recognize that this engine was, from its inception, imbued with a statistical soul. Von Neumann’s architecture was designed for deterministic, procedural calculation. But the problems of the real world—the "shadows in the cave"—are not deterministic. They are noisy, incomplete, and probabilistic. The great leap was the realization that this rigid computational engine could be harnessed to execute flexible, fault-tolerant statistical learning processes. Claude Shannon’s information theory ( Shannon 1948 ) provided the currency, and figures like Turing himself, with his Bayesian approach to code-breaking, exemplified the fusion. The Heisenberg Uncertainty Principle in physics finds its parallel in the bias-variance trade-off in statistics: a fundamental, inescapable tension between accuracy and precision in any measurement or model. It is against this rich historical and philosophical tapestry that the ascent of artificial intelligence must be viewed. The common narrative celebrates the computational horsepower—the faster processors and larger memories—while ignoring the intellectual software that gives them purpose. This paper aims to correct this narrative. We posit that the theoretical and methodological core of AI is, and has always been, statistical . The excitement around deep learning and generative AI has created a form of historical amnesia, where the extensive statistical lineage of these methods is often ignored or forgotten. As LeCun et al. 2015 themselves acknowledge, deep learning’s optimization, generalization, and inference frameworks are thoroughly statistical. Pearl 2009 laments the lack of causal reasoning in modern ML, a field built entirely upon statistical foundations. This paper is therefore a reclamation project. It is structured as a journey through the nine fundamental pillars of statistics that not only support but constitute the very essence of AI. We will demonstrate that from its theoretical roots to its modern algorithms, artificial intelligence is applied statistics at scale. This is not to diminish the monumental achievements of computer science in creating the scalable algorithms and hardware that realize these statistical principles. Rather, it is to clarify their respective roles: statistics provides the what and why of learning, while computer science provides the how. Our argument is not one of mere precedence, but of essential identity. To build the future of AI on a stable foundation, we must first acknowledge the ground on which it stands. 1.1 The Human Engine: From Statistical Calculation to Computational Learning Long before silicon, there was flesh and blood. The first "computers" were not machines, but humans—often teams of highly skilled women, such as those at the Indian Statistical Institute under Mahalanobis and at the University of Pennsylvania’s Moore School—who performed the monumental calculations required for multivariate analysis, ballistics tables, and early economic modeling. They were executing statistical algorithms by hand. This historical fact underscores a profound truth: the statistical questions came first ; the electronic computer was invented as a tool to solve them at scale. The design of these studies— how to collect data to best answer a specific question—is the domain of experimental design, a cornerstone of statistical science formalized by R.A. Fisher. This principle is experiencing a renaissance in modern AI through paradigms like active learning , where the model itself statistically guides the data acquisition process to maximize information gain. The cycle is complete: statistical thinking now guides the computational engine on what data to compute on. 1.1.1 The Generalized Linear Model (GLM) as a Proto-Neural Network A profound,