Elements of Active Continuous Learning and Uncertainty Self-Awareness: a Narrow Implementation for Face and Facial Expression Recognition
Stanislav Selitskiy · 2025
Read Elements of Active Continuous Learning and Uncertainty Self-Awareness: a Narrow Implementation for Face and Facial Expression Recognition by Stanislav Selitskiy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05574.txt.
Introduction
Stanislav Selitskiy describes a neural network that watches another network and judges when its answers cannot be trusted. The lower network is an ensemble that recognizes faces and facial expressions. The watcher studies patterns in the lower network's activity to spot signs of high uncertainty.
The watcher keeps a memory of its own past performance and adjusts itself during training. When it rules an answer untrustworthy, the system switches into active learning mode and asks a human for help. Selitskiy frames this as a narrow form of machine self-awareness. Big ideas tied to general intelligence, he argues, can be modeled even inside small, focused learning systems.
Catalog record
| CREATOR | Stanislav Selitskiy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05574
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Elements of Active Continuous Learning and Uncertainty Self-Awareness: a Narrow Implementation for Face and Facial Expression Recognition Stanislav Selitskiy Abstract Reflection on one’s thought process and making corrections to it if there exists dissatisfaction in its performance is, perhaps, one of the essential traits of intelligence. However, such high-level abstract concepts mandatory for Artificial General Intelligence can be modelled even at the low level of narrow Machine Learning algorithms. Here, we present the self-awareness mechanism emulation in the form of a supervising artificial neural network (ANN) observing patterns in activations of another underlying ANN in a search for indications of the high uncertainty of the underlying ANN and, therefore, the trustworthiness of its predictions. The underlying ANN is a convolutional neural network (CNN) ensemble employed for face recognition and facial expression tasks. The self-awareness ANN has a memory region where its past performance information is stored, and its learnable parameters are adjusted during the training to optimize the performance. The trustworthiness verdict triggers the active learning mode, giving elements of agency to the machine learning algorithm that asks for human help in high uncertainty and confusion conditions. 1 Introduction Artificial Intelligence (AI) is quite a vague terminology artefact that has been overused many times, sometimes even for describing narrow software implementations of simple mathematical concepts such as multi-dimensional regression. It is understandable that to separate the high-level AI from the narrow level, such abbreviation as AGI (Artificial General Intelligence) was introduced. Sometimes even AGI gets associated with the “hype-style” conversation, therefore such alternatives as “human-level AI” [ 5 ] or “DL System 2” [ 4 ] , and others can used. The founders of AI research, such as A. Turing and J. McCarthy, who coined the very term AI, were sceptical about the worthiness of the attempts to answer what AI is. Instead, they suggested answering the question of how well AI can emulate or implement human-type intelligence [ 17 , 9 ] . N. Chomsky, in numerous lectures and publications (f.e. [ 2 ] ), even more categorically elaborated that AI is a human linguistic concept rather than an independent phenomenon. Suppose we accept discussing AI in the context of human-likeliness. There still should be room for learning from simple and narrow machine learning (ML) algorithms if they could be used as “building blocks” and working approximations of human-like intelligence. In this work, we want to concentrate on two aspects of human-likeliness intelligence functionality: continuous lifetime learning and awareness of uncertainty. Lifetime Learning (LTL) was introduced in the mid-’90s in the context of the robot learning process [ 15 ] . The LTL learner could face various tasks during its lifetime, and each new learning task may benefit from the saved successful models and examples of data they were trained and applied to [ 14 ] . From the human perspective, a high volume of training data forced on the learner is not a benefit. Rather abundance of potential data, from which the learner chooses a few characteristic examples and asks for the teacher’s expert advice, is more desirable. A similar Active Learning (AL) approach expects an ML algorithm to ask an “Oracle” advice on selected un-labelled data [ 8 ] , in particular when high uncertainty about a particular piece of data is occurred [ 6 ] . The idea of learning the ML processes was also introduced in the ’90s by the same author as LTL [ 16 ] , and recently gained traction in various flavours of meta-learning [ 18 ] . One of the directions of learning about learning is learning uncertainty of the learner [ 7 ] . To bring general considerations into a practical, although narrow perspective, we concentrate on making the meta-learning supervisor ANN model. It learns patterns of the functionality of the underlying CNN models that are associated with the failed predictions for Face Recognition (FR) [ 13 ] and Facial Expression Recognition (FER) tasks [ 12 ] , self-adjusting on the previous experience during training, as well as, test times. The reason to use FR and FER tasks is based not only on the fact that these are pretty human-centric ones but also, although State of the art (SOTA) CNN models had already passed the milestone of the human-level accuracy of face recognition several years ago in the ideal laboratory conditions. In the case of the Out of (training) Data Distribution (OOD) [ 10 ] , for example, makeup and occlusions, accuracy significantly drops. Even worse for FER algorithms and modes, which perform far worse than FR. The reason may be that the idea that the whole spectre of emotion expressions can be reduced to six basic facial feature complexes [ 3 ] was challenged because human emotion recognition is context-based. The same facial feature complexes may be interpreted differently depending on the situational context [ 1 ] . Applying the continuous uncertainty and trustworthiness self-awareness algorithms to FR and FER models and data sets built and partitioned to exaggerate and aggravate OOD conditions is a good area for evaluating the algorithms. The paper is organized as follows. Section 2 proposes a solution for dynamically adjusting the meta-learning trustworthiness estimating algorithm for predictions done for the FR and FER tasks. Section 3 describes the data set used for experiments; Section 4 outlines experimental algorithms in detail; Section 6 presents the obtained results, and Section 6 discusses the results, draws practical conclusions, and states directions of the research of not yet answered questions. 2 Proposed Solution 2.1 Uncertainty Meta-learning In [ 13 ] , two approaches to assigning a trustworthiness flag to the FR prediction were proposed: statistical analysis of the distributions of the maximal softmax activation value for correct and wrong verdicts, and use of the meta-learning supervisor ANN that uses the whole set of softmax activations for all FR classes (sorted into the “uncertainty shape descriptor” (USD) to provide class-invariant generalization) as an input and generates trusted or not-trusted flag. This contribution “marries” these two approaches by collecting statistical information about training results in the loss layer (LL) memory of the meta-learning supervisor ANN. The information in the LL’s memory holds prediction result y_{t} , training label result l_{t} , and trustworthiness threshold TT . The latter parameter is the learnable one, and the derivative of the loss error, calculated from these statistical data, is used to auto-configure the TT to optimize the sum of square errors loss: SSE_{TT}=\sum_{t=1}^{K}SE_{t} , where K is a number of entries in the memory table: SE_{TTt}=\begin{cases}{(y_{t}-TT)}^{2},&(l_{t}<TT\wedge\,y_{t}>TT)\vee\,(l_{t}>TT\wedge\,y_{t}<TT)\\ 0,&(l_{t}>TT\wedge\,y_{t}>TT)\vee\,(l_{t}<TT\wedge\,y_{t}<TT)\end{cases} (1) The input of the meta-learning supervisor ANN was built from the softmax activations of the ensemble of the underlying CNN models. The algorithm of building USD can be described in a few words as follows: “build the “uncertainty shape descriptor” by sorting softmax activations inside each model vector, order model vectors by the highest softmax activation, flatten the list of vectors, rearrange the order of activations in each vector to the order of activations in the vector with the highest softmax activation”. Examples of the descriptor for the M=7 CNN models in the underlying FR or FER ensemble, for the cases when none of the models, 4 , and 6 detected the face correctly, are