Attractor FCM
Alexis Kafantaris · 2026
Read Attractor FCM by Alexis Kafantaris (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27947.txt.
Introduction
Kafantaris builds and tests an attractor FCM learning by gradient descent under physics limits, in Jacobian form not Hebbian, agentic, or hybrid. It keeps leftover memory, learns through time, and anchors on a fixed point refreshed step by step to update weights, keeping system memory. A Newton step first finds the fixed-point attractor, then descent reshapes the landscape, steering weights through attractor dynamics. Descent shifts with sigmoid saturation to dodge early local stalls. A causal mask filters updates by physics and expert views, driving error to target.
Catalog record
| CREATOR | Alexis Kafantaris |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21694 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.27947
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Attractor FCM Alexis Kafantaris Abstract Abstract In this paper an attractor FCM is created, tested, and analyzed. This FCM is neither a hebbian based nor agentic, nor a hybrid; it rather is a gradient descent based, physics constrained, Jacobian version of an FCM. Moreover, this model has several quirks; it uses residual memory, back propagation through time, and a fixed point anchor that is recursively implemented to update its weights. The residuals update the recursive part without losing the system memory. The model’s anchor enables it to converge in a fixed point for which back propagation through time unrolls it and ensures that the error minimization is for an accurate gradient. Furthermore, a new learning algorithm is utilized. The Newton’s method finds the system’s fixed point attractor and then gradient descend is adaptively changing the landscape; an adaptive term is used to directly manipulate the weights through the attractor dynamics. As the adaptive term changes, the descent through the landscape is constantly adjusting according to sigmoid saturation, and that prevents premature convergence to a local minimum. Lastly, the updates are filtered by causal mask that informs the network about the physics, respecting the initial expert based opinions, for which model reduces the error to the target in an efficient way. 1 Introduction Fuzzy cognitive map learning methods is an interesting topic that has been somewhat stale [ 3 ] . Although there are many programs and learning methods, a better approach is still lacking [ 5 ] . Some methods have convergence advantages, while others have interpretability. For example, Hebbian [ 6 ] based methods converge faster but are not interpretable. On the other hand, an agentic setup might lack in convergence but it is interpretable [ 7 ] . Ideally, each setup is meant to be used under specific conditions, but one does not want to make that choice; or rather one prefers a fuzzy cognitive map that is holistically better. Moreover, fuzzy cognitive maps are used for classification, prediction, and simulation [ 2 ] . These are already key distinctions which more or less shape the architecture. Again, the different versions of fuzzy cognitive maps as well as their learning methods are shaped to address the key challenges [ 4 ] . Simulation, for example, accepts a target and then feeds it into the fuzzy cognitive map network. The network, attempting to minimize the error, adjusts the weights which represent concept correlation [ 1 ] ; then by assessing these concepts one can determine the simulation outcome as the mathematical equilibrium that the system settles into, assuming that the system does not fall into chaos. Furthermore, for prediction, previous inputs are used and given these, new targets are evaluated [ 10 ] . The important idea is that the fuzzy cognitive map will be adjusted to minimize the error, so in turn it will explain the way that it made its deductions. Lastly, for classification the idea is the same; however, all these different applications require a different setup [ 5 ] . Nonetheless, the tradeoffs are simple and make intuitive sense; assuming one wants a simulation, he only cares about the output targets and so wants fast convergence. Therefore a Hebbian FCM is a good choice in a computational sense [ 6 ] ; however, this lacks in interpretability, and so trying to read the map will make no sense. Last but not least there are other networks as well from which one can draw inspiration. By assesing deep equilibrium models and hopefield networks one finds that there are other methods like the back propagation through time which are used. In turn, these methods could be implemented in a fuzzy cognitive map leveraging the math and creating hybrids, or more pure forms of the fuzzy cognitive maps. Hence, achieving better convergence and other interesting properties which are examined in the attractor FCM. 2 Related Works A fuzzy cognitive map is a signed digraph; a symbolic network with concepts as nodes and fuzzy relationships as edges. By using fuzzy relations as edges it becomes interpretable, e.g. concept C1 affects to concept C2 by 0.2, edge C1C2 is 0.2, or concept C3 affects concept C2 by negative 0.5, edge C3C2 is 0.5. The FCM is a shallow recurrent neural network that instead of calculating random weights, it calculates weights as system dynamics [ 1 ] . This way, one can simulate the system, and through simulation determine the mathematical equilibrium [ 2 ] . The FCM Equations are as follows: H_{t+1}=\tanh(H_{t}W),\quad H_{0}=H_{\text{initial}} \;H_{T}=\Phi\circ\Phi\circ\cdots\circ\Phi(H_{0})\; E=H_{\text{target}}-H_{T} W=W+\eta\,H_{T}\otimes E According to the FCM literature the FCM learning methods that are suggested are hebbian based [ 6 ] , population based [ 8 , 7 ] and hybrids [ 4 ] . For all of these there are advantages regarding explainability, convergence, and other properties [ 3 ] . Moreover, due to the scarcity of algorithms in that domain there is a gap. The existing algorithms are somewhat limited in strengths as well and depending on the algorithm there are several advantages and disadvantages [ 5 ] . Generally, there are other similar ideas to an FCM like the DEQ networks [ 13 ] , which can be viewed as optimization frameworks of a fixed point; and there are Hopfield networks [ 11 , 12 ] , that use energy minimization to make inferences, and may implement interesting dynamics. These networks all use ideas that should apply and improve an FCM, however there is nothing formal established yet. The gradient descent algorithm is a mathematical tool for finding the solution. Using the derivative of the feed forward equations the gradient descent can find the best direction for back propagating the weights. In other words, by moving towards the direction of the gradient time the program reduces the error of the target by a step epsilon; as the error decreases the model is closer to the target, which makes the gradient descent a very efficient program. However, having to rely on a step each time for that process means that the algorithm can get stuck at a local minima that is deeper than a step. On the other hand, too large of a step and the algorithm gets unstable. This algorithm is inspired by equilibrium propagation networks [ 14 ] , and from the gradient descent component, by improving on a gradient descent based method the gap is addressed; using lyapunov stability [ 16 ] , the energy is minimized and then the inputs are denoised under a condition of contraction [ 9 ] . In addition, a structural mask is applied on the network, so this algorithm retains a hundred percent of its initial structure. The structure represents the physics of a system, the experts opinion is reflected through these interconnections; respecting the physics and minimizing the targets using Jacobian gradient descent is an excellent approach. Additionally, the system also has a denoising properties. Hence, the system for a given input the system acts like a catalyst, preserving the graph topology while also optimizing for the specific targets. 3 Methodology Here, the attractor FCM model is created; the key components are established and a new learning method is formalized. Then, convergence and denoisification