Unraveling the cognitive patterns of Large Language Models through module communities

Kushal Raj Bhandari, Pin-Yu Chen, Jianxi Gao · 2025

Read Unraveling the cognitive patterns of Large Language Models through module communities by Kushal Raj Bhandari, Pin-Yu Chen, Jianxi Gao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18192.txt.

Introduction

Kushal Raj Bhandari, Pin-Yu Chen, and Jianxi Gao mapped the inner groups of large language models to their skills. Their paper, from twenty twenty-five, deals with a black box flaw: models work, but their billions of weights hide how. The team borrows a lens from biology, where thought is read through group structure. They build a network frame that links three things: skills, model parts, and data sets.

Skill spread across the module groups shows a mixed tale. Models do not split skills as sharply as brains split tasks by region. Yet group level reads still show form in the spread. Readers who probe models get a new chart of where skills sit in the mass.

Catalog record

CREATORKushal Raj Bhandari, Pin-Yu Chen, Jianxi Gao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-18192

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unraveling the cognitive patterns of Large Language Models through module communities Kushal Raj Bhandari, Pin-Yu Chen, Jianxi Gao Abstract Large Language Models (LLMs) have reshaped our world with significant advancements in science, engineering, and society through applications ranging from scientific discoveries and medical diagnostics to Chatbots. Despite their ubiquity and utility, the underlying mechanisms of LLM remain concealed within billions of parameters and complex structures, making their inner architecture and cognitive processes challenging to comprehend. We address this gap by adopting approaches to understanding emerging cognition in biology and developing a network-based framework that links cognitive skills, LLM architectures, and datasets, ushering in a paradigm shift in foundation model analysis. The skill distribution in the module communities demonstrates that while LLMs do not strictly parallel the focalized specialization observed in specific biological systems, they exhibit unique communities of modules whose emergent skill patterns partially mirror the distributed yet interconnected cognitive organization seen in avian and small mammalian brains. Our numerical results highlight a key divergence from biological systems to LLMs, where skill acquisition benefits substantially from dynamic, cross-regional interactions and neural plasticity. By integrating cognitive science principles with machine learning, our framework provides new insights into LLM interpretability and suggests that effective fine-tuning strategies should leverage distributed learning dynamics rather than rigid modular interventions. K eywords Large Language Models | Network Community Structure | Cognitive Skills | AI interpretability 1 Introduction The widespread adoption of LLMs is a testament to their impressive capabilities in generating coherent and context-aware text [ 1 ] , which has led to their use in everything from customer service chatbots [ 2 ] and automated content creation [ 3 ] to advanced data analysis [ 4 ] and even scientific research [ 5 ] . While the practical benefits of LLMs are recognized, a significant gap remains in our understanding of what drives their impressive performance. This imbalance, where the focus is predominantly on leveraging their utility rather than studying their working mechanism, has spurred many questions about the underlying principles that drive their success [ 5 ] . Bridging the gap between the widespread use of LLMs and the fundamental principles that drive their performance is a critical challenge. Much like the complexities of the human brain, these systems operate as “black boxes,” making it difficult to uncover the mechanisms behind their decision-making. The complexities of understanding LLMs involve exploring the intriguing parallels and distinctions between artificial neural architectures and the human brain (Figure 1 a), revealing captivating patterns of resemblance [ 6 , 7 ] despite their inherent differences [ 8 ] . Neuroscientists have long used brain mapping to identify discrete regions with synchronous activity linked to cognitive processes, memory, language, and motor control [ 9 , 10 ] . We illustrate the distribution of cognitive skills (i.e., cognitive process memory, executive function, language communication, and social cognition) alongside their associated datasets (Figure 1 b), highlighting the diversity of tasks and the strong alignment between dataset categories and core cognitive functions. Moreover, network science approaches have substantially enriched neuroscience by illuminating how large-scale brain networks exhibit modular structures, small-world properties, and dynamic connectivity patterns [ 11 , 12 ] . Building on such insights, recent studies on LLMs have adopted techniques, employing systematic benchmarks like CogBench [ 13 ] , psychological tests such as cognitive reflection and semantic illusions [ 14 ] , and even neuroimaging comparisons to evaluate their cognitive capabilities [ 15 ] . Yet, many of these efforts remain unsupported by a cohesive framework rooted in cognitive science and neuroscience, highlighting the importance of systematically mapping the alignment between LLMs and abstract cognitive skills. Expanding upon this growing interest, recent studies have explored how cognitive skills are encoded and localized within these models. For instance, aligning datasets with linguistic and cognitive skills facilitates targeted training and evaluation of LLM capabilities [ 16 ] , though such approaches often overlook the role of neural mechanisms that generate these skills. Efforts to map specific tasks onto localized regions of a fine-tuned LLM’s architecture [ 17 ] reveal the emergence of task-specialized modules, yet they fall short of explaining the structural neural dynamics that support this localization. Similarly, linking in-context learning with cognitive skills has offered insights into the meta-cognitive capabilities of LLMs [ 18 ] , but these studies primarily focused on behavioral outputs and self-assessment metrics rather than deeper structural explanations. Despite such advancements in understanding cognition in LLMs, prior works lack exploration of inter-skill relationships, dynamic adaptability, cross-domain generalizability, and detailed interpretability of underlying mechanisms. Figure 1: Connecting cognitive skills, datasets, and LLMs to form a multipartite network. ( a ) The schematic figure illustrates the relationships between cognitive skills, datasets, and LLM weight parameters as a multipartite network, drawing an analogy to the interconnected organization of the human brain. ( b ) The bar plots illustrate how different cognitive functions are categorized by the frequency of their associated skills and how often they appear across multiple-choice question datasets. Figure 2: Multipartite Network of Skills, Dataset and Modules of Llama2 model. The network depicts modules (squares), datasets (triangles), and skills (circles) as nodes. Edges are weighted by the normalized values derived from the bipartite relationships between skills and datasets and between datasets and modules, reflecting the structural importance and interactions within the multiple types of nodes. The projection network simplifies the multipartite structure by collapsing intermediary nodes(datasets) to focus on the direct interactions between skills and modules using Block -based pruning strategy. This projection highlights key dependencies and structural patterns within the model, offering insights into which modules are most influential for specific skills. 2 Emerging community structures in skill and module networks The architecture of emerging LLMs reflects the self-organization of neural assemblies [ 19 ] , where local activity and interactions drive the emergence of specific, stereotyped connectivity patterns, such as modularity. Constructing the overall network topology becomes essential. It involves integrating the dataset that captures domain knowledge, the architectural modules of LLMs, and the emerging cognitive functions. The methodology for building these networks is detailed in the Supplementary Information ( SI 1 and SI 2 ). Network visualization reveals the structural and functional relationships among skills, datasets, and modules, and illustrates the process used to generate the Skills and Modules projection networks, as shown in Figure 2 . These networks exhibit distinct connectivity patterns that can be leveraged to study the localization of skills within LLM modules, an essential step toward understanding the emergence of intelligence. Growing observations demonstrate that neural networks often exhibit meaningful community organization. Therefore, we leverage Louvain community detection techniques [ 23 ] to uncover latent interdependencies and organizational patterns among cognitive skills (Figure 3 a) and LLM modules (Figure 3 b). The resulting community structures reveal a hierarchical and modular architecture within LLMs, shedding light on how localized and distributed processing underpins their cognitive capabilities. This insight carries significant implications for model design, interpretability, and optimization. Surprisingly, while groups of LLM modules are tightly interconnected through shared skill distributions, there is no precise alignment between the predefined cognitive functions and the communities identified in the skills network (Figure 3 c). A Chi-square test comparing the distribution of skills across communities is

Read the complete text