Survey of Swarm Intelligence Approaches to Search Documents Based On Semantic Similarity Conference: 2025 4th International Conference on Cyber Security, Artificial Intelligence and the Digital Economy; March 07–09, 2025; Kuala Lumpur, Malaysia 2025 4th International Conference on Cyber Security, Ar
Chandrashekar Muniyappa, Eunjin Kim · 2025
Read Survey of Swarm Intelligence Approaches to Search Documents Based On Semantic Similarity Conference: 2025 4th International Conference on Cyber Security, Artificial Intelligence and the Digital Economy; March 07–09, 2025; Kuala Lumpur, Malaysia 2025 4th International Conference on Cyber Security, Ar by Chandrashekar Muniyappa, Eunjin Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-11787.txt.
Introduction
Chandrashekar Muniyappa and Eunjin Kim survey swarm intelligence methods for finding documents by meaning, in a 2025 paper. Swarm algorithms copy how ants, bees, and flocks solve problems collectively. They have spread across many optimization tasks. Semantic search asks for documents by content, not keywords. The survey gathers recent attempts to marry the two.
Strengths of swarm methods include flexibility and few tuning demands. Weaknesses around speed and scaling are also weighed. Document ranking, clustering, and query expansion uses are covered. The authors sort the literature by algorithm family. Gaps point to hybrid designs as a promising direction. Recommendations for future research close the survey. Semantic search remains hungry for better ranking heuristics, they note.
Catalog record
| CREATOR | Chandrashekar Muniyappa, Eunjin Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-11787
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Survey of Swarm Intelligence Approaches to Search Documents Based On Semantic Similarity Conference: 2025 4th International Conference on Cyber Security, Artificial Intelligence and the Digital Economy; March 07–09, 2025; Kuala Lumpur, Malaysia 2025 4th International Conference on Cyber Security, Artificial Intelligence and the Digital Economy (CSAIDE 2025), March 07–09, 2025, Kuala Lumpur, Malaysia DOI: 10.1145/3729706.3729817 ISBN: 979-8-4007-1271-5/25/03 CCS: Computing methodologies Continuous space search Chandrashekar Muniyappa, Eunjin Kim Abstract . Swarm Intelligence (SI) is gaining a lot of popularity in artificial intelligence, where the natural behavior of animals and insects is observed and translated into computer algorithms called swarm computing to solve real-world problems. Due to their effectiveness, they are applied in solving various computer optimization problems. This survey will review all the latest developments in Searching for documents based on semantic similarity using Swarm Intelligence algorithms and recommend future research directions. 1. Introduction A swarm refers to a group of agents that communicate with each other directly or indirectly using their local environment to solve a problem. Computer scientists studied the group behavior of animals and insects and developed computer algorithms to solve complex real-world problems which led to Swarm computing. However, with cloud computing volume of data is growing exponentially, to build complex systems large volumes of data have to be explored. Therefore, deterministic systems will not be able to scale, to solve this problem, meta-heuristics algorithms are used. Swarm Intelligence (SI) meta-heuristic algorithms that can learn and adapt to dynamically changing environments like biological organisms are gaining much popularity in solving complex problems. They are effective in searching large solution spaces, and multi-dimensional hyper-planes, and adapting to dynamically changing constraints. There are different categories of SI algorithms, a sample of categories are shown in Fig 1 . In this paper, we will review how Particle Swarm Optimization (PSO), Ant Colony Optimization (ACO), and variants of these algorithms are applied to various text similarity measurement problems. Figure 1. Sample of Swarm Intelligence Hierarchy 2. Main X.-F. Song et al. [1], applied particle swarm optimization to solve feature selection problem in high-dimensional dataset. The approach has three steps: In the first step Symmetric Uncertainty (SU) method was applied to compute the relevancy score and the values less than the predetermined threshold will be elemenated as irrelevant features. In the second step, features were clustered using the SU score computed in the first step; such that, if the difference bewteen their SU score is high they belong to different clusters; otherwise, to the same cluster. Finally in the third step, PSO algorithm is applied to pick the representative features from each cluster as the final answer. To apply PSO, the particles were encoded using the integer values of cluster number they belong to, for example if a feature \mathit{F_{i}} belongs to cluster \mathit{C_{j}} , then it was encoded using the integer value j . As all values are integers, the integer programming PSO a variant of PSO [2] was applied. The optimization process was guided using the relevancy of the given feature with the cluster. The relevancy probability was computed using equation: 1 (1) pc_{j}=\frac{Cv_{j}^{max}}{Cv} where • j is the number os clusters 1,2,3,…M. • Cv_{j}^{max} is the max relevancy score of the given cluster j • Cv is the relevancy score of the given feature for the given cluster • pc_{j} is the relevancy probability of the given particle The process is repeated for all the particles, for the specified number of iterations using classification accuracy as the fitness function. During experimentation they found that when \mathit{p_{best}} is near equal to \mathit{g_{best}} that is when a particle’s local best is ner equal to global best then the algorithm was stuck in the local minima resulting in poor results. To overcome this problem and to increase the diversity of the particles selection, a novel difference mutation strategy to randomly initialize the particles in the generations was applied. J. Gao et al [3] modified the velocity term in the traditional PSO to probabilities and suggests the Clustering Probabilistic Particle Swarm Optimization (CPPSO) algorithm for feature selection. Instead of using binary values as the velocity to include or exclude the feature; floating point probabilities are used to select the features. The probabilities are calculated using the equation 2 (2) \displaystyle\begin{aligned} p_{i,j}^{t+1}=p_{i,j}^{t}=w*p_{i,j}^{t}+c_{1}*r*(P_{best}-x_{i,j}^{t})\\ +c_{2}*r*(G_{best}-x_{i,j}^{t})-r*(D_{r}-x_{i,j}^{t})\end{aligned} \displaystyle\left\{\begin{aligned} &x_{i,j}^{t+1}=1-x_{i,j}^{t}\quad&p_{i,j}^{t+1}\geq r\\ &x_{i,j}^{t+1}=x_{i,j}^{t}\quad&otherwise\end{aligned}\right. where • {p_{i,j}^{t}} is the probability of {i^{th}} particle in {j^{th}} dimension in iteration t . • P_{best} and G_{best} are the local and global optima • D_{r} is the set of random numbers Random numbers helps in exploration and elitism is used for exploitation. These together boost the algorithm performance. K-means clustering algorithm [12] with Hamming distance is used to measure how dissimilar the particles are. The particles close to centroid are grouped together and the rest is grouped as unfavorable solutions. The steps are repeated for the specified iterations and finally the cluster with small radius is picked as the solution. S. Rohaidah Ahmada et al [4], deviced ACO-KNN an implementation of KNN algorithm using the Ant Colony Optimization (ACO), a hybrid algorithm to extract features from text for sentiment classification. They split the process into two phases. In the first phase, they cleaned the text by removing stopwords, stemming, and by applying other Natural Language Programming (NLP) cleaning tasks [10]. And then clustered the documents using Fuzzy C-Means (FCM) clustering algorithm [5]. In the second phase, the extracted features were represented as a graph and ants were placed randomly on each node to start the search. Each ant kept track of local best and global best, where local best is the best solution found by an Ant and global best refers to the optimal solution found based on the work done by all ants. At the end of each iteration, KNN algorithm is applied to classify text sentiments with the subset of features found by ants and Mean Squared Error (MSE) is calcualted, lower the MSE value better is the result. Based on the results Pheromone table is updated and Ant movements are decided. The process is repeated for the specified number of iterations or until there is no improvement in the MSE. They tested this hybrid algorithm by applying it on opensource datasets and compared the results with Genetic Algorithm (GA), the results obtained by ACO-KNN were far superior. The equations ( 3 ) gives the pheromone updation rule for local best when an ant completes the route. (3) \Delta\tau_{i}^{k}(t)=\phi\cdot\gamma(S^{k}(t))+\frac{w\cdot(n-|{S^{k}(t)|})}{n}ifi\in S^{k}(t) Where: • n is the number of features • (S^{k}(t)) is the subset of features found by ant k at iteration t • |{S^{k}(t)}| length of feature subset found by ant k at iteration t • \gamma(S^{k}(t)) classification performance • \phi relative weight of classifier performance (0.8) • w relative weight of feature subset length (0.2) • \phi\in[0,1] • w = 1 - w Once all the ants have completed the route, equation ( 4 ) is used to update the global best route. (4) \Delta\tau_{i}^{g}(t)=\phi\cdot\gamma(S^{g}(t))+\frac{w\cdot(n-|{S^{g}(t)|})}{n}ifi\in S^{g}(t) Where: • n is the number of features • (S^{g}(t)) is the global best subset of features found in iteration t. • |{S^{g}(t)}| length of the global best feature subset found in iteration t. • \gamma(S^{g}(t)) classification performance • \phi relative weight of classifier performance