A novel k-means clustering approach using two distance measures for Gaussian data School of Mathematical Sciences College of Science Rochester Institute of Technology
Naitik H. Gada · 2025
Read A novel k-means clustering approach using two distance measures for Gaussian data School of Mathematical Sciences College of Science Rochester Institute of Technology by Naitik H. Gada (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17823.txt.
Introduction
Naitik Gada proposes a new version of k-means clustering, a widely used method that groups data points around a set of centers. Classic k-means judges only how tight each group is, which can leave points, especially outliers, in the wrong group.
The new version also uses distance between groups, and it picks the number of groups with a standard quality criterion. On synthetic data and on public benchmark sets, points settle into their true groups more accurately than with the classic method, including outliers. Gada also notes open questions raised by the approach for future clustering research.
Catalog record
| CREATOR | Naitik H. Gada |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-17823
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A novel k-means clustering approach using two distance measures for Gaussian data School of Mathematical Sciences College of Science Rochester Institute of Technology Naitik H. Gada Abstract Abstract Clustering algorithms have long been the topic of research, representing the more popular side of unsupervised learning. Since clustering analysis is one of the best ways to find some clarity and structure within raw data, this paper explores a novel approach to k -means clustering. Here we present a k -means clustering algorithm that takes both the within cluster distance (WCD) and the inter cluster distance (ICD) as the distance metric to cluster the data into k clusters pre-determined by the Calinski-Harabasz criterion in order to provide a more robust output for the clustering analysis. The idea with this approach is that by including both the measurement metrics, the convergence of the data into their clusters becomes solidified and more robust. We run the algorithm with some synthetically produced data and also some benchmark data sets obtained from the UCI repository. The results show that the convergence of the data into their respective clusters is more accurate by using both WCD and ICD measurement metrics. The algorithm is also better at clustering the outliers into their true clusters as opposed to the traditional k means method. We also address some interesting possible research topics that reveal themselves as we answer the questions we initially set out to address. Chapter 1 Introduction Machine learning can be broadly classified into three categories of algorithmic techniques depending on the type of problem being faced. These techniques also vary heavily, based on the learning algorithms themselves. They are: Supervised Learning, Reinforcement Learning and Unsupervised Learning. Supervised learning makes use of predetermined classes of the responses to train the underlying algorithm and make predictions based on the same. The features or the independent variables, X are mapped to the responses or the dependent variables, Y . The algorithm learns from this mapping to make predictions on unseen data. Hence the name, machine learning [ 17 ] . It is the human equivalent of learning from our past experiences in order to gather knowledge that is imperative to improve our ability to perform future tasks in the real world. Supervised learning algorithms can either be categorized as regression or classification. Dependent variables with continuous data fall into the regression category whereas dependent variables with discrete data labels fall into the classification category [ 12 ] . Reinforcement learning is another entity altogether wherein the algorithm interacts with the environment based on some actions, A = {a_{1},a_{2},...a_{N}} and tries to produce an optimal policy or decision, by trial and error, based on rewards (or punishments), R = {r_{1},r_{2},...r_{N}} . The goal with this algorithm is to produce a decision based on a path that maximizes the rewards or minimize the punishments by the time the stopping criteria is met [ 3 ] , [ 15 ] . Contrary to the supervised learning algorithms where the output data is labelled, unsupervised algorithms almost seem black boxed because there is no coherent knowledge about the data prior to processing it [ 8 ] . The features or the independent variables, X = {x_{1},x_{2},....x_{N}} , where X is an N-dimensional set of vectors, have no associated labels and are hence at the mercy of the processing algorithm to identify the homogeneity within the data set. This data could be customer information at a marketing research company, a set of handwritten alphabets or numbers, confidential patient data for the medical records, pixel information from an image. Unsupervised learning and specifically exploratory data analysis is now being widely used as the first step in gaining a deeper understanding of the raw data [ 25 ] . One approach calls for the use of metaheuristic algorithms to deal with the NP-hardness of the unsupervised learning algorithms [ 9 ] . Metaheuristic algorithms are high level guiding strategies that search the solution space for the most optimal solution. Despite being able to reduce the time complexity of finding a solution, metaheuristic algorithms have one major drawback: they are known to get stuck in the local optima [ 9 ] , [ 2 ] . Another approach calls for genetic algorithm to better search the solution space for optimized results [ 21 ] . Genetic algorithms are a part of the “Evolutionary Algorithms” that mimic real life evolution to search for an optimized solution. Other evolutionary algorithms include Pattern Search, Particle Swarm Optimization, Simulated Annealing [ 21 ] , [ 5 ] , [ 9 ] . Whatever the approach may be, in order to solve the unsupervised learning problems, we have to deploy methods that find patterns beyond the raw data which is nothing but unstructured noise. One method to understand the homogeneity in the underlying raw data is clustering analysis [ 27 ] , [ 10 ] , [ 20 ] . 1.1 Clustering Analysis Clustering analysis is a class of unsupervised learning techniques that is the most widely researched [ 27 ] , [ 22 ] , [ 6 ] . It garners more interest particularly because of its applications in deep learning and its potential ability to produce sophisticated artificial intelligence algorithms [ 27 ] . Unsupervised learning algorithms, specifically clustering algorithms have been researched for the last four decades [ 12 ] . The goal of clustering is to separate the unlabelled data into a finite set of “clusters” with similar properties among the data within the same clusters but differing properties from the data in other clusters [ 13 ] , [ 16 ] . Its applications include, but are not limited to data mining, image segmentation, vector quantization, pattern recognition, etc. [ 13 ] . The definition of a “good” cluster remains implicit in that it depends on the application. There are many methods to classify these clusters, both ad hoc and systematic [ 13 ] , [ 16 ] , [ 19 ] . Hierarchical clustering uses recursion to find clusters within the data by either a “top down” or a “bottom up” approach with a higher than quadratic complexity [ 1 ] . This makes them highly unsuitable for larger data sets. In contrast, partitional algorithms find all the clusters within the data simultaneously and are computationally much cheaper than hierarchical algorithms making them favorable for large data sets. Clustering analysis is fundamental in deriving an insight into purely unstructured and noisy data. What sets the tone for further analysis of the clustered data is the similarity in properties of data belonging to the same clusters. These properties can either be distance based measures like Euclidean or Manhattan or they can be density based clustering like DBSCAN and BIRCH [ 13 ] . Marketing research companies make use of clustering analysis to better target their audiences [ 15 ] . Similarly even social media companies make use of clustering analysis and graph theory as a way to link similar social groups together and target ads based on the same. One such popular method of clustering is using a pre-determined number of clusters to classify the data into k different clusters [ 22 ] . k -means clustering is