Comparison between neural network clustering, hierarchical clustering and k-means clustering: Applications using fluidic lenses
Graciana Puentes · 2025
Read Comparison between neural network clustering, hierarchical clustering and k-means clustering: Applications using fluidic lenses by Graciana Puentes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22448.txt.
Introduction
Graciana Puentes compares three ways to group data in a 2025 paper. The data come from fluid lenses, soft lenses whose shape shifts with fluid. A wave sensor read the bent light from the lenses, and each read broke into 15 shape terms. The task was to sort like reads into clusters. Three methods faced the same data set.
One method used a self-organizing map, a neural net that lays data on a grid. A second built a tree of groups step by step, and its groups matched the data well. A third split the data into five tight groups with a strong score. Judged as a whole, tree grouping plus the split method gave the most stable result. Map size and tree cut choices could swing the map-based result on their own, which made it less safe to trust alone.
Catalog record
| CREATOR | Graciana Puentes |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-22448
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparison between neural network clustering, hierarchical clustering and k-means clustering: Applications using fluidic lenses Graciana Puentes Abstract A comparison between neural network clustering (NNC), hierarchical clustering (HC) and K-means clustering (KMC) is performed to evaluate the computational superiority of these three machine learning (ML) techniques for organizing large datasets into clusters. For NNC, a self-organizing map (SOM) training was applied to a collection of wavefront sensor reconstructions, decomposed in terms of 15 Zernike coefficients, characterizing the optical aberrations of the phase front transmitted by fluidic lenses. In order to understand the distribution and structure of the 15 Zernike variables within an input space, SOM-neighboring weight distances, SOM-sample hits, SOM-weight positions and SOM-weight planes were analyzed to form a visual interpretation of the system’s structural properties. In the case of HC, the data was partitioned using a combined dissimilarity-linkage matrix computation. The effectiveness of this method was confirmed by a high cophenetic correlation coefficient value (c=0.9651). Additionally, a maximum number of clusters was established by setting an inconsistency cutoff of 0.8, yielding a total of 7 clusters for system segmentation. Nevetheless, we found this result is dramatically modified by setting a different inconsistency cutoff, resulting in the formation of 13 different clusters, when reducing the cutoff from 0.8 to 0.7. In addition, a KMC approach was employed to establish a quantitative measure of clustering segmentation efficiency, obtaining a sillhoute average value of 0.905 for data segmentation into K=5 non-overlapping clusters. On the other hand, the NNC analysis revealed that the 15 variables could be characterized through the collective influence of 8 clusters. It was established that the formation of clusters through the combined linkage and dissimilarity algorithms of HC alongside KMC is a more dependable clustering solution than separate assessment via NNC or HC, where altering the SOM size or inconsistency cutoff can lead to completely new clustering configurations. 1 Introduction Clustering refers to the method of grouping variables with similar characteristics into sets known as clusters. Given the importance of clustering in areas such as data analysis, pattern recognition, image processing, information retrieval, and medical imaging, it has been extensively researched using a variety of computational techniques. An effective clustering algorithm proficiently manages tasks such as scaling non-uniform data, analysing categorical, numerical, and binary data, interpreting results thoroughly, uncovering key features of a system, and dealing with high-dimensional data. The most frequently utilized clustering techniques include Hierarchical Clustering (HC) and K-Means Clustering (KMC). In HC, a hierarchy of clusters is formed, with each cluster comprising data points that share similar characteristics. KMC, on the other hand, creates clusters by averaging the data around K centroids. Zhao et al. Zhao noted that the consistency of HC solutions across various levels of detail enabled flat partitions of differing granularity, making them well-suited for interactive exploration and visualization. In scenarios where clusters contain numerous sub-clusters, a hierarchical structure was considered a natural constraint within the relevant application domain, such as biological taxonomy and phylogenetic trees. Recently, in the pursuit of effective clustering algorithms to articulate the learned representation necessary for feature detection, Neural Network Clustering (NNC) has gained preference. Cirrincione et al. Cirrincione suggested that the limitation of threshold splitting in HC could be resolved through NNC by constructing a hierarchical tree in a progressive and self-organizing manner. This approach, based on the innovative concept of neighborhood convex hulls, characterizes horizontal expansion through an anisotropic influence region. Additionally, the combination of hierarchical segmentation and the GH-EXIN neural network was seen as a means to enhance clustering accuracy. Zhang et al. Zhang demonstrated that combining hierarchical dendrograms with heat maps offered a clear visualization of clinical studies involving diverse study populations. A system known as Cognitive Comparison-Enhanced Hierarchical Clustering (CCEHC) was introduced by Guan, C. and Yuen Guan to deliver tailored product suggestions based on individual user preferences. Du Du emphasized the significance of self-organizing maps (SOM) as a competitive learning-based clustering neural network, capable of extracting valuable information from vast databases or the World Wide Web (WWW). It was highlighted that structural features must first be identified in a database for data mining, and the self-organization exploratory technique appeared particularly promising. Jain et al. Jain identified database segmentation, predictive modelling, and visualization of large databases as some clustering strategies for data mining. It was argued that web mining presents challenges due to the ambiguous characteristics of the less structured WWW database. In this context, the topology-preserving attribute of NNC rendered it especially appropriate for processing visual web information. Mangiameli et al. Mangiameli performed a comparison between NNC and HC, demonstrating that NNC outperformed HC. It was indicated that HC methods were prone to making classification mistakes when real-world data deviated from the ideal conditions of tightly grouped isolated clusters. However, the advantage of NNC over HC was firmly reliant on achieving precise decision-making through NNC on partially organized data. It is worth mentioning that Refs. Cirrincione ; Mangiameli ; Herrero ; Okamoto underscored the enhancement of clustering accuracy via an NNC-HC combination. Recently, Shahid Shahid reported a comparison between NNC and HC precision dominance, applied to a local aqua system to learn the distribution and topology of variables in an input space using a total of 8 neurons, resulting in the formation of 6 clusters for NNC. They concluded that HC provides for a more dominantly precise clustering characterisation than NNC, resulting in 7 clusters for data segmentation considering an inconsistency cutoff of 0.7842. In this paper, we present a comparison between NNC, HC and KMC applied to a completely different scenario. Namely, a set of 15 Zernike coefficients characterising optical aberrations obtained by wavefront reconstruction of the phase front transmitted by fluidic lenses of varying fluidic volumes using a Shack-Hartmann wavefront sensor 1 ; 2 ; 3 ; 4 ; 5 ; 6 ; 7 ; 8 ; 9 ; 10 ; 10b ; 11 ; 12 ; 13 ; 14 ; 15 ; 16 ; 17 ; 18 ; 19 ; 20 ; 21 ; 22 ; 23 . Moreover, as opposed to Ref. Shahid , we construct a NN using 10 neurons, resulting in the formation of 8 clusters for system segmentation. We found that HC can provide for a more precise clustering configuration consisting of 7 clusters, as long as a sufficiently high inconsistency cutoff is chosen ( \leq 0.8 ). In contrast to Ref. Shahid , we encounter that when the inconsistency cutoff is reduced from 0.8 to 0.7, the clustering configuration changes dramatically, resulting in the formation of 13 new clusters, clearly reducing the precision of HC in comparison with NNC. Finally, a KMC approach was employed to establish a quantitative measure of clustering segmentation efficiency, obtaining a silhouette mean value of 0.905 for data segmentation into K=5 clusters. We conclude that while NNC characterization is mostly visual, and HC precision dominance is strongly dependent on the elected inconsistency cutoff, KMC can provide an efficient clustering characterization, as quantified by the mean silhouette value. Thus NNC, HC and KMC, can be considered as complementary techniques, which should be employed jointly for a more dependable clustering characterization. 1.1 Data Components The data used for the current clustering analysis is comprised of 15 Zernike coefficients for 8 different weights,