journal article·2025-06-18Open access

Automated Exploratory Clustering to Democratize Clustering Analysis

Georg Stefan Schlake, Max Pernklau, Christian Beecks

Applied Sciences· Volume 15· Issue 12

Abstract

AutoML is enabling many practitioners to use sophisticated Machine Learning pipelines even without being experienced in building application-specific solutions. Adapting AutoML to the field of unsupervised learning, particularly to the task of clustering, is challenging, as clustering is highly subjective and application-specific; the goal is not to find the best way to group data objects based on previously seen examples, but to find interesting new structures within potentially unknown data objects that provide actionable insights. The level of interestingness of a clustering is highly subjective and is subject to a variety of different characteristics making different clusterings of the same dataset (e.g., grouping people by age, gender, or special interests). In this paper, we propose an Automated Exploratory Clustering framework which determines multiple clusterings satisfying different notions of interestingness automatically. To this end, we generate multiple clusterings via AutoML processes and return a selection of clusterings, from which the user can explore the most preferred ones. We use different methods like the skyline operator to prune non-Pareto-optimal clusterings wrt. different dimensions of interestingsness and deliver a small set of valuable clusterings. In this way, our approach enables practitioners as well as domain experts to identify valuable clusterings without becoming experts in clustering as well, thus reducing human efforts and resources in finding application-specific solutions. Our empirical investigation with current state-of-the-art methods is carried out on a number of benchmark datasets, where a well-established ground truth can proxy for the wishes of a domain expert and multiple interestingness properties of the clusterings.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning and Data Classification · Data Stream Mining Techniques · Advanced Clustering Algorithms Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Chair of Data Science, University of Hagen, 58084 Hagen, Germany

Funding

DFG

References (76)

Show source-provided references
1. Hutter, F., Kotthoff, L., and Vanschoren, J. (2019). Automated Machine Learning—Methods, Systems, Challenges, Springer.10.1007/978-3-030-05318-5 ↗
2. Camilo da Silva, M., Licari, B., Tavares, G.M., and Barbon Junior, S. (2024, January 9–12). Benchmarking AutoML Clustering Frameworks. Proceedings of the International Conference on Automated Machine Learning, Paris, France. (ABCD Track).
3. Automated machine learning: Past, present and future10.1007/s10462-024-10726-1 ↗
4. Thornton, C., Hutter, F., Hoos, H.H., and Leyton-Brown, K. (2013, January 11–14). Auto-WEKA: Combined selection and hyperparameter optimization of classification algorithms. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013, Chicago, IL, USA.10.1145/2487575.2487629 ↗
5. Erickson, N., Mueller, J., Shirkov, A., Zhang, H., Larroy, P., Li, M., and Smola, A.J. (2020). AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data. arXiv.
6. Mu, T., Wang, H., Zheng, S., Liang, Z., Wang, C., Shao, X., and Liang, Z. (2023, January 3–7). TSC-AutoML: Meta-learning for Automatic Time Series Classification Algorithm Selection. Proceedings of the 39th IEEE International Conference on Data Engineering, ICDE 2023, Anaheim, CA, USA.10.1109/ICDE55515.2023.00084 ↗
7. Jin, H., Song, Q., and Hu, X. (2019, January 4–8). Auto-Keras: An Efficient Neural Architecture Search System. Proceedings of the Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA.10.1145/3292500.3330648 ↗
8. Mcfly: Automated deep learning on time series10.1016/j.softx.2020.100548 ↗
9. Tang, Z., Fang, H., Zhou, S., Yang, T., Zhong, Z., Hu, C., Kirchhoff, K., and Karypis, G. (2024, January 9–12). AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Models. Proceedings of the International Conference on Automated Machine Learning, Paris, France. PMLR.
10. Data clustering: Application and trends10.1007/s10462-022-10325-y ↗
11. McQueen, J. (July, January 21). Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA, USA.
12. Ester, M., Kriegel, H., Sander, J., and Xu, X. (1996, January 2–4). A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. Proceedings of the KDD Second International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, OR, USA.
13. Campello, R.J.G.B., Moulavi, D., Zimek, A., and Sander, J. (2015). Hierarchical Density Estimates for Data Clustering, Visualization, and Outlier Detection. ACM Trans. Knowl. Discov. Data, 10.10.1145/2733381 ↗
14. Mean Shift: A Robust Approach Toward Feature Space Analysis10.1109/34.1000236 ↗
15. von Luxburg, U., Williamson, R.C., and Guyon, I. (2011, January 2). Clustering: Science or Art?. Proceedings of the Unsupervised and Transfer Learning—Workshop Held at ICML 2011, Bellevue, WA, USA. JMLR Proceedings.
16. Exploratory data analysis10.1002/wics.2 ↗
17. Poulakis, Y., Doulkeridis, C., and Kyriazis, D. (2020, January 17–20). AutoClust: A Framework for Automated Clustering based on Cluster Validity Indices. Proceedings of the 20th IEEE International Conference on Data Mining, ICDM 2020, Sorrento, Italy.10.1109/ICDM50108.2020.00153 ↗
18. AutoCluster: Meta-learning Based Ensemble Method for Automated Unsupervised Clustering
19. Tschechlov, D., Fritz, M., and Schwarz, H. (2021, January 23–26). AutoML4Clust: Efficient AutoML for Clustering Analyses. Proceedings of the 24th International Conference on Extending Database Technology, EDBT 2021, Nicosia, Cyprus.
20. Treder-Tschechlov, D., Fritz, M., Schwarz, H., and Mitschang, B. (2023). ML2DAC: Meta-Learning to Democratize AutoML for Clustering Analysis. Proc. ACM Manag. Data, 1.10.1145/3589289 ↗
21. AutoClues: Exploring Clustering Pipelines via AutoML and Diversification
22. Schlake, G.S., and Beecks, C. (2023, January 15–18). Towards Automated Clustering. Proceedings of the IEEE International Conference on Big Data, BigData 2023, Sorrento, Italy.10.1109/BigData59044.2023.10386424 ↗
23. Poulakis, Y., Doulkeridis, C., and Kyriazis, D. (2024). A Survey on AutoML Methods and Systems for Clustering. ACM Trans. Knowl. Discov. Data, 18.10.1145/3643564 ↗
24. Schlake, G.S., and Beecks, C. (2024, January 15–18). The Skyline Operator to Find the Needle in the Haystack for Automated Clustering. Proceedings of the IEEE International Conference on Big Data, BigData 2024, Washington, DC, USA.10.1109/BigData62323.2024.10825416 ↗
25. Schlake, G.S., Pernklau, M., and Beecks, C. (2024, January 15–18). Automated Exploratory Clustering. Proceedings of the IEEE International Conference on Big Data, BigData 2024, Washington, DC, USA.10.1109/BigData62323.2024.10825574 ↗
26. Fuzzy Clustering: A Historical Perspective10.1109/MCI.2018.2881643 ↗
27. Hierarchical grouping to optimize an objective function10.1080/01621459.1963.10500845 ↗
28. Kaufman, L., and Rousseeuw, P.J. (1990). Partitioning Around Medoids (Program PAM), John Wiley & Sons. Chapter 2.
29. Zhang, T., Ramakrishnan, R., and Livny, M. (1996, January 4–6). BIRCH: An Efficient Data Clustering Method for Very Large Databases. Proceedings of the 1996 ACM SIGMOD International Conference on Management of Data, Montreal, QC, Canada.10.1145/233269.233324 ↗
30. Ankerst, M., Breunig, M.M., Kriegel, H., and Sander, J. (1999, January 1–3). OPTICS: Ordering Points To Identify the Clustering Structure. Proceedings of the SIGMOD 1999, Proceedings ACM SIGMOD International Conference on Management of Data, Philadelphia, PA, USA.10.1145/304182.304187 ↗
31. Schlake, G.S., and Beecks, C. (2025, January 10–12). Arbitrary Shaped Clustering Validation on the Test Bench. Proceedings of the 14th International Conference on Data Science, Technology and Applications, DATA 2025, Bilbao, Spain.
32. Beer, A., Draganov, A., Hohma, E., Jahn, P., Frey, C.M.M., and Assent, I. (2023, January 6–10). Connecting the Dots—Density-Connectivity Distance unifies DBSCAN, k-Center and Spectral Clustering. Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2023, Long Beach, CA, USA.10.1145/3580305.3599283 ↗
33. Hadi, R.H., Hady, H.N., Hasan, A.M., Al-Jodah, A., and Humaidi, A.J. (2023). Improved fault classification for predictive maintenance in industrial IoT based on AutoML: A case study of ball-bearing faults. Processes, 11.10.3390/pr11051507 ↗
34. Pataci, H., Li, Y., Katsis, Y., Zhu, Y., and Popa, L. (2022, January 8). Stock price volatility prediction: A case study with AutoML. Proceedings of the Fourth Workshop on Financial Technology and Natural Language Processing, FinNLP 2022, Abu Dhabi, UAE.10.18653/v1/2022.finnlp-1.6 ↗
35. Automated machine learning: Review of the state-of-the-art and opportunities for healthcare10.1016/j.artmed.2020.101822 ↗
36. Datta, D., and Friedland, G. (November, January 29). Efficient Multimedia Computing: Unleashing the Power of AutoML. Proceedings of the 31st ACM International Conference on Multimedia, MM 2023, Ottawa, ON, Canada.10.1145/3581783.3613858 ↗
37. AutoGluon: A revolutionary framework for landslide hazard analysis10.1016/j.nhres.2021.07.002 ↗
38. Oyucu, S., and Aksöz, A. (2024). Integrating Machine Learning and MLOps for Wind Energy Forecasting: A Comparative Analysis and Optimization Study on Türkiye’s Wind Data. Appl. Sci., 14.10.3390/app14093725 ↗
39. Subspace clustering10.1002/widm.1057 ↗
40. Subspace multi-clustering: A review10.1007/s10115-017-1110-9 ↗
41. Weakly Supervised Multilabel Clustering and its Applications in Computer Vision10.1109/TCYB.2015.2501385 ↗
42. Bailey, J. (2013). Alternative Clustering Analysis: A Review. Data Clustering: Algorithms and Applications, CRC Press.
43. Learning Neural Models for End-to-End Clustering
44. Shawi, R.E., Lekunze, H., and Sakr, S. (2021, January 15–18). cSmartML: A Meta Learning-Based Framework for Automated Selection and Hyperparameter Tuning for Clustering. Proceedings of the 2021 IEEE International Conference on Big Data (Big Data), Orlando, FL, USA.10.1109/BigData52589.2021.9671542 ↗
45. Shawi, R.E., and Sakr, S. (December, January 28). cSmartML-Glassbox: Increasing Transparency and Controllability in Automated Clustering. Proceedings of the IEEE International Conference on Data Mining Workshops, ICDM 2022—Workshops, Orlando, FL, USA.10.1109/ICDMW58026.2022.00015 ↗
46. Shawi, R.E., and Sakr, S. (December, January 28). TPE-AutoClust: A Tree-based Pipline Ensemble Framework for Automated Clustering. Proceedings of the IEEE International Conference on Data Mining Workshops, ICDM 2022—Workshops, Orlando, FL, USA.10.1109/ICDMW58026.2022.00149 ↗
47. da Silva, M.C., Tavares, G.M., Medvet, E., and Junior, S.B. (2024). Problem-oriented AutoML in Clustering. arXiv.
48. Gratsos, K., Ougiaroglou, S., and Margaris, D. (2023). kClusterHub: An AutoML-Driven Tool for Effortless Partition-Based Clustering over Varied Data Types. Future Internet, 15.10.3390/fi15100341 ↗
49. Carbonell, J.G., and Goldstein, J. (1998, January 24–28). The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries. Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia.10.1145/290941.291025 ↗
50. Vieira, M.R., Razente, H.L., Barioni, M.C.N., Hadjieleftheriou, M., Srivastava, D., Traina, C., and Tsotras, V.J. (2011, January 11–16). On query result diversification. Proceedings of the 27th International Conference on Data Engineering, ICDE 2011, Hannover, Germany.10.1109/ICDE.2011.5767846 ↗
51. Nguyen, X.V., Epps, J., and Bailey, J. (2009, January 14–18). Information theoretic measures for clusterings comparison: Is a correction for chance necessary?. Proceedings of the 6th Annual International Conference on Machine Learning, ICML 2009, Montreal, QC, Canada. ACM International Conference Proceeding Series.
52. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis10.1016/0377-0427(87)90125-7 ↗
53. Visualizing data using t-SNE
54. Algorithms for hierarchical clustering: An overview10.1002/widm.53 ↗
55. Jain, A.K., and Dubes, R.C. (1988). Algorithms for Clustering Data, Prentice-Hall, Inc.
56. Börzsönyi, S., Kossmann, D., and Stocker, K. (2001, January 2–6). The Skyline Operator. Proceedings of the 17th International Conference on Data Engineering, Heidelberg, Germany.
57. ARTful Skyline Computation for In-Memory Database Systems
58. Objective criteria for the evaluation of clustering methods10.1080/01621459.1971.10482356 ↗
59. Providing Diversity in K-Nearest Neighbor Query Results
60. Moulavi, D., Jaskowiak, P.A., Campello, R.J.G.B., Zimek, A., and Sander, J. (2014, January 24–26). Density-Based Clustering Validation. Proceedings of the 2014 SIAM International Conference on Data Mining, Philadelphia, PA, USA.10.1137/1.9781611973440.96 ↗
61. Kelly, M., Longjohn, R., and Nottingham, K. (2025, May 19). The UCI Machine Learning Repository. Available online: https://archive.ics.uci.edu/.
62. Parmar, M. (2025, May 19). Clustering Datasets. Available online: https://github.com/milaan9/Clustering-Datasets.
63. Kennedy, J., and Eberhart, R. (December, January 27). Particle swarm optimization. Proceedings of the International Conference on Neural Networks (ICNN’95), Perth, WA, Australia.
64. Claesen, M., Simm, J., Popovic, D., Moreau, Y., and Moor, B.D. (2014). Easy Hyperparameter Search Using Optunity. arXiv.
65. Scikit-learn: Machine Learning in Python
66. hdbscan: Hierarchical density based clustering10.21105/joss.00205 ↗
67. Schlake, G.S., and Beecks, C. (2024, January 6–10). Validating Arbitrary Shaped Clusters—A Survey. Proceedings of the 11th IEEE International Conference on Data Science and Advanced Analytics, DSAA 2024, San Diego, CA, USA.10.1109/DSAA61799.2024.10722773 ↗
68. Guan, S., and Loew, M.H. (2022). A Distance-based Separability Measure for Internal Cluster Validation. Int. J. Artif. Intell. Tools, 31.10.1142/S0218213022600053 ↗
69. New internal clustering validation measure for contiguous arbitrary-shape clusters10.1002/int.22521 ↗
70. VIASCKDE Index: A Novel Internal Cluster Validity Index for Arbitrary-Shaped Clusters Based on the Kernel Density Estimation
71. A dendrite method for cluster analysis10.1080/03610927408827101 ↗
72. A Cluster Separation Measure10.1109/TPAMI.1979.4766909 ↗
73. Well-separated clusters and optimal fuzzy partitions10.1080/01969727408546059 ↗
74. A spatial filtering approach to texture analysis10.1016/0167-8655(85)90053-4 ↗
75. SEP/COP: An efficient method to find the best partition in hierarchical clustering based on a new cluster validity index10.1016/j.patcog.2010.04.021 ↗
76. Romano, S., Nguyen, X.V., Bailey, J., and Verspoor, K. (2016). Adjusting for Chance Clustering Comparison Measures. J. Mach. Learn. Res., 17.