Macro SOStream: An Evolving Algorithm to Self Organizing Density-Based Clustering with Micro and Macroclusters
Source abstract
Abstract
This paper proposes a new evolving algorithm named Macro SOStream with entirely online learning and based on self-organizing density for data stream clustering. The Macro SOStream is based on the SOStream algorithm, but we incorporate macroclusters composed of microclusters. While microclusters have spherical shapes, macroclusters can have arbitrary shapes. Moreover, the Macro SOStream has the macrocluster merge functionality specially designed to improve its performance under data drift contexts. The Macro SOStream’s performance is compared to SOStream and DenStream algorithms’ performance using four synthetic datasets and the ARI performance metric to validate our proposal. Furthermore, we carry out an exhaustive analysis on the influence of adequate hyperparameter setup on these algorithms’ performance. As a result, the Macro SOStream presents good performance mainly in the context of data drift and for demands of non-spherical clusters.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Stream Mining Techniques · Advanced Clustering Algorithms Research · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer and Software Engineering Department, Polytechnique Montreal, Montreal, QC H3T 1J4, Canada
Department of Computer Engineering and Automation—DCA Campus Universitário, Federal University of Rio Grande do Norte—UFRN, Natal 59077-080, RN, Brazil
Funding
the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)
References (40)
Show source-provided references
1. Alpaydin, E. (2010). Introduction to Machine Learning, The MIT Press. [2nd ed.].
2. A review of novelty detection10.1016/j.sigpro.2013.12.026 ↗
3. Swarms on the 3-sphere for online clustering of multivariate time series and data streams10.1016/j.future.2020.05.018 ↗
4. Self-evolving intelligent algorithms for facilitating data interoperability in IoT environments10.1016/j.future.2018.02.049 ↗
5. Muller, A.C., and Guido, S. (2016). Introduction to Machine Learning with Python, O’Reilly. [1st ed.].
6. Angelov, P. (2013). Autonomous Learning Systems, John Wiley & Sons, Ltd.
7. Kokate, U., Deshpande, A., Mahalle, P., and Patil, P. (2018). Data Stream Clustering Techniques, Applications, and Models: Comparative Analysis and Discussion. Big Data Cogn. Comput., 2.10.3390/bdcc2040032 ↗
8. Angelov, P.P., and Gu, X. (2019). Empirical Approach to Machine Learning, Studies in Computational Intelligence; Springer International Publishing.10.1007/978-3-030-02384-3 ↗
9. Evolving fuzzy and neuro-fuzzy approaches in clustering, regression, identification, and classification: A Survey10.1016/j.ins.2019.03.060 ↗
10. An overview on evolving systems and learning from stream data10.1007/s12530-020-09334-5 ↗
11. Aggarwal, C.C., Yu, P.S., Han, J., and Wang, J. (2003, January 9–12). A Framework for Clustering Evolving Data Streams. Proceedings of the 2003 VLDB Conference, Berlin, Germany.10.1016/B978-012722442-8/50016-1 ↗
12. Density-Based Clustering over an Evolving Data Stream with Noise10.1137/1.9781611972764.29 ↗
13. C-DenStream: Using Domain Knowledge on a Data Stream
14. Ren, J., and Ma, R. (2009, January 14–16). Density-Based Data Streams Clustering over Sliding Windows. Proceedings of the 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery, Tianjin, China.10.1109/FSKD.2009.553 ↗
15. SOStream: Self organizing density-based clustering over data stream
16. Moshtaghi, M., Leckie, C., and Bezdek, J.C. (2016, January 5–7). Online Clustering of Multivariate Time-series. Proceedings of the 2016 SIAM International Conference on Data Mining, Miami, FL, USA.10.1137/1.9781611974348.41 ↗
17. An evolving approach to data streams clustering based on typicality and eccentricity data analytics10.1016/j.ins.2019.12.022 ↗
18. Hassani, M., Spaus, P., Gaber, M.M., and Seidl, T. (2012, January 17–19). Density-based projected clustering of data streams. Proceedings of the International Conference on Scalable Uncertainty Management, Marburg, Germany.10.1007/978-3-642-33362-0_24 ↗
19. Hyper-cylindrical micro-clustering for streaming data with unscheduled data removals10.1016/j.knosys.2016.02.004 ↗
20. BEstream: Batch Capturing with Elliptic Function for One-Pass Data Stream Clustering10.1016/j.datak.2018.07.002 ↗
21. DyClee: Dynamic clustering for tracking evolving environments10.1016/j.patcog.2019.05.024 ↗
22. DGStream: High quality and efficiency stream clustering algorithm10.1016/j.eswa.2019.112947 ↗
23. Novelty detection in continuously changing environments10.1016/j.future.2020.07.037 ↗
24. Handling drifts and shifts in on-line data streams with evolving fuzzy systems10.1016/j.asoc.2010.07.003 ↗
25. Discussion and review on evolving data streams and concept drift adapting10.1007/s12530-016-9168-2 ↗
26. A survey on concept drift adaptation10.1145/2523813 ↗
27. An evolving approach to unsupervised and Real-Time fault detection in industrial processes10.1016/j.eswa.2016.06.035 ↗
28. Evolving Fuzzy Set-based and Cloud-based Unsupervised Classifiers for Spam Detection10.1109/TLA.2019.8931138 ↗
29. The clustering algorithm for efficient energy management in mobile ad-hoc networks10.1016/j.comnet.2019.106983 ↗
30. Online reliable semi-supervised learning on evolving data streams10.1016/j.ins.2020.03.052 ↗
31. Ntoutsi, I., Zimek, A., Palpanas, T., Kröger, P., and Kriegel, H.P. (2012, January 26–28). Density-based Projected Clustering over High Dimensional Data Streams. Proceedings of the 2012 SIAM International Conference on Data Mining, Anaheim, CA, USA.10.1137/1.9781611972825.85 ↗
32. Angelov, P. (2014, January 9–12). Anomaly detection based on eccentricity analysis. Proceedings of the 2014 IEEE Symposium on Evolving and Autonomous Learning Systems (EALS), Orlando, FL, USA.10.1109/EALS.2014.7009497 ↗
33. Versatile Hyper-Elliptic Clustering Approach for Streaming Data Based on One-Pass-Thrown-Away Learning10.1007/s00357-017-9222-1 ↗
34. Ant Colony Stream Clustering: A Fast Density Clustering Algorithm for Dynamic Data Streams10.1109/TCYB.2018.2822552 ↗
35. Asan, U., Soyer, A., and Serdarasan, S. (2012). Computational Intelligence Systems in Industrial Engineering, Atlantis Computational Intelligence Systems; Atlantis Press.
36. Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P., Gramfort, A., and Grobler, J. (2013, January 23–27). API design for machine learning software: Experiences from the scikit-learn project. Proceedings of the ECML PKDD Workshop: Languages for Data Mining and Machine Learning, Prague, Czech Republic.
37. Robust path-based spectral clustering10.1016/j.patcog.2007.04.010 ↗
38. Scikit-learn: Machine Learning in Python
39. Comparing partitions10.1007/BF01908075 ↗
40. Bisong, E. (2019). Google Colaboratory. Building Machine Learning and Deep Learning Models on Google Cloud Platform: A Comprehensive Guide for Beginners, Apress.10.1007/978-1-4842-4470-8 ↗