Software Operation Anomalies Diagnosis Method Based on a Multiple Time Windows Mixed Model
Source abstract
Abstract
The detection of anomalies in software systems has become increasingly crucial in recent years due to their impact on overall software quality. However, existing integrated anomaly detectors usually combine the results of multiple detectors in a clustering manner and do not consider the changes in data anomalies in the time dimension. This paper investigates the limitations of existing anomaly detection methods and proposes an improved integrated anomaly detection approach based on time windows and a voting mechanism. By utilizing multiple time windows, the proposed method overcomes the challenges of cumulative anomalies and achieves enhanced performance in capturing anomalies that accumulate gradually over time. Additionally, two hybrid models are introduced, based on accuracy and sensitivity, respectively, to optimize performance metrics such as AUC, precision, recall, and F1-score. The proposed method demonstrates remarkable performance, achieving either the highest or only a marginal 3% lower performance compared to the optimal model.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection · Software System Performance and Reliability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China
References (33)
Show source-provided references
1. Be more familiar with our enemies and pave the way forward: A review of the roles bugs played in software failures10.1016/j.jss.2017.06.069 ↗
2. Newman, M. (2023, April 05). Software Errors Cost US Economy $59.5 Billion Annually, NIST Assesses Technical Needs of Industry to Improve Software-Testing, Available online: https://www.nist.gov/system/files/documents/director/planning/report02-3.pdf.
3. Zhao, Y., Nasrullah, Z., and Li, Z. (2019). PyOD: A Python Toolbox for Scalable Outlier Detection. arXiv.
4. Predicting Performance Anomalies in Software Systems at Run-time
5. Kohyarnejadfard, I., Aloise, D., Dagenais, M.R., and Shakeri, M. (2021). A Framework for Detecting System Performance Anomalies Using Tracing Data Analysis. Entropy, 23.10.3390/e23081011 ↗
6. Tracking clusters and anomalies in evolving data streams10.1002/sam.11552 ↗
7. Summary of Software Failure Static Prediction Methods
8. Count Models for Software Quality Estimation10.1109/TR.2007.896757 ↗
9. A Comprehensive Empirical Study of Count Models for Software Fault Prediction10.1109/TR.2007.896761 ↗
10. Identification of defect-prone classes in telecommunication software systems using design metrics10.1016/j.ins.2005.12.002 ↗
11. Data Mining Static Code Attributes to Learn Defect Predictors10.1109/TSE.2007.256941 ↗
12. Jia, S., Hou, C., and Wang, J. (2017, January 6–8). Software aging analysis and prediction in a web server based on multiple linear regression algorithm. Proceedings of the 2017 IEEE 9th International Conference on Communication Software and Networks (ICCSN), Guangzhou, China.10.1109/ICCSN.2017.8230349 ↗
13. Predicting aging-related bugs using software complexity metrics10.1016/j.peva.2012.09.004 ↗
14. A framework for on-line timing error detection in software systems10.1016/j.future.2018.08.025 ↗
15. Arning, A., Agrawal, R., and Raghavan, P. (2023, April 05). A Linear Method for Deviation Detection in Large Databases. United States: N. p., 1996. Web. Available online: https://cdn.aaai.org/KDD/1996/KDD96-027.pdf.
16. Estimating the Support of a High-Dimensional Distribution10.1162/089976601750264965 ↗
17. Shyu, M., Chen, S., Sarinnapakorn, K., and Chang, L. (2023, April 05). A novel anomaly detection scheme based on principal component classifier. In Proceedings of the IEEE Foundations and New Directions of Data Mining Workshop, in conjunction with the Third IEEE International Conference on Data Mining, ICDM’03, 2003, pp. 172–179. Available online: https://scholar.google.com.hk/scholar?hl=en&as_sdt=0%2C5&q=.+A+novel+anomaly+detection+scheme+based+on+principal+component+classifier.+&btnG=#d=gs_cit&t=1696759862460&u=%2Fscholar%3Fq%3Dinfo%3AjiTPoAYrCo8J%3Ascholar.google.com%2F%26output%3Dcite%26scirp%3D0%26hl%3Den.
18. Ramaswamy, S., Rastogi, R., and Shim, K. (2000, January 15–18). Efficient algorithms for mining outliers from large data sets. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, New York, NY, USA.10.1145/342009.335437 ↗
19. Fast Outlier Detection in High Dimensional Spaces10.1007/3-540-45681-3_2 ↗
20. Breunig, M.M., Kriegel, H.-P., Ng, R.T., and Sander, J. (2000, January 16–18). LOF: Identifying Density-Based Local Outliers. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Association for Computing Machinery, New York, NY, USA.10.1145/342009.335388 ↗
21. Tang, J., Chen, Z., Fu, A.W., and Cheung, D.W. (2002). Advances in Knowledge Discovery and Data Mining, Springer.
22. Discovering cluster-based local outliers10.1016/S0167-8655(03)00003-5 ↗
23. Histogram-based Outlier Score (HBOS): A fast Unsupervised Anomaly Detection Algorithm
24. A Novel Outlier Detection Method for Multivariate Data10.1109/TKDE.2020.3036524 ↗
25. Kingma, D.P., and Welling, M. (2013). Auto-Encoding Variational Bayes. arXiv, Available online: http://arxiv.org/abs/1312.6114.
26. Generative Adversarial Active Learning for Unsupervised Outlier Detection
27. A Review on Outlier/Anomaly Detection in Time Series Data
28. IoT anomaly detection methods and applications: A survey10.1016/j.iot.2022.100568 ↗
29. Distributed Anomaly Detection Using Minimum Volume Elliptical Principal Component Analysis10.1109/TKDE.2016.2555804 ↗
30. Zhao, Y., Nasrullah, Z., Hryniewicki, M.K., and Li, Z. (2019). Proceedings of the 2019 SIAM International Conference on Data Mining, Society for Industrial and Applied Mathematics.
31. SUOD: Accelerating Large-scale Unsupervised Heterogeneous Outlier Detection
32. (2023, May 08). Available online: https://github.com/waico/SkAB.
33. (2023, May 08). Available online: https://github.com/numenta/NAB.