journal article·2021-03-01Open access

Machine Learning-Based Malicious X.509 Certificates’ Detection

Jiaxin Li, Zhaoxin Zhang, Changyong Guo

Applied Sciences· Volume 11· Issue 5

Abstract

X.509 certificates play an important role in encrypting the transmission of data on both sides under HTTPS. With the popularization of X.509 certificates, more and more criminals leverage certificates to prevent their communications from being exposed by malicious traffic analysis tools. Phishing sites and malware are good examples. Those X.509 certificates found in phishing sites or malware are called malicious X.509 certificates. This paper applies different machine learning models, including classical machine learning models, ensemble learning models, and deep learning models, to distinguish between malicious certificates and benign certificates with Verification for Extraction (VFE). The VFE is a system we design and implement for obtaining plentiful characteristics of certificates. The result shows that ensemble learning models are the most stable and efficient models with an average accuracy of 95.9%, which outperforms many previous works. In addition, we obtain an SVM-based detection model with an accuracy of 98.2%, which is the highest accuracy. The outcome indicates the VFE is capable of capturing essential and crucial characteristics of malicious X.509 certificates.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Internet Traffic Analysis and Secure E-voting · Spam and Phishing Detection · Network Security and Intrusion Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Network Information Security Research Center, School of Computer Science and Technology, Harbin Institute of Technology at Weihai, Weihai 264200, Shandong, China

Funding

Ministry of Science and Technology of the People's Republic of China

References (30)

Show source-provided references
1. Cooper, D., Santesson, S., Farrell, S., Boeyen, S., Housley, R., and Polk, W. (2021, February 27). RFC 5280: Internet X. 509 Public Key Infrastructure Certificate and Certificate Revocation List (CRL) Profile. RFC 5280, May 2008. Available online: https://www.rfc-editor.org/info/rfc5280.10.17487/rfc5280 ↗
2. Ghafir, I., Prenosil, V., Hammoudeh, M., Han, L., and Raza, U. (2017, January 19–20). Malicious SSL certificate detection: A step towards advanced persistent threat defence. Proceedings of the International Conference on Future Networks and Distributed Systems, Cambridge, UK.10.1145/3102304.3102331 ↗
3. Mishari, M.A., De Cristofaro, E., Defrawy, K.E., and Tsudik, G. (2009). Harvesting SSL certificate data to identify Web-fraud. arXiv.
4. Detection of rogue certificates from trusted certificate authorities using deep neural networks10.1145/2975591 ↗
5. Torroledo, I., Camacho, L.D., and Bahnsen, A.C. (2018, January 19). Hunting malicious TLS certificates with deep neural networks. Proceedings of the 11th ACM Workshop on Artificial Intelligence and Security, Toronto, ON, Canada.10.1145/3270101.3270105 ↗
6. Fasllija, E., Enişer, H.F., and Prünster, B. (2019, January 23–25). Phish-Hook: Detecting Phishing Certificates Using Certificate Transparency Logs. Proceedings of the International Conference on Security and Privacy in Communication Systems, Orlando, FL, USA.10.1007/978-3-030-37231-6_18 ↗
7. On the detection of fake certificates via attribute correlation10.3390/e17063806 ↗
8. Dong, Z., Kapadia, A., Blythe, J., and Camp, L.J. (2015, January 26–29). Beyond the lock icon: Real-time detection of phishing websites using public key certificates. Proceedings of the 2015 APWG Symposium on Electronic Crime Research (eCrime), Barcelona, Spain.10.1109/ECRIME.2015.7120795 ↗
9. Hutchinson, S., Zhang, Z., and Liu, Q. (2018, January 6–8). Detecting phishing websites with random forest. Proceedings of the International Conference on Machine Learning and Intelligent Communications, Hangzhou, China.10.1007/978-3-030-00557-3_46 ↗
10. Phishing Websites Detection using Machine Learning
11. Kumar, D., Wang, Z., Hyder, M., Dickinson, J., Beck, G., Adrian, D., Mason, J., Durumeric, Z., Halderman, J.A., and Bailey, M. (2018, January 21–23). Tracking certificate misissuance in the wild. Proceedings of the 2018 IEEE Symposium on Security and Privacy (SP), Francisco, CA, USA.10.1109/SP.2018.00015 ↗
12. Drury, V., and Meyer, U. (2019, January 11–13). Certified phishing: Taking a look at public key certificates of phishing websites. Proceedings of the 15th Symposium on Usable Privacy and Security (SOUPS’19), Santa Clara, CA, USA.
13. Fadai, T., Schrittwieser, S., Kieseberg, P., and Mulazzani, M. (2015, January 24–28). Trust me, I’m a Root CA! Analyzing SSL Root CAs in Modern Browsers and Operating Systems. Proceedings of the 2015 10th International Conference on Availability, Reliability and Security, Toulouse, France.10.1109/ARES.2015.93 ↗
14. Understanding bag-of-words model: A statistical framework10.1007/s13042-010-0001-0 ↗
15. Joulin, A., Grave, E., Bojanowski, P., and Mikolov, T. (2016). Bag of tricks for efficient text classification. arXiv.10.18653/v1/E17-2068 ↗
16. Severyn, A., and Moschitti, A. (2015, January 9–13). Learning to rank short text pairs with convolutional deep neural networks. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile.10.1145/2766462.2767738 ↗
17. Akhawe, D., Amann, B., Vallentin, M., and Sommer, R. (2013, January 13–17). Here’s my cert, so trust me, maybe? Understanding TLS errors on the web. Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil.10.1145/2488388.2488395 ↗
18. The Origins of Logistic Regression
19. Nwankpa, C., Ijomah, W., Gachagan, A., and Marshall, S. (2018). Activation functions: Comparison of trends in practice and research for deep learning. arXiv.
20. Evgeniou, T., and Pontil, M. (1999). Support vector machines: Theory and applications. Advanced Course on Artificial Intelligence, Springer.
21. Induction of decision trees10.1007/BF00116251 ↗
22. Ensemble learning
23. Random forests10.1023/A:1010933404324 ↗
24. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd acm Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
25. Lightgbm: A highly efficient gradient boosting decision tree
26. CatBoost: Unbiased boosting with categorical features
27. Imagenet classification with deep convolutional neural networks
28. Deep learning10.1038/nature14539 ↗
29. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
30. Dong, Z., Kapadia, A., and Camp, L.J. (2013, January 9–13). Pinning & binning: Real time classification of certificates. Proceedings of the 29th Annual Computer Security Applications Conference, New Orleans, LA, USA. poster presentation.