journal article·2023-07-04Open access

Research and Application of Semi-Supervised Category Dictionary Model Based on Transfer Learning

Yuansheng Dai, Yingyi Liu, Haoyu Song, Bing He, Haiwen Yuan, Boyang Zhang

Applied Sciences· Volume 13· Issue 13

Abstract

Classification tasks are pivotal across diverse applications, yet the burgeoning amount of data, coupled with complicating factors such as noise, exacerbates the challenge of classifying complex data. For algorithms that require a large amount of data, the annotation work for datasets is also exceptionally complex and tedious. Drawing upon existing research, this paper first introduces a novel semi-supervised category dictionary model based on transfer learning (SSDT). This model is designed to construct a more representative category dictionary and to delineate the associations of information across different domains, utilizing the lens of conditional probability distribution. This approach is particularly apt for semi-supervised transfer learning scenarios. Subsequently, the proposed method is applied to the domain of bearing fault diagnosis. This model is suitable for transfer scenarios; moreover, its semi-supervised characteristic eliminates the need for labeling the entire input dataset, significantly reducing manual workload. Experimental results attest to the model’s practical utility. When benchmarked against other 6 models, the SSDT model demonstrates enhanced generalization performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Domain Adaptation and Few-Shot Learning · Text and Document Classification Technologies · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Grid Shanghai Extra High Voltage Company, Shanghai 200063, China

Department of Testing Technology and Automation Equipment, School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China

Funding

Science and Technology project of State Grid Corporation: Research and application of insulator string digitization for UHV transmission line based on multi-parameter composite perception

References (30)

Show source-provided references
1. Shekhar, S., Patel, V.M., Nguyen, H.V., and Chellappa, R. (2013, January 23–28). Generalized domain-adaptive dictionaries. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.53 ↗
2. A Survey on Transfer Learning
3. Lu, B., Chellappa, R., and Nasrabadi, N.M. (2015, January 7–10). Incremental Dictionary Learning for Unsupervised Domain Adaptation. Proceedings of the British Machine Vision Conference 2015, Swansea, UK.10.5244/C.29.108 ↗
4. Long, M., Ding, G., Wang, J., Sun, J., Guo, Y., and Yu, P.S. (2013, January 23–28). Transfer Sparse Coding for Robust Image Representation. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.59 ↗
5. (March, January 22). Supervised Transfer Sparse Coding. Proceedings of the AAAI Conference on Artificial Intelligence, held virtually. Available online: https://ojs.aaai.org/index.php/AAAI/article/view/8981.
6. Wang, S., Zhang, L., and Zuo, W. (2017, January 22–29). Class-Specific Reconstruction Transfer Learning via Sparse Low-Rank Constraint. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.10.1109/ICCVW.2017.116 ↗
7. Semi-supervised transfer subspace for domain adaptation10.1016/j.patcog.2017.04.011 ↗
8. Ding, Z., Shao, M., and Fu, Y. (2014, January 27–31). Latent Low-Rank Transfer Subspace Learning for Missing Modality Recognition. Proceedings of the Twenty-Eighth Aaai Conference on Artificial Intelligence, Québec City, QC, Canada.10.1609/aaai.v28i1.8905 ↗
9. Boutilier, C. (2009, January 11–17). Domain Adaptation via Transfer Component Analysis. Proceedings of the 21st International Joint Conference on Artificial Intelligence (ijcai-09), Pasadena, CA, USA.
10. Gong, B., Shi, Y., Sha, F., and Grauman, K. (2012, January 16–21). Geodesic Flow Kernel for Unsupervised Domain Adaptation. Proceedings of the 2012 Ieee Conference on Computer Vision and Pattern Recognition (cvpr), Providence, RI, USA.
11. Discriminative Transfer Subspace Learning via Low-Rank and Sparse Representation10.1109/TIP.2015.2510498 ↗
12. Lee, H., Battle, A., Raina, R., and Ng, A. (2006). Proceedings of the Advances in Neural Information Processing Systems, MIT Press.
13. Fang, C., Xu, Y., and Rockmore, D.N. (2013, January 1–8). Unbiased metric learning: On the utilization of multiple datasets and web images for softening bias. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.208 ↗
14. Choi, M.J., Lim, J.J., Torralba, A., and Willsky, A.S. (2010, January 13–18). Exploiting hierarchical context on a large database of object categories. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5540221 ↗
15. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
16. LabelMe: A database and web-based tool for image10.1007/s11263-007-0090-8 ↗
17. Tommasi, T., and Tuytelaars, T. (September, January 6–7,). A testbed for cross-dataset analysis. Proceedings of the Computer Vision-ECCV 2014 Workshops, Zurich, Switzerland. Part III 13.10.1007/978-3-319-16199-0_2 ↗
18. Deep domain generalization with structured low-rank constraint10.1109/TIP.2017.2758199 ↗
19. Ghifary, M., Kleijn, W.B., Zhang, M., and Balduzzi, D. (2015, January 7–13). Domain generalization for object recognition with multi-task autoencoders. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.293 ↗
20. (2023, May 14). Data of Vision. Available online: https://www.cs.dartmouth.edu/~chenfang/%20proj_page/FXR_iccv13/%20index.%20php.
21. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
22. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., and Darrell, T. (2014, January 21–26). DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. Proceedings of the International Conference on Machine Learning, Beijing, China.
23. Adaptive feature extraction using sparse coding for machinery fault diagnosis10.1016/j.ymssp.2010.07.019 ↗
24. Deep Model Based Domain Adaptation for Fault Diagnosis10.1109/TIE.2016.2627020 ↗
25. Wang, Y., Zhou, Z., and Zhou, A. (2006). Machine Learning and Its Applications, Tsinghua University Press Co.
26. Robust Face Recognition via Sparse Representation10.1109/TPAMI.2008.79 ↗
27. Shao, M., Castillo, C., Gu, Z., and Fu, Y. (2012, January 10). Low-rank transfer subspace learning. Proceedings of the 2012 IEEE 12th International Conference on Data Mining, IEEE, Washington, DC, USA.10.1109/ICDM.2012.102 ↗
28. A Survey of Dictionary Learning Algorithms for Face Recognition10.1109/ACCESS.2017.2695239 ↗
29. Yang, A.Y., Sastry, S.S., Ganesh, A., and Ma, Y. (2010, January 26–29). Fast ℓ1-minimization algorithms and an application in robust face recognition: A review. Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong, China.10.1109/ICIP.2010.5651522 ↗
30. (2023, May 29). Bearing Test Data. Case Western Reserve University Bearing Data Center. Available online: http://csegroups.case.edu/bearingdatacenter/home.