Research on Chinese Named Entity Recognition Based on Lexical Information and Spatial Features
Source abstract
Abstract
In the field of Chinese-named entity recognition, recent research has sparked new interest by combining lexical features with character-based methods. Although this vocabulary enhancement method provides a new perspective, it faces two main challenges: firstly, using character-by-character matching can easily lead to conflicts during the vocabulary matching process. Although existing solutions attempt to alleviate this problem by obtaining semantic information about words, they still lack sufficient temporal sequential or global information acquisition; secondly, due to the limitations of dictionaries, there may be words in a sentence that do not match the dictionary. In this situation, existing vocabulary enhancement methods cannot effectively play a role. To address these issues, this paper proposes a method based on lexical information and spatial features. This method carefully considers the neighborhood and overlap relationships of characters in vocabulary and establishes global bidirectional semantic and temporal sequential information to effectively address the impact of conflicting vocabulary and character fusion on entity segmentation. Secondly, the attention score matrix extracted by the point-by-point convolutional network captures the local spatial relationship between characters without fused vocabulary information and characters with fused vocabulary information, aiming to compensate for information loss and strengthen spatial connections. The comparison results with the baseline model show that the SISF method proposed in this paper improves the F1 metric by 0.72%, 3.12%, 1.07%, and 0.37% on the Resume, Weibo, Ontonotes 4.0, and MSRA datasets, respectively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Authorship Attribution and Profiling
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Technology, Xinjiang University, Urumqi 830046, China
Funding
National Key R&D Program of China · Major Science and Technology Projects in Xinjiang Uygur Autonomous Region · National Natural Science Foundation of China
References (32)
Show source-provided references
1. McIlraith, S.A., and Weinberger, K.Q. (2018, January 2–7). Empower Sequence Labeling with Task-Aware Neural Language Model. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th Innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, LA, USA.
2. Sun, T., Shao, Y., Li, X., Liu, P., Yan, H., Qiu, X., and Huang, X. (2020, January 7–12). Learning Sparse Sharing Architectures for Multiple Tasks. Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, the Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, the Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA.
3. Mitkov, R., and Angelova, G. (2017, January 2–8). Neural Reranking for Named Entity Recognition. Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017, Varna, Bulgaria.
4. F-Score Driven Max Margin Neural Network for Named Entity Recognition in Chinese Social Media
5. Jurafsky, D., Chai, J., Schluter, N., and Tetreault, J.R. (2020, January 5–10). Simplify the Usage of Lexicon in Chinese NER. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online.
6. Chinese NER Using Lattice LSTM
7. Jurafsky, D., Chai, J., Schluter, N., and Tetreault, J.R. (2020, January 5–10). FLAT: Chinese NER Using Flat-Lattice Transformer. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online.
8. Word segmentation of overlapping ambiguous strings during Chinese reading10.1037/a0035389 ↗
9. Gui, T., Ma, R., Zhang, Q., Zhao, L., Jiang, Y., and Huang, X. (2019, January 10–16). CNN-Based Chinese NER with Lexicon Rethinking. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China.10.24963/ijcai.2019/692 ↗
10. García-Castro, R. (2020, January 9–19). SLK-NER: Exploiting Second-order Lexicon Knowledge for Chinese NER. Proceedings of the 32nd International Conference on Software Engineering and Knowledge Engineering, SEKE 2020, Pittsburgh, PA, USA.
11. Scott, D., Bel, N., and Zong, C. (2020, January 8–13). Porous Lattice Transformer Encoder for Chinese NER. Proceedings of the 28th International Conference on Computational Linguistics, COLING 2020, Barcelona, Spain (Online).
12. Ma, X., and Hovy, E.H. (2016, January 7–12). End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, Berlin, Germany.10.18653/v1/P16-1101 ↗
13. Calzolari, N., Choukri, K., Declerck, T., Loftsson, H., Maegaard, B., Mariani, J., Moreno, A., Odijk, J., and Piperidis, S. (2014, January 26–31). Comparison of the Impact of Word Segmentation on Name Tagging for Chinese and Japanese. Proceedings of the Ninth International Conference on Language Resources and Evaluation, LREC 2014, Reykjavik, Iceland.
14. Yu, J., Feng, X., Li, J., and Liu, J. (2023, January 26–29). Named Entity Recognition in Classical Chinese by Lexicon Enhancement. Proceedings of the IEEE International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2023, Venice, Italy.10.1109/WI-IAT59888.2023.00076 ↗
15. Aguilar, G., López-Monroy, A.P., González, F.A., and Solorio, T. (2019). Modeling Noisiness to Recognize Named Entities using Multitask Neural Networks on Social Media. arXiv.10.18653/v1/N18-1127 ↗
16. Chinese NER Using Dynamic Meta-Embeddings10.1109/ACCESS.2019.2916816 ↗
17. Zhang, D., Lu, J., and Zhang, P. (2023). Unified Lattice Graph Fusion for Chinese named entity recognition. arXiv.
18. Named entity recognition in aerospace based on multi-feature fusion transformer10.1038/s41598-023-50705-0 ↗
19. Carpuat, M., de Marneffe, M., and Ruíz, I.V.M. (2022, January 10–15). Delving Deep into Regularity: A Simple but Effective Method for Chinese named entity recognition. Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, Seattle, WA, USA.
20. Investigating the emotional experiences in eSports spectatorship: The case of League of Legends10.1016/j.ipm.2023.103516 ↗
21. VisPhone: Chinese named entity recognition model enhanced by visual and phonetic features10.1016/j.ipm.2023.103314 ↗
22. CAN-NER: Convolutional Attention Network for Chinese Named Entity Recognition
23. LSTM-CRF Neural Network with Gated Self Attention for Chinese NER10.1109/ACCESS.2019.2942433 ↗
24. Lu, Z., Xie, H., Liu, C., and Zhang, Y. (December, January 28). Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasets. Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA.
25. Transformer-XL: Attentive Language Models beyond a Fixed-Length Context
26. Yan, H., Deng, B., Li, X., and Qiu, X. (2019). TENER: Adapting Transformer Encoder for Named Entity Recognition. arXiv.
27. Meng, Y., Wu, W., Wang, F., Li, X., Nie, P., Yin, F., Li, M., Han, Q., Sun, X., and Li, J. (2019, January 8–14). Glyce: Glyph-vectors for Chinese Character Representations. Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, Vancouver, BC, Canada.
28. Jurafsky, D., Chai, J., Schluter, N., and Tetreault, J.R. (2020, January 5–10). Named Entity Recognition as Dependency Parsing. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online.
29. Palmer, M., Hwa, R., and Riedel, S. (2017, January 9–11). Fast and Accurate Entity Recognition with Iterated Dilated Convolutions. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017, Copenhagen, Denmark.
30. Brodley, C.E., and Danyluk, A.P. (July, January 28). Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), Williamstown, MA, USA.
31. FGN: Fusion Glyph Network for Chinese named entity recognition
32. Token Relation Aware Chinese named entity recognition10.1145/3531534 ↗