Deep Learning-Based Automatic Summarization of Chinese Maritime Judgment Documents
Source abstract
Abstract
In the context of China’s accelerating maritime judicial digitization, automatic summarization of lengthy and terminology-rich judgment documents has become a critical need for improving legal efficiency. Focusing on the task of automatic summarization for Chinese maritime judgment documents, we propose HybridSumm, an “extraction–abstraction” hybrid summarization framework that integrates a maritime judgment lexicon to address the unique characteristics of maritime legal texts, including their extended length and dense domain-specific terminology. First, we construct a specialized maritime judgment lexicon to enhance the accuracy of legal term identification, specifically targeting the complexity of maritime terminology. Second, for long-text processing, we design an extractive summarization model that integrates the RoBERTa-wwm-ext pre-trained model with dilated convolutional networks and residual mechanisms. It can efficiently identify key sentences by capturing both local semantic features and global contextual relationships in lengthy judgments. Finally, the abstraction stage employs a Nezha-UniLM encoder–decoder architecture, augmented with a pointer–generator network (for out-of-vocabulary term handling) and a coverage mechanism (to reduce redundancy), ensuring that summaries are logically coherent and legally standardized. Experimental results show that HybridSumm’s lexicon-guided two-stage framework significantly enhances the standardization of legal terminology and semantic coherence in long-text summaries, validating its practical value in advancing judicial intelligence development.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Advanced Text Analysis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Maritime Economics and Management, Dalian Maritime University, Dalian 116026, China
Funding
Dalian Federation of Social Science Associations · Liaoning Federation of Social Science Associations
References (75)
Show source-provided references
1. The automatic creation of literature abstracts10.1147/rd.22.0159 ↗
2. Recent automatic text summarization techniques: A survey10.1007/s10462-016-9475-9 ↗
3. A review of automatic text summarization research in recent 70 years
4. Ishikawa, K., Ando, S., and Okumura, A. (2001, January 7–9). Hybrid text summarization method based on the TF method and the LEAD method. Proceedings of the Second NTCIR Workshop Meeting on Evaluation of Chinese & Japanese Text Retrieval and Text Summarization, Tokyo, Japan.
5. New methods in automatic extracting10.1145/321510.321519 ↗
6. Lloret, E., and Palomar, M. (2009, January 13–17). A gradual combination of features for building automatic summarisation systems. Proceedings of the 12th International Conference on Text, Speech and Dialogue, Pilsen, Czech Republic.10.1007/978-3-642-04208-9_6 ↗
7. PadmaLahari, E., Kumar, D.V.N.S., and Prasad, S. (2014, January 8–10). Automatic text summarization with statistical and linguistic features using successive thresholds. Proceedings of the 2014 IEEE International Conference on Advanced Communications, Control and Computing Technologies, Ramanathapuram, India.10.1109/ICACCCT.2014.7019360 ↗
8. Research on automatic text summarization combining topic feature
9. Gong, Y., and Liu, X. (2001, January 9–13). Generic text summarization using relevance measure and latent semantic analysis. Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New Orleans, LA, USA.10.1145/383952.383955 ↗
10. Summarization of changes in dynamic text collections using Latent Dirichlet Allocation model10.1016/j.ipm.2015.06.002 ↗
11. Page, L., Brin, S., Motwani, R., and Winograd, T. (1998). The PageRank Citation Ranking: Bringing Order to the Web, Stanford Infolab. Technical Report.
12. Zong, Q., Xia, R., and Zhang, J. (2021). Text Data Mining, Springer Nature Singapore Pte Ltd.10.1007/978-981-16-0100-2 ↗
13. Mihalcea, R., and Tarau, P. (2004, January 25–26). TextRank: Bringing order into texts. Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, Barcelona, Spain.
14. Lexrank: Graph-based lexical centrality as salience in text summarization10.1613/jair.1523 ↗
15. Chinese automatic text summarization based on weighted TextRank
16. Chinese Single Document Summarization Based on LexRank
17. Improving triangle-graph based text summarization using hybrid similarity function
18. Carbonell, J., and Goldstein, J. (1998, January 24–28). The use of MMR, diversity-based reranking for reordering documents and producing summaries. Proceedings of the 21st Annual ACM SIGIR International Conference on Research and Development in Information Retrieval, Melbourne, Australia.10.1145/290941.291025 ↗
19. Pozzi, A., Barbierato, E., and Toti, D. (2023). Cryptoblend: An AI-powered tool for aggregation and summarization of cryptocurrency news. Informatics, 10.10.3390/informatics10010005 ↗
20. Yin, W., and Pei, Y. (2015, January 25–31). Optimizing sentence modeling and selection for document summarization. Proceedings of 24th International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina.
21. Aggarwal, C.C., and Zhai, C. (2012). A Survey of Text Summarization Techniques. Mining Text Data, Springer Science+Business Media.10.1007/978-1-4614-3223-4 ↗
22. Kupiec, J., Pedersen, J., and Chen, F. (1995, January 9–13). A trainable document summarizer. Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, WA, USA.10.1145/215206.215333 ↗
23. Zhang, J., Chan, H.Y., Fung, P., and Cao, L. (2007, January 27–31). A comparative study on speech summarization of broadcast news and lecture speech. Proceedings of 8th Annual Conference of the International Speech Communication Association, Antwerp, Belgium.
24. Conroy, J., and O’leary, D. (2001, January 9–13). Text summarization via hidden Markov models. Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New Orleans, LA, USA.10.1145/383952.384042 ↗
25. Osborne, M. (2002, January 11–12). Using maximum entropy for sentence extraction. Proceedings of the ACL-02 Workshop on Automatic Summarization, Phildadelphia, PA, USA.10.3115/1118162.1118163 ↗
26. Query-focused multi-document summarization: Automatic data annotations and supervised learning approaches10.1017/S1351324911000167 ↗
27. Louis, A., Joshi, A., and Nenkova, A. (2010, January 24–25). Discourse indicators for content selection in summarization. Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Tokyo, Japan.
28. Nallapati, R., Zhai, F., and Zhou, B. (2017, January 4–9). SummaRuNNer: A recurrent neural network based sequence model for extractive summarization of document. Proceedings of the 31st AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.10958 ↗
29. Rachabathuni, P.K. (2017, January 23–24). A survey on abstractive summarization techniques. Proceedings of the 2017 International Conference on Inventive Computing and Informatics (ICICI), Coimbatore, India.
30. Concept generalization and fusion for abstractive sentence generation10.1016/j.eswa.2016.01.007 ↗
31. Nayeem, M.T., and Chali, Y. (2017, January 6–10). Paraphrastic fusion for abstractive multi-sentence compression generation. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore.10.1145/3132847.3133106 ↗
32. Embar, V.R., Deshpande, S.R., Vaishnavi, A.K., Jain, V., and Kallimani, J.S. (2013, January 22–25). sArAmsha—A Kannada abstractive summarizer. Proceedings of the 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Mysore, India.10.1109/ICACCI.2013.6637229 ↗
33. Kurisinkel, L.J., Zhang, Y., and Varma, V. (December, January 27). Abstractive multi-document summarization by partial tree extraction, recombination and linearization. Proceedings of the 8th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Taipei, Taiwan.
34. Abstractive text summarization based on improved semantic graph approach10.1007/s10766-018-0560-3 ↗
35. Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1179 ↗
36. Sutskever, I., Vinyals, O., and Le, Q.V. (2014, January 8–13). Sequence to sequence learning with neural networks. Proceedings of the 27th International Conference on Neural Information Processing Systems, Montreal, QC, Canada.
37. Rush, A.M., Chopra, S., and Weston, J. (2015, January 17–21). A neural attention model for abstractive sentence summarization. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.10.18653/v1/D15-1044 ↗
38. Chopra, S., Auli, M., and Rush, A.M. (2016, January 12–17). Abstractive sentence summarization with attentive recurrent neural networks. Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1012 ↗
39. Nallapati, R., Zhou, B., dos Santos, C., Gulcehre, C., and Xiang, B. (2016, January 11–12). Abstractive text summarization using sequence-to-sequence RNNs and beyond. Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning, Berlin, Germany.10.18653/v1/K16-1028 ↗
40. Tan, J., Wan, X., and Xiao, J. (August, January 30). Abstractive document summarization with a graph-based attentional neural model. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
41. Chen, Q., Zhu, X., Ling, Z., Wei, S., and Jiang, H. (2016, January 9–15). Distraction-based neural networks for document summarization. Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI-16), New York, NY, USA.
42. Zhang, J., Zhao, Y., Saleh, M., and Liu, P. (2020, January 13–18). Pegasus: Pre-training with extracted gap-sentences for abstractive summarization. Proceedings of the 37th International Conference on Machine Learning, Online.
43. Pozzi, A., Incremona, A., Tessera, D., and Toti, D. (2025). Mitigating exposure bias in large language model distillation: An imitation learning approach. Neural. Comput. Appl.10.1007/s00521-025-11162-0 ↗
44. Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I. (2024, June 16). Improving Language Understanding by Generative Pre-Training. Available online: https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf.
45. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.
46. Liu, Y. (2019). Fine-tune BERT for extractive summarization. arXiv.
47. Liu, Y., and Lapata, M. (2019, January 3–7). Text summarization with pretrained encoders. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1387 ↗
48. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I. (2024, June 16). Language Models are Unsupervised Multitask Learners. Available online: https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf.
49. Kieuvongngam, V., Tan, B., and Niu, Y. (2020). Automatic text summarization of COVID-19 medical research articles using bert and gpt-2. arXiv.
50. Natural language understanding for legal text: A review
51. Grover, C., Hachey, B., and Hughson, I. (2003, January 24–28). Automatic summarisation of legal documents. Proceedings of the 9th International Conference on Artificial Intelligence and Law, Scotland, UK.10.1145/1047788.1047839 ↗
52. Farzindar, A., and Lapalme, G. (2004, January 8–10). LetSum, an automatic legal text summarizing system. Proceedings of the 17th Annual Conference on Legal Knowledge and Information Systems, Berlin, Germany.
53. Galgani, F., Compton, P., and Hoffmann, A. (2012, January 23). Combining different summarization techniques for legal text. Proceedings of the Workshop on Innovative Hybrid Approaches to the Processing of Textual Data, Avignon, France.
54. Duan, X., Zhang, Y., and Yuan, L. (2019, January 3–7). Legal summarization for multi-role debate dialogue via controversy focus mining and multi-task learning. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.10.1145/3357384.3357940 ↗
55. Bhattacharya, P., Poddar, S., Rudra, K., Ghosh, K., and Ghosh, S. (2021, January 21–25). Incorporating domain knowledge for extractive summarization of legal case documents. Proceedings of the 18th International Conference on Artificial Intelligence and Law, São Paulo, Brazil.10.1145/3462757.3466092 ↗
56. Su, J. (2024, July 27). “SPACES: Extraction-Abstraction”-Based Long-Text Summarization (LAIC Summary). (In Chinese).
57. Abstractive automatic summarizing model for legal judgment documents
58. Effective deep learning approaches for summarization of legal texts10.1016/j.jksuci.2019.11.015 ↗
59. Method of abstracting judgement document combined with law
60. Huang, Y., Sun, L., Han, C., and Guo, J. (2023). A High-Precision Two-Stage Legal Judgment Summarization. Mathematics, 11.10.3390/math11061320 ↗
61. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv.
62. Pre-training with whole word masking for Chinese bert
63. Yu, F., and Koltun, V. (2016, January 2–4). Multi-scale context aggregation by dilated convolutions. Proceedings of the 4th International Conference on Learning Representations (ICLR), San Juan, Puerto Rico.
64. Dauphin, Y.N., Fan, A., Auli, M., and Grangier, D. (2017, January 6–11). Language modeling with gated convolutional networks. Proceedings of the 34th International Conference on Machine Learning—Volume 70, Sydney, Australia.
65. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
66. Su, J. (2024, July 29). DGCNN: A Reading Comprehension-Based Question Answering Model Using CNN. (In Chinese).
67. Wei, J., Ren, X., Li, X., Huang, W., Liao, Y., Wang, Y., Lin, J., Jiang, X., Chen, X., and Liu, Q. (2019). NEZHA: Neural contextualized representation for Chinese language understanding. arXiv.
68. Micikevicius, P., Narang, S., Alben, J., Diamos, G., Elsen, E., Garcia, D., Ginsburg, B., Houston, M., Kuchaiev, O., and Venkatesh, G. (May, January 30). Mixed precision training. Proceedings of the 6th International Conference on Learning Representations, Vancouver, BC, Canada.
69. Li, D., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., and Hon, H.W. (2019, January 8–14). Unified language model pre-training for natural language understanding and generation. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, BC, Canada.
70. See, A., Liu, P.J., and Manning, C.D. (August, January 30). Get to the point: Summarization with pointer-generator networks. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
71. Wiseman, S., and Rush, A.M. (2016, January 1–5). Sequence-to-sequence learning as beam-search optimization. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1137 ↗
72. Cui, Y., Che, W., Liu, T., Qin, B., Wang, S., and Hu, G. (2020, January 16–20). Revisiting pre-trained models for Chinese natural language processing. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, Online.10.18653/v1/2020.findings-emnlp.58 ↗
73. (2024, June 27). Available online: https://github.com/ymcui/MacBERT.
74. Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., and Zettlemoyer, L. (2020, January 5–10). Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.703 ↗
75. (2024, April 21). Available online: https://huggingface.co/uer/bart-base-chinese-cluecorpussmall.