基于改进的MMR算法的新闻文本抽取式摘要方法

doi:10.3969/j.issn.0255-8297.2021.03.010

Abstract

Abstract: This paper proposes a news extraction method based on maximal marginal relevance (MMR) and a news extraction method based on support vector machine and maximal marginal relevance (SVM-MMR). The first method improves the traditional MMR news extraction method, and the second one uses the improved MMR news extraction method to make a second choice of the SVM classification results. Compared with the traditional MMR news extraction method, the average precision of MMR-based and SVMMMR-based news extraction methods are improved by 0.148 and 0.204, respectively. And the extraction efficiency of the MMR-based method is about 3 times of that of the SVMMMR method. The augmented MMR algorithm is more suitable for application scenarios that require high summarization efficiency, especially for long text summarization, while the SVM-MMR method is more suitable for generating a more comprehensive summary of the text content.

Key words: news extraction, extractive summarization, redundant processing, support vector machine (SVM), maximal marginal relevance (MMR)

CLC Number:

TP391

CHENG Kun, LI Chuanyi, JIA Xinxin, GE Jidong, LUO Bin. News Summarization Extracting Method Based on Improved MMR Algorithm[J]. Journal of Applied Sciences, 2021, 39(3): 443-442.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

URL: https://www.jas.shu.edu.cn/EN/10.3969/j.issn.0255-8297.2021.03.010

https://www.jas.shu.edu.cn/EN/Y2021/V39/I3/443

References

[1] Mihalcea R, Tarau P. TextRank: bringing order into texts[C]//Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2004: 404-411.
[2] 荀静, 杨玉珍. 基于TextRank的文本情感摘要提取方法[J]. 计算机应用与软件, 2018, 35(10): 80-84. Gou J, Yang Y Z. Text emotion summarization extraction based on TextRank[J]. Computer Applications and Software, 2018, 35(10): 80-84. (in Chinese)
[3] 黄波, 刘传才. 基于加权TextRank的中文自动文本摘要[J]. 计算机应用研究, 2020, 37(2): 407-410. Huang B, Liu C C. Chinese automatic text summarization based on weighted TextRank[J]. Application Research of Computers, 2020, 37(2): 407-410. (in Chinese)
[4] Chakrabarti D, Punera K. Event summarization using tweets[C]//Proceedings of the 5th International AAAI Conference on Weblogs and Social Media, Barcelona, Catalonia, Spain, 2011: 66-73.
[5] Dohare S, Gupta V, Karnick H, et al. Unsupervised semantic abstractive summarization[C]//Proceedings of ACL 2018, Student Research Workshop, Melbourne, Australia, 2018: 74-83.
[6] Gillick D, Favre B. A scalable global model for summarization[C]//Proceedings of the Workshop on Integer Linear Programming for Natural Language Processing, 2009: 10-18.
[7] Kgebck M, Mogren O, Tahmasebi N, et al. Extractive summarization using continuous vector space models[C]//Proceedings of the 2nd Workshop on Continuous Vector Space Models and their Compositionality (CVSC), Gothenburg, Sweden, 2014: 31-39.
[8] Lin C Y. Training a selection function for extraction[C]//Proceedings of the 8th International Conference on Information and Knowledge Management, Edinburgh, United Kingdom, 1999: 55-62.
[9] Conroy J M, O’leary D P. Text summarization via hidden Markov models[C]//Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, New Orleans, Louisiana, USA, 2001: 406-407.
[10] Galley M. A skip-chain conditional random field for ranking meeting utterances by importance[C]//Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, Stroudsburg, PA, United States, 2006: 364-372.
[11] Zhang J, Fung P. Speech summarization without lexical features for Mandarin broad-cast news[C]//Human Language Technologies 2007: the Conference of the North American Chapter of the Association for Computational Linguistics, Stroudsburg, PA, United States, 2007: 213-216.
[12] 张剑, 袁华强. Rhetorical-state SVM在抽取式语音摘要中的应用[J]. 科学技术与工程, 2013, 13(21): 6299-6301, 6305. Zhang J, Yuan H Q. Rhetorical-state SVM for extractive speech summarization[J]. Science Technology and Engineering, 2013, 13(21): 6299-6301, 6305. (in Chinese)
[13] 孟令阁, 马建芬, 张雪英. 基于主题的SVM与MMR融合的会议摘要技术[J]. 计算机工程与设计, 2016, 37(10): 2695-2699. Meng L G, Ma J F, Zhang X Y. Meeting summarization technology confused with SVM and MMR based on theme[J]. Computer Engineering and Design, 2016, 37(10): 2695-2699.
[14] Cao Z, Wei F, Li S, et al. Learning summary prior representation for extractive summarization[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China, 2015: 829-833.
[15] Nallapati R, Zhai F, Zhou B. SummaRuNNer: a recurrent neural network based sequence model for extractive summarization of documents[C]//Proceedings of the 31st AAAI Conference on Artificial Intelligence. Menlo Park, CA: AAAI, 2017: 3075-3081.
[16] He R, Lee W S, Ng H T, et al. An unsupervised neural attention model for aspect extraction[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, Canada, 2017: 388-397.
[17] 余珊珊, 苏锦钿, 李鹏飞. 基于改进的TextRank的自动摘要提取方法[J]. 计算机科学, 2016, 43(6): 240-247. Yu S S, Su J D, Li P F. Improved TextRank-based method for automatic summarization[J]. Computer Science, 2016, 43(6): 240-247. (in Chinese)
[18] 第一财经——汽车[EB/OL].[2020-10-26]. https://www.yicai.com/news/automobile/.
[19] 徐馨韬, 柴小丽, 谢彬, 等. 基于改进TextRank算法的中文文本摘要提取[J]. 计算机工程, 2019, 45(3): 273-277. Xu X T, Chai X L, Xie B, et al. Extraction of Chinese text summarization based on improved TextRank algorithm[J]. Computer Engineering, 2019, 45(3): 273-277. (in Chinese)

News Summarization Extracting Method Based on Improved MMR Algorithm

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 13

Recommended Articles

Metrics

Comments

[1]	CAO Guogang, LI Mengxue, CHEN Ying, CAO Cong, WANG Ziyi, FANG Meng, GAO Chunfang, LIU Yunxiang. Classification Method of Improved Support Vector Machine and Its Application in Early Detection of Primary Liver Cancer [J]. Journal of Applied Sciences, 2021, 39(3): 481-480.
[2]	FAN Shurui, JIA Yating, LIU Jinghua. Feature Selection of Human Activity Recognition Based on Tri-axial Accelerometer [J]. Journal of Applied Sciences, 2019, 37(3): 427-436.
[3]	SU Wen-xuan, FANG Zhen. Identifying Image Authenticity Based on CFA Inconsistency of Interpolation Characteristics [J]. Journal of Applied Sciences, 2019, 37(1): 33-40.
[4]	XU Zhong-xiong, SHAO Gui-wei, XIE Yu-xing, WU Liang, JI Zheng. Method of UAV Autonomous Positioning Based on Encoded Sign during Power Inspection [J]. Journal of Applied Sciences, 2018, 36(5): 845-858.
[5]	FENG Fa-jie, LI Jun-ping, DING Ya-zhou, ZHU Kun, CUI Wei-hong. Target Detection from High Resolution Remote Sensing Images Based on Combination of Multi-scale Visual Features [J]. Journal of Applied Sciences, 2018, 36(3): 471-484.
[6]	ZHAI Xu-ping, MENG Tian, WANG Tao. SVM Spectrum Sensing Based on Data Pre-processing with Log Function [J]. Journal of Applied Sciences, 2017, 35(6): 726-734.
[7]	YANG Jin-sheng, LIN Zhen-jun. Modified Support Vector Machine for Wireless Localization [J]. Journal of Applied Sciences, 2017, 35(6): 685-692.
[8]	XIONG Bang-shu, LIU Yu, MO Yan, HUANG Jian-ping, LI Xin-min. Recognition of Helicopter Flight Condition Based onSupport Vector Machine [J]. Journal of Applied Sciences, 2016, 34(4): 469-474.
[9]	HU Zhao-hua, XU Yu-wei, ZHAO Xiao-lei, HE Jun, ZHOU You. Multi-feature Selection Tracking Based on Support Vector Machine [J]. Journal of Applied Sciences, 2015, 33(5): 502-517.
[10]	YANG Hong-tao, GENG Jin-hua, DING Xiao-rui, YU Cao-feng, YU Bing. Force-Geometric Error Modeling of CNC Machine Tools Using PSO-SVM [J]. Journal of Applied Sciences, 2014, 32(3): 325-330.
[11]	FU Zhong-liang, ZHANG Wen-yuan, MENG Qing-xiang. SAR Image Classification Based on SVM with Fusion of Gray Scale and Texture Features [J]. Journal of Applied Sciences, 2012, 30(5): 498-504.
[12]	DING Meng1, CAO Yun-feng1;2, WU Qing-xian1. Crater Detection from Gray Image of the Moon Surface [J]. Journal of Applied Sciences, 2009, 27(2): 156-160.
[13]	MENG Wei;WANG Fei-fei;PENG Xin-jun;SHEN Chen-yi;WANG Yi-fei. Prediction of Protein-Protein Interaction Sites Using Support Vector Machine [J]. Journal of Applied Sciences, 2008, 26(4): 403-0403 .