Abstractive text summarization of low-resourced languages using deep learning

Author:

Shafiq Nida1,Hamid Isma1,Asif Muhammad1,Nawaz Qamar2,Aljuaid Hanan3,Ali Hamid1

Affiliation:

1. Department of Computer Science, National Textile University, Faisalabad, Pakistan

2. Department of Computer Science, University of Agriculture Faisalabad, Faisalabad, Pakistan

3. Computer Sciences Department, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia

Abstract

Background Humans must be able to cope with the huge amounts of information produced by the information technology revolution. As a result, automatic text summarization is being employed in a range of industries to assist individuals in identifying the most important information. For text summarization, two approaches are mainly considered: text summarization by the extractive and abstractive methods. The extractive summarisation approach selects chunks of sentences like source documents, while the abstractive approach can generate a summary based on mined keywords. For low-resourced languages, e.g., Urdu, extractive summarization uses various models and algorithms. However, the study of abstractive summarization in Urdu is still a challenging task. Because there are so many literary works in Urdu, producing abstractive summaries demands extensive research. Methodology This article proposed a deep learning model for the Urdu language by using the Urdu 1 Million news dataset and compared its performance with the two widely used methods based on machine learning, such as support vector machine (SVM) and logistic regression (LR). The results show that the suggested deep learning model performs better than the other two approaches. The summaries produced by extractive summaries are processed using the encoder-decoder paradigm to create an abstractive summary. Results With the help of Urdu language specialists, the system-generated summaries were validated, showing the proposed model’s improvement and accuracy.

Funder

The Princess Nourah bint Abdulrahman University Researchers Supporting Project, Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia

Publisher

PeerJ

Subject

General Computer Science

Reference35 articles.

1. An abstractive arabic text summarizer with user controlled granularity;Azmi;Information Processing & Management,2018

2. Evaluation of different techniques for detection of virulence in Yersinia enterocolitica;Bhaduri;Journal of Clinical Microbiology,1990

3. A gentle introduction to bayes theorem for machine learning;Brownlee,2019

4. Urdu text summarizer using sentence weight algorithm for word processors;Burney;International Journal of Computer Applications,2012

5. Abstractive text-image summarization using multimodal attentional hierarchical RNN;Chen,2018

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3