Detecting Spam Product Reviews in Roman Urdu Script

Abstract

References In recent years, online customer reviews have become the main source to determine public opinion about offered products and services. Therefore, manufacturers and sellers are extremely concerned with customer reviews, as these can have a direct impact on their businesses. Unfortunately, there is an increasing trend to write spam reviews to promote or demote targeted products or services. This practice, known as review spamming, has posed many questions regarding the authenticity and dependability of customers’ review-based business processes. Although the spam review detection (SRD) problem has gained much attention from researchers, existing studies on SRD have mostly worked on datasets of English, Chinese, Arabic, Persian, and Malay languages. Therefore, the objective of this research is to identify the spam in Roman Urdu reviews using different classification models based on linguistic features and behavioral features. The performance of each classifier is evaluated in a number of perspectives: (i) linguistic features are used to calculate accuracy (F1 score) of each classifier; (ii) behavioral features combined with distributional and non-distributional aspects are used to evaluate accuracy (F1 score) of each classifier; and (iii) the combination of both linguistic and behavioral features (distributional and non-distributional aspects) are used to evaluate the accuracy of each classifier. The experimental evaluations demonstrated an improved accuracy (F1 score: 0.96), which is the result of combinations of linguistic features and behavioral features with the distributional aspect of reviewers. Moreover, behavioral features using distributional characteristic achieve an accuracy (F1 score: 0.86) and linguistic features shows accuracy (F1 score: 0.69). The outcome of this research can be used to increase customers’ confidence in the South Asian region. It can also help to reduce spam reviews in the South Asian region, particularly in Pakistan.