Affiliation:
1. YILDIZ TEKNİK ÜNİVERSİTESİ
Abstract
In this paper, we present a design for an ensemble chatbot based on paraphrase detection. Our proposed chatbot is intended to assist companies in reducing the need for costly call center operations by providing a 24-hour service to customers seeking information about products or services. Our algorithm is designed to work effectively on small data sets, such as an existing FAQ, and does not require a large number of instances. We evaluated the performance of our chatbot using publicly available data from the websites of major telecommunication companies and found that the ensemble model improved success rates by 6% compared to the single best model, with a top 3 accuracy of 84.54% and a top 1 accuracy of 70.10%.
Publisher
Kocaeli Journal of Science and Engineering
Reference22 articles.
1. [1] AbuShawar B., Atwell E., 2015. ALICE chatbot: Trials and outputs. Computación y Sistemas, 19(4), pp. 625‒632. Instituto Politécnico Nacional, Centro de Investigación en Computación.
2. [2] Luo B., Lau R.Y.K., Li C., Si Y.W., 2022. A critical review of state-of-the-art chatbot designs and applications. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 12(1), pp. e1434. Wiley Online Library.
3. [3] Devlin J., Chang M.W., Lee K., Toutanova K., 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Paper presented at the North American Chapter of the Association for Computational Linguistics.
4. [4] Amer E., Hazem A., Farouk O., Louca A., Mohamed Y., Ashraf M., 2021. A proposed chatbot framework for COVID-19. Paper presented at the 2021 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC), IEEE, pp. 263-268.
5. [5] Rajpurkar P., Zhang J., Lopyrev K., Liang P., 2016. SQuAD: 100,000+ Questions for Machine Comprehension of Text. Paper presented at the Conference on Empirical Methods in Natural Language Processing.