Author:
Doxolodeo Kerenza,Krisnadhi Adila Alfa
Abstract
AbstractConstructing a question-answering dataset can be prohibitively expensive, making it difficult for researchers to make one for an under-resourced language, such as Indonesian. We create a novel Indonesian Question Answering dataset that is produced automatically end-to-end. The process uses Context Free Grammar, the Wikipedia Indonesian Corpus, and the concept of the proxy model. The dataset consists of 134 thousand simple questions and 60 thousand complex questions. It achieved competitive grammatical and model accuracy compared to the translated dataset but suffers from some issues due to resource constraints.
Publisher
Springer Science and Business Media LLC
Reference21 articles.
1. Carrino, C. P., Costa-jussà, M. R., & Fonollosa, J. A. R. (2020). Automatic spanish translation of squad dataset for multi-lingual question answering. In N. Calzolari, F. Béchet, & P. Blache, et al (Eds.), Proceedings of the 12th language resources and evaluation conference, LREC 2020, May 11–16, 2020 (pp. 5515–5523). European Language Resources Association. https://aclanthology.org/2020.lrec-1.677/
2. Clark, J. H., Palomaki, J., Nikolaev, V., et al. (2020). Tydi QA: A benchmark for information-seeking question answering in typologically diverse languages. Transactions of the Association for Computational Linguistics, 8, 454–470. https://doi.org/10.1162/tacl_a_00317
3. Devlin, J., Chang, M., & Lee, K. et al. (2019). BERT: pre-training of deep bidirectional transformers for language understanding. In J. Burstein, C. Doran, & T. Solorio (Eds.), Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: Human language technologies, NAACL-HLT 2019, June 2–7, 2019 (Vol. 1, (Long and Short Papers), pp. 4171–4186). Association for Computational Linguistics. https://doi.org/10.18653/v1/n19-1423
4. Dubey, M., Banerjee, D., & Abdelkawi, A. et al (2019). Lc-quad 2.0: A large dataset for complex question answering over wikidata and dbpedia. In: Ghidini C, Hartig O, Maleshkova M, et al. (Eds.), The semantic web—ISWC 2019—18th international semantic web conference, October 26–30, 2019, Proceedings, Part II, Lecture Notes in Computer Science (Vol. 11779, pp. 69–78). Springer. https://doi.org/10.1007/978-3-030-30796-7_5
5. Eyal, M., Baumel, T., & Elhadad, M. (2019). Question answering as an automatic evaluation metric for news article summarization. In J. Burstein, C. Doran, & T. Solorio (Eds.), Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: Human language technologies, NAACL-HLT 2019 June 2–7, 2019 (Vol. 1 (Long and Short Papers), pp. 3938–3948). Association for Computational Linguistics. https://doi.org/10.18653/v1/n19-1395