Abstract
AbstractThis paper presents the SAGT Turkish–German code-switching treebank, and observations and annotation challenges we encountered during its development. The treebank consists of transcriptions of bilingual conversations annotated with several layers: language IDs, lemmas, POS tags, morphological features, and dependency relations. The annotations follow the Universal Dependencies annotation scheme and the conventions used in monolingual treebanks as much as possible. We present and discuss a number of issues that arise because of the need for consistent multilingual annotation within a single treebank, as well as the informal language, which is where code-switching is observed most. Besides proposing solutions to these issues, we present some observations about code-switching phenomena that are only possible to observe in a data set with rich linguistic annotation. The treebank was annotated with a focus on quality of annotations through an iterative process of detecting and correcting annotation errors. We also present quantitative measures for indication of annotation quality. The code-switching treebank created in this study is released to the public through Universal Dependencies repositories.
Funder
Deutsche Forschungsgemeinschaft
Universität Stuttgart
Publisher
Springer Science and Business Media LLC
Subject
Library and Information Sciences,Linguistics and Language,Education,Language and Linguistics
Reference57 articles.
1. Auer, P., & Wei, L. (2007). Handbook of multilingualism and multilingual communication (Vol. 5). Berlin: Walter de Gruyter.
2. Backus, A. D. (2009). Codeswitching as one piece of the puzzle of language change: the case of Turkish Yapmak. In L. Isurin, D. Winford, & K. de Bot (Eds.), Interdisciplinary approaches to codeswitching, number 41 in Studies in Bilingualism (pp. 307–336). Amsterdam: John Benjamins.
3. Belazi, H. M., Rubin, E. J., & Toribio, A. J. (1994). Code switching and X-bar theory: The functional head constraint. Linguistic Inquiry, 221–237.
4. Berzak, Y., Huang, Y., Barbu, A., Korhonen, A., & Katz, B. (2016). Anchoring and agreement in syntactic annotations. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, (pp. 2215–2224). Association for Computational Linguistics. https://doi.org/10.18653/v1/D16-1239.
5. Bhat, I., Bhat, R. A., Shrivastava, M., & Sharma, D. (2018). Universal Dependency parsing for Hindi-English code-switching. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, (Long Papers) (Vol. 1, pp. 987–998). Association for Computational Linguistics. https://doi.org/10.18653/v1/N18-1090.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献