NewsCom-TOX: a corpus of comments on news articles annotated for toxicity in Spanish-Reference-Cited by-同舟云学术

NewsCom-TOX: a corpus of comments on news articles annotated for toxicity in Spanish

Published:2024-01-17 Issue: Volume: Page:
ISSN:1574-020X
Container-title:Language Resources and Evaluation
language:en
Short-container-title:Lang Resources & Evaluation

Author:

Taulé Mariona^ORCID,Nofre Montserrat,Bargiela Víctor,Bonet Xavier

Abstract

AbstractIn this article, we present the NewsCom-TOX corpus, a new corpus manually annotated for toxicity in Spanish. NewsCom-TOX consists of 4359 comments in Spanish posted in response to 21 news articles on social media related to immigration, in order to analyse and identify messages with racial and xenophobic content. This corpus is multi-level annotated with different binary linguistic categories -stance, target, stereotype, sarcasm, mockery, insult, improper language, aggressiveness and intolerance- taking into account not only the information conveyed in each comment, but also the whole discourse thread in which the comment occurs, as well as the information conveyed in the news article, including their images. These categories allow us to identify the presence of toxicity and its intensity, that is, the level of toxicity of each comment. All this information is available for research purposes upon request. Here we describe the NewsCom-TOX corpus, the annotation tagset used, the criteria applied and the annotation process carried out, including the inter-annotator agreement tests conducted. A quantitative analysis of the results obtained is also provided. NewsCom-TOX is a linguistic resource that will be valuable for both linguistic and computational research in Spanish in NLP tasks for the detection of toxic information.

Funder

Compagnia di San Paolo

agència de gestió d’ajuts universitaris i de recerca

Ministerio de Ciencia e Innovación

Universitat de Barcelona

Publisher

Springer Science and Business Media LLC

Link

https://link.springer.com/content/pdf/10.1007/s10579-023-09711-x.pdf

Reference55 articles.

1. Abercrombie, G., Basile, V., Tonelli, S., Rieser, V., & Uma, A. (2022). (eds) Proceedings of the 1st Workshop on Perspectivist Approaches to NLP @LREC2022, European Language Resources Association, Marseille, France,https://aclanthology.org/2022.nlperspectives-1.0.

2. Akhtar, S., Basile, V., & Patti, V. (2021). Whose opinions matter? perspective-aware models to identify opinions of hate speech victims in abusive language detection. arXiv preprintarXiv:2106.15896.

3. Allport, G. (1954). The nature of prejudice. Doubleday.

4. Álvarez-Carmona, MÁ., Guzmán-Falcón, E., Montes-Gómez, M., Escalante, H. J., Villasenor-Pineda, L., Reyes-Meza, V., & Rico-Sulayes, A. (2018). Overview of mex-a3t at ibereval 2018: Authorship and aggressiveness analysis in mexican spanish tweets. In: Notebook papers of 3rd SEPLN workshop on Evaluation of human language technologies for Iberian languages (IberEVAL), Seville, Spain, vol 6.

5. Aragón, M. E., Jarquín-Vásquez, H. J., Montes-Gómez, M., Escalante, H.J., Pineda, L.V., Gómez-Adorno, H., Posadas-Durán, J.P., & Bel-Enguix, G. (2020). Overview of mex-a3t at iberlef 2020: Fake news and aggressiveness analysis in mexican spanish. In: IberLEF@ SEPLN, pp 222–235.