Time Aware F-Score for Cybersecurity Early Detection Evaluation
-
Published:2024-01-09
Issue:2
Volume:14
Page:574
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
López-Vizcaíno Manuel1ORCID, Nóvoa Francisco J.1ORCID, Fernández Diego1ORCID, Cacheda Fidel1ORCID
Affiliation:
1. Center for Information and Communications Technologies Research (CITIC), Department of Computer Science and Information Technologies, University of A Coruña, 15071 A Coruña, Spain
Abstract
With the increase in the use of Internet interconnected systems, security has become of utmost importance. One key element to guarantee an adequate level of security is being able to detect the threat as soon as possible, decreasing the risk of consequences derived from those actions. In this paper, a new metric for early detection system evaluation that takes into account the delay in detection is defined. Time aware F-score (TaF) takes into account the number of items or individual elements processed to determine if an element is an anomaly or if it is not relevant to be detected. These results are validated by means of a dual approach to cybersecurity, Operative System (OS) scan attack as part of systems and network security and the detection of depression in social media networks as part of the protection of users. Also, different approaches, oriented towards studying the impact of single item selection, are applied to final decisions. This study allows to establish that nitems selection method is usually the best option for early detection systems. TaF metric provides, as well, an adequate alternative for time sensitive detection evaluation.
Funder
Ministry of Economy and Competitiveness of Spain Xunta de Galicia and the European Union
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference26 articles.
1. Losada, D.E., and Crestani, F. (2016). Experimental IR Meets Multilinguality, Multimodality, and Interaction, Springer. 2. Mirsky, Y., Doitshman, T., Elovici, Y., and Shabtai, A. (2018, January 18–21). Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detection. Proceedings of the Network and Distributed Systems Security (NDSS) Symposium 2018, San Diego, CA, USA. 3. Measuring Early Detection of Anomalies;Novoa;IEEE Access,2022 4. Losada, D.E., Crestani, F., and Parapar, J. (2020). Advances in Information Retrieval, Springer International Publishing. 5. Sadeque, F., Xu, D., and Bethard, S. (2018, January 5–9). Measuring the latency of depression detection in social media. Proceedings of the WSDM 2018—11th ACM International Conference on Web Search and Data Mining, Marina Del Rey, CA, USA.
|
|