Codeguard: Utilizing Advanced Pattern Recognition in Language Models for Software Vulnerability Analysis-Reference-Cited by-同舟云学术

Codeguard: Utilizing Advanced Pattern Recognition in Language Models for Software Vulnerability Analysis

Published:2024-02-28 Issue:1 Volume:29 Page:108-118
ISSN:2247-840X
Container-title:Land Forces Academy Review
language:en
Short-container-title:

Author:

Jones Rebet¹,Omar Marwan²

Affiliation:

1. Capitol Technology University , Maryland , USA

2. Capitol Technology University , Maryland, USA & Illinois Institute of Technology , Chicago , USA

Abstract

Abstract Enhancing software quality and security hinges on the effective identification of vulnerabilities in source code. This paper presents a novel approach that combines pattern recognition training with cloze-style examination techniques in a semi-supervised learning framework. Our methodology involves training a language model using the SARD and Devign datasets, which contain numerous examples of vulnerable code. During training, specific code sections are deliberately obscured, challenging the model to predict the hidden tokens. Through rigorous empirical testing, we demonstrate the effectiveness of our approach in accurately identifying code vulnerabilities. Our results highlight the significant advantages of employing pattern recognition training alongside cloze-style questioning, leading to improved accuracy in detecting vulnerabilities in source code.

Publisher

Walter de Gruyter GmbH

Link

https://www.sciendo.com/pdf/10.2478/raft-2024-0011

Reference25 articles.

1. Alharbi, A.R., Hijji, M., & Aljaedi, A. (2021). Enhancing topic clustering for Arabic security news based on k-means and topic modelling. IET Networks, Vol. 10, Issue 6, 278–294. Available at: https://doi.org/10.1049/ntw2.12017.

2. Aluru, S.S., Mathew, B., Saha, P., & Mukherjee, A. (2020). Deep Learning Models for Multilingual Hate Speech Detection. arXiv preprint arXiv:2004.06465, available at: https://doi.org/10.48550/arXiv.2004.06465.

3. Ayub, M.F., Li, X., Mahmood, K., Shamshad, S., Saleem, M.A., & Omar, M. (2023). Secure Consumer-Centric Demand Response Management in Resilient Smart Grid as Industry 5.0 Application with Blockchain-Based Authentication. IEEE Transactions on Consumer Electronics. Available at: http://dx.doi.org/10.1109/tce.2023.3320974.

4. Chakraborty, S., Krishna, R., Ding, Y., & Ray, B. (2021). Deep Learning Based Vulnerability Detection: Are We There Yet? IEEE Transactions on Software Engineering, Vol. 48, Issue 9, 3280–3296. DOI: 10.1109/TSE.2021.3087402.

5. Cheng, X., Wang, H., Hua, J., Xu, G., & Sui, Y. (2021). DeepWukong: Statically Detecting Software Vulnerabilities Using Deep Graph Neural Network. ACM Transactions on Software Engineering and Methodology (TOSEM), Vol. 30, Issue 3, 1–33. Available at: https://doi.org/10.1145/3436877.