Abstract
AbstractTechnological Advances in Artificial Intelligence (AI) have Brought forth the Potential for Models to Assist in Academic Writing. However, Concerns Regarding the Accuracy, Reliability, and Impact of AI in Academic Writing have been Raised. This Study Examined the Capabilities of GPT-4, a state-of-the-art AI Language Model, in Writing an American Psychological Association (APA)-style School Psychology Paper. Specifically, we Examined GPT-4’s Ability to Provide Citations and Substantiate Claims, Offer Factually Correct Information, and Generate Accurate APA (7th Edition; 2020) Style Citations and Referencing. The Results Reveal Limitations in GPT-4’s Performance, Including a lack of Proper Citations and Substantiation, Errors in Citations and Referencing, and the need for External Validation of Factual Accuracy. While GPT-4 Shows Potential, Further Refinement is Necessary to Enhance its Accuracy, Reliability, and Adherence to APA (2020) Guidelines. Future Research should Focus on Improving the Capabilities of AI Models for Scientific Writing and Developing Clear Policies for Their use in Academia.
Publisher
Springer Science and Business Media LLC
Reference29 articles.
1. Agarwal, V., Thureja, N., Garg, M. K., Dharmavaram, S., & Kumar, D. (2024). Which LLM should I use? Evaluating LLMs for tasks performed by Undergraduate Computer Science Students in India. arXiv preprint arXiv:2402.01687.
2. Alkaissi, H., & McFarlane, S. I. (2023). Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus, 15(2). https://doi.org/10.7759/cureus.35179
3. American Psychological Association (2020). Publication manual of the American Psychological Association (7th ed.). https://doi.org/10.1037/0000165-000
4. Arif, T. B., Munaf, U., & Ul-Haque, I. (2023). The future of medical education and research: Is ChatGPT a blessing or blight in disguise? Medical Education Online, 28(1). https://doi.org/10.1080/10872981.2023.2181052
5. Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., & Lundberg, S. (2023). Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712. https://arxiv.org/abs/2303.12712.