Two Birds With One Stone: Writing a Paper Entitled “ChatGPT as a Tool for Studying Human-AI Interaction in the Wild” with ChatGPT

Abstract

Few advancements in Artificial Intelligence (AI) have seemed to be quite as captivating for the public as was the release of ChatGPT by OpenAI. This chatbot has been able to provide remarkably accurate answers to factual questions, write workable code in a variety of programming languages, and generate human-like text passages on any number of topics. Because, at the time of writing, this technology is so new, there is a need to understand the capabilities and limitations of the system. This includes understanding the nature of collaborative and iterative writing. This paper reviews an attempt to write a conference proceedings paper on the ways in which to use ChatGPT to study human-AI interaction. Evaluation of output and the iterative processes required shows the strengths of ChatGPT’s context awareness, while highlighting its limitations in attempts to provide academic references. Additionally, metrics of passage similarity to prior passages is assessed.