Analyzing the Impact of a Structured LLM Workshop in Different Education Levels

Abstract

An observation on the current state of teaching large language models (LLMs) in education is made. The problem of lacking a structural approach is defined. A methodology is created in order to serve as the basis of a workshop in teaching students with different types of backgrounds the correct use of LLMs and their capabilities. A workshop plan is created; instructions and materials are presented. A practical experiment has been conducted by dividing students into teams and guiding them to create a small project. Different LLMs are used for the purposes of creating a fictional story, images relating to the story, and very simple HTML, JS, and CSS code. Participants are given requirements that consider the limitations of LLMs, and different approaches to creatively solving arising issues due to the requirements are observed. The students’ projects are hosted on the web, so that they can see the results of their work. They are given the opportunity to use them as motivation for their future development. A survey is created and distributed to all the participating students. The results are analyzed from different angles and conclusions are made on the effectiveness of the workshop in completing its goal of solving the defined problem.