PCG/PCGML evaluations: Introducing panda evaluation using the soft launch

Abstract

This study takes a new perspective on the procedural content generation (PCG) evaluation problem, extracts current PCG evaluation methods from previous works, and presents a novel classification of these methods while showing each method’s capabilities. Also, the present study introduces a novel concept called Panda Evaluation. Additionally, the soft and hard launches were presented as two evaluation methods and possible building blocks of PE. A group of papers was analyzed to understand previous works and find new opportunities. In doing so, some missing PCG evaluation areas were found, and some new methods were proposed for future PCG evaluations. To the best of our knowledge, this is the first time these concepts have been presented in PCG evaluation.