Evaluating Crowdsourcing Applications with Map-Based Storytelling Capabilities in Cultural Heritage

Abstract

Crowdsourcing applications that integrate storytelling and geotagging capabilities offer new avenues for engaging the public in cultural heritage. However, standardised evaluation frameworks are lacking. This paper presents an applied evaluation methodology involving the analysis of relevant web-based tools. Towards this goal, this paper presents the development of crowdsourcing applications using, as a case study, the collection of myths and legends associated with the monumental heritage site of the Palace of the Grand Master of the Knights of Rhodes in Greece. Additionally, the paper presents an evaluation conducted through a criteria-based approach and user-based survey. The study reviews the concepts of crowdsourcing and digital storytelling within digital heritage, along with current concepts of living heritage and folklore, and examines relevant initiatives. The evaluation follows a four-stage methodology: (i) initial web-based tool selection based on the minimum requirements of web compatibility, crowdsourced data display, and map-based storytelling capability; (ii) application development using the selected web-based tools; (iii) a five-criteria assessment, based on the factors of open access, usability/tool support, participatory content/story creation, metrics provision and metadata model usage; and (iv) a crowd-based survey, indicating the most effective option. Findings from 100 respondents reveal limited exposure to participatory storytelling applications but interest in contributing content. Social media and influential figures serve as key channels for promoting crowdsourcing open calls. The results highlight gaps in understanding user expectations and perceptions, suggesting future research for gaining insights into engagement rates.