A Novel Approach to Automated Behavioral Diagram Assessment using Label Similarity and Subgraph Edit Distance

Abstract

Unified Modelling Language (UML) is one of the standard languages used in modelling software. Therefore, UML is widely taught in many universities. Generally, teachers assign students to build UML diagram designs based on a predetermined project. However, the assessment of such assignments can be challenging and teachers may be inconsistent in assessing students’ answers. Thus, automated UML diagram assessment becomes essential to maintaining assessment consistency. This study uses a behavioral diagram as the object of research since it is a commonly taught UML diagram. The behavioral diagram can show a dynamic view of the software. This study proposes a new approach to automatically assessing the similarity of behaviour diagrams as reliably as experts. We divide the assessment into two portions: semantic assessment and structural assessment. Label similarity is used to calculate semantic assessment, while subgraph edit distance is used to calculate structural assessment. The results suggest that the proposed approach is as reliable as an expert in assessing the similarity between two behaviour diagrams. The observed agreement value suggests strong agreement between the use of experts and the proposed approach.