Generating 3D Visual Language Editors: Encapsulating Interaction Techniques in Visual Patterns

Abstract

The implementation of three-dimensional visual languages requires a wide range of conceptual and technical knowledge on issues for 3D graphics and textual language processing. Our generator framework DEViL3D incorporates such knowledge and supports the design of visual 3D languages and their implementation from high-level specifications. Such 3D languages arise from different modeling domains that make use of three-dimensional representations, e.g. the "ball-and-stick" models of molecules. The front-end of a 3D language implementation is a dedicated 3D graphical structure editor, which offers interaction and navigation techniques to construct programs in their domain. These techniques allow to manipulate the 3D program directly using operations to insert, move, and restructure objects. We have developed canned solutions for all such techniques that are encapsulated in visual patterns, which are provided by our generator. The designer of a particular 3D language only has to apply visual patterns to constructs of the abstract syntax, which defines the basic structure of the language. We have complemented our development with a usability study. Participants had to solve several tasks with different interaction or navigation techniques. Furthermore, we equipped the 3D editors with the opportunity to let users gain an immersive 3D perception by using stereoscopic hardware.