Abstract
AbstractWith the growing use of temporal logics in areas ranging from robot planning to runtime verification, it is critical that users have a clear understanding of what a specification means. Toward this end, we have been developing a catalog of semantic errors and a suite of test instruments targeting various user-groups. The catalog is of interest to educators, to logic designers, to formula authors, and to tool builders, e.g., to identify mistakes. The test instruments are suitable for classroom teaching or self-study.This paper reports on five sets of survey data collected over a three-year span. We study misconceptions about finite-trace $$\textsc {ltl}_{f}$$
L
T
L
f
in three ltl-aware audiences, and misconceptions about standard ltl in novices. We find several mistakes, even among experts. In addition, the data supports several categories of errors in both $$\textsc {ltl}_{f}$$
L
T
L
f
and ltl that have not been identified in prior work. These findings, based on data from actual users, offer insights into what specific ways temporal logics are tricky and provide a groundwork for future interventions.
Publisher
Springer Nature Switzerland
Reference71 articles.
1. Almstrum, V.L., et al.: Concept inventories in computer science for the topic discrete mathematics. ACM SIGCSE Bull. 38(4), 132–145 (2006). https://doi.org/10.1145/1189136.1189182
2. Alur, R., Bansal, S., Bastani, O., Jothimurugan, K.: A framework for transforming specifications in reinforcement learning. CoRR abs/2111.00272 (2021). https://arxiv.org/abs/2111.00272
3. Lecture Notes in Computer Science;G Amram,2021
4. Antoniotti, M., Mishra, B.: Discrete events models + temporal logic = supervisory controller: automatic synthesis of locomotion controllers. In: ICRA, pp. 1441–1446. IEEE (1995). https://doi.org/10.1109/ROBOT.1995.525480
5. Araki, B., Li, X., Vodrahalli, K., DeCastro, J.A., Fry, M.J., Rus, D.: The logical options framework. In: ICML, vol. 139, pp. 307–317. PMLR (2021). http://proceedings.mlr.press/v139/araki21a.html