Affiliation:
1. Georgia Institute of Technology, USA
2. KDDI Research, Japan
Abstract
Smart home environments are designed to provide services that help improve the quality of life for the occupant via a variety of sensors and actuators installed throughout the space. Many automated actions taken by a smart home are governed by the output of an underlying activity recognition system. However, activity recognition systems may not be perfectly accurate, and therefore inconsistencies in smart home operations can lead users reliant on smart home predictions to wonder “Why did the smart home do that?” In this work, we build on insights from Explainable Artificial Intelligence (XAI) techniques and introduce an explainable activity recognition framework in which we leverage leading XAI methods (Local Interpretable Model-agnostic Explanations, SHapley Additive exPlanations (SHAP), Anchors) to generate natural language explanations that explain what about an activity led to the given classification. We evaluate our framework in the context of a commonly targeted smart home scenario: autonomous remote caregiver monitoring for individuals who are living alone or need assistance. Within the context of remote caregiver monitoring, we perform a two-step evaluation: (a) utilize Machine Learning experts to assess the sensibility of explanations and (b) recruit non-experts in two user remote caregiver monitoring scenarios, synchronous and asynchronous, to assess the effectiveness of explanations generated via our framework. Our results show that the XAI approach, SHAP, has a 92% success rate in generating sensible explanations. Moreover, in 83% of sampled scenarios users preferred natural language explanations over a simple activity label, underscoring the need for explainable activity recognition systems. Finally, we show that explanations generated by some XAI methods can lead users to lose confidence in the accuracy of the underlying activity recognition model, while others lead users to gain confidence. Taking all studied factors into consideration, we make a recommendation regarding which existing XAI method leads to the best performance in the domain of smart home automation and discuss a range of topics for future work to further improve explainable activity recognition.
Funder
KDDI Research
NSF Graduate Research Fellowship
Publisher
Association for Computing Machinery (ACM)
Subject
Artificial Intelligence,Human-Computer Interaction
Reference82 articles.
1. Trends and Trajectories for Explainable, Accountable and Intelligible Systems
2. Gregory D. Abowd, Aaron F. Bobick, Irfan A. Essa, Elizabeth D. Mynatt, and Wendy A. Rogers. 2002. The aware home: A living laboratory for technologies for successful aging. In Proceedings of the AAAI-02 Workshop “Automation as Caregiver.” 1–7.
3. Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
4. Activity recognition in sensor data streams for active and assisted living environments;Machot Fadi Al;IEEE Trans. Circ. Syst. Vid. Technol.,2017
5. Iftikhar Alam, Shah Khusro, and Muhammad Naeem. 2017. A review of smart TV: Past, present, and future. In Proceedings of the International Conference on Open Source Systems & Technologies (ICOSST’17). IEEE, 35–41.
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献