Abstract
AbstractEnsuring the transparency of machine learning models is vital for their ethical application in various industries. There has been a concurrent trend of distributed machine learning designed to limit access to training data for privacy concerns. Such models, trained over horizontally or vertically partitioned data, present a challenge for explainable AI because the explaining party may have a biased view of background data or a partial view of the feature space. As a result, explanations obtained from different participants of distributed machine learning might not be consistent with one another, undermining trust in the product. This paper presents an Explainable Data Collaboration Framework based on a model-agnostic additive feature attribution algorithm (KernelSHAP) and Data Collaboration method of privacy-preserving distributed machine learning. In particular, we present three algorithms for different scenarios of explainability in Data Collaboration and verify their consistency with experiments on open-access datasets. Our results demonstrated a significant (by at least a factor of 1.75) decrease in feature attribution discrepancies among the users of distributed machine learning. The proposed method improves consistency among explanations obtained from different participants, which can enhance trust in the product and enable ethical application in various industries.
Funder
New Energy and Industrial Technology Development Organization
Japan Society for the Promotion of Science
Publisher
Springer Science and Business Media LLC
Reference31 articles.
1. Jobin A, Ienca M, Vayena E. The global landscape of ai ethics guidelines. Nat Mach Intelli. 2019;1(9):389–99.
2. Grant TD, Wischik DJ. Show us the data: privacy, explainability, and why the law can’t have both. Geo Wash L Rev. 2020;88:1350.
3. Chen H, Hussain SU, Boemer F, Stapf E, Sadeghi AR, Koushanfar F, Cammarota R. Developing privacy-preserving ai systems: the lessons learned. In: 2020 57th ACM/IEEE Design Automation Conference (DAC). IEEE; 2020. p. 1–4.
4. Cheng Y, Liu Y, Chen T, Yang Q. Federated learning for privacy-preserving ai. Commun ACM. 2020;63(12):33–6.
5. Imakura A, Sakurai T. Data collaboration analysis framework using centralization of individual intermediate representations for distributed data sets. ASCE-ASME J Risk Uncertain Eng Syst Part A Civil Eng. 2020;6(2):04020018.