Affiliation:
1. The Alan Turing Institute and University of Warwick
2. Humboldt University of Berlin
3. Amazon
4. Yale University
5. Northeastern University
6. Google
7. University of Virginia
Abstract
Abstract
We propose privacy-preserving protocols for computing linear regression models, in the setting where the training dataset is vertically distributed among several parties. Our main contribution is a hybrid multi-party computation protocol that combines Yao’s garbled circuits with tailored protocols for computing inner products. Like many machine learning tasks, building a linear regression model involves solving a system of linear equations. We conduct a comprehensive evaluation and comparison of different techniques for securely performing this task, including a new Conjugate Gradient Descent (CGD) algorithm. This algorithm is suitable for secure computation because it uses an efficient fixed-point representation of real numbers while maintaining accuracy and convergence rates comparable to what can be obtained with a classical solution using floating point numbers. Our technique improves on Nikolaenko et al.’s method for privacy-preserving ridge regression (S&P 2013), and can be used as a building block in other analyses. We implement a complete system and demonstrate that our approach is highly scalable, solving data analysis problems with one million records and one hundred features in less than one hour of total running time.
Cited by
82 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Concurrent vertical and horizontal federated learning with fuzzy cognitive maps;Future Generation Computer Systems;2025-01
2. Vertical Federated Learning Across Heterogeneous Regions for Industry 4.0;IEEE Transactions on Industrial Informatics;2024-08
3. Communication-Efficient Secure Logistic Regression;2024 IEEE 9th European Symposium on Security and Privacy (EuroS&P);2024-07-08
4. Privacy‐preserving distributed learning with chaotic maps;2024 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS);2024-05-23
5. Blind Federated Learning without initial model;Journal of Big Data;2024-04-23