Optimal Transport-Embedded Neural Network for Fairness Transfer Problem
-
Published:2023-10-31
Issue:21
Volume:12
Page:4481
-
ISSN:2079-9292
-
Container-title:Electronics
-
language:en
-
Short-container-title:Electronics
Author:
Xiang Muchao1, Ling Zaixun1, Liu Qine2, Zhang Yaoxuan3
Affiliation:
1. State Grid Hubei Electric Power Research Institute, Wuhan 430077, China 2. State Grid Xiangyang Power Supply Company, Xiangyang 441000, China 3. School of Automation, Wuhan University of Technology, Wuhan 430070, China
Abstract
Research on neuromorphic computing has gained popularity in recent years. In particular, regularized embedded neural systems have been applied in several significant real-world situations, such as recommendation systems and transfer learning. This paper deals with the fairness transfer learning problem, which has been insufficiently explored. In fairness transfer settings, the source domain has limit-tagged training samples, which may lead to performance degradation in the target domain. To solve such problems, a linear data-augmentation-based optimal transport-embedded neural network is proposed in this paper. It can augment the source samples to make the distribution of the source domain balanced and can align the source and target distributions simultaneously. Moreover, the distribution of the augmented data by mixup is limited to a certain bound that can avoid the abnormal samples generated. The effectiveness of the proposed method has been demonstrated in several transfer learning tests, including regression and classification. In 1-shot and 3-shot classification tasks on the Office dataset, our method’s accuracy is 4.8 and 3.9% better, respectively, than the second-best model. Additionally, our model’s performance is about 2–3 percentage points superior to the second-best model in the OfficeHome dataset. It is simple yet effective, making it perfect for low-power edge AI applications.
Funder
State Grid Hubei Electric Power Co., Ltd.
Subject
Electrical and Electronic Engineering,Computer Networks and Communications,Hardware and Architecture,Signal Processing,Control and Systems Engineering
Reference33 articles.
1. Spatial contextual classification and prediction models for mining geospatial data;Shekhar;IEEE Trans. Multimed.,2002 2. Few-shot domain adaptation via mixup optimal transport;Xu;IEEE Trans. Image Process.,2022 3. Smooth depth contours characterize the underlying distribution;Kong;J. Multivar. Anal.,2010 4. Ni, R., Goldblum, M., Sharaf, A., Kong, K., and Goldstein, T. (2021, January 18–24). Data augmentation for meta-learning. Proceedings of the International Conference on Machine Learning. PMLR, Virtual. 5. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems 27 (NIPS 2014), Montreal, QC, Canada.
|
|