Affiliation:
1. Guangzhou Institute of Technology Xidian University, China
2. Knight Foundation School of Computing and Information Sciences Florida International University, United States
3. School of Computer Science and Technology Xidian University, China
4. Department of Electrical and Computer Engineering Auburn University, United States
5. Hangzhou Institute of Technology Xidian University, China
Abstract
Recently, wireless sensing techniques have been widely used for Internet of Things (IoT) applications. Unlike traditional device-based sensing, wireless sensing is contactless, pervasive, low-cost, and non-invasive, making it highly suitable for relevant IoT applications. However, most existing methods are highly dependent on high-quality datasets, and the minority class will not achieve a satisfactory performance when suffering from a class imbalance problem. In this paper, we propose a time-frequency semantic generative adversarial network (GAN) framework (i.e., TFSemantic) to address the imbalanced classification problem in human activity recognition (HAR) using radio frequency (RF) signals. Specifically, the TFSemantic framework can learn semantic features from the minority classes and then generate high-quality signals to restore data balance. It includes a data pre-processing module, a semantic extraction module, a semantic distribution module, and a data augmenter module. In the data pre-processing module, we process four different RF datasets (i.e., WiFi, RFID, UWB, and mmWave). We also develop Fourier semantic feature convolution (SFC) and attention semantic feature embedding (SFE) methods for the semantic extraction module. A discrete wavelet transform (DWT) is utilized for reconstructed RF samples in the semantic distribution module. In data augmenter module, we design an associated loss function to achieve effective adversarial training. Finally, we validate the effectiveness of the proposed TFSemantic framework using different RF datasets, which outperforms several state-of-the-art methods.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications
Reference55 articles.
1. Harshit Ambalkar , Xuyu Wang , and Shiwen Mao . 2021 . Adversarial human activity recognition using Wi-Fi CSI . In 2021 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE). Virtual Conference, 1–5. Harshit Ambalkar, Xuyu Wang, and Shiwen Mao. 2021. Adversarial human activity recognition using Wi-Fi CSI. In 2021 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE). Virtual Conference, 1–5.
2. Guided search for hybrid systems based on coarse-grained space abstractions;Bogomolov Sergiy;Springer Int. J. Software Tools for Technology Transfer,2016
3. Konstantinos Bousmalis George Trigeorgis Nathan Silberman Dilip Krishnan and Dumitru Erhan. 2016. Domain separation networks. In Advances in Neural Information Processing Systems D. Lee M. Sugiyama U. Luxburg I. Guyon and R. Garnett (Eds.) Vol. 29. HBarcelona SPAIN. Konstantinos Bousmalis George Trigeorgis Nathan Silberman Dilip Krishnan and Dumitru Erhan. 2016. Domain separation networks. In Advances in Neural Information Processing Systems D. Lee M. Sugiyama U. Luxburg I. Guyon and R. Garnett (Eds.) Vol. 29. HBarcelona SPAIN.
4. Respiratory biofeedback using acoustic sensing with smartphones;Chara Azhar;Smart Health,2023
5. RF-Based Human Activity Recognition Using Signal Adapted Convolutional Neural Network