Multi-Channel Audio Completion Algorithm Based on Tensor Nuclear Norm

Author:

Zhu Lin12,Yang Lidong12ORCID,Guo Yong3,Niu Dawei1,Zhang Dandan1

Affiliation:

1. School of Digital and Intelligence Industry, Inner Mongolia University of Science and Technology, 7 Ardin Street, Baotou 014010, China

2. Inner Mongolia Key Laboratory of Pattern Recognition and Intelligent Image Processing, 7 Ardin Street, Baotou 014010, China

3. School of Science, Inner Mongolia University of Science and Technology, 7 Ardin Street, Baotou 014010, China

Abstract

Multi-channel audio signals provide a better auditory sensation to the audience. However, missing data may occur in the collection, transmission, compression, or other processes of audio signals, resulting in audio quality degradation and affecting the auditory experience. As a result, the completeness of the audio signal has become a popular research topic in the field of signal processing. In this paper, the tensor nuclear norm is introduced into the audio signal completion algorithm, and the multi-channel audio signals with missing data are restored by using the completion algorithm based on the tensor nuclear norm. First of all, the multi-channel audio signals are preprocessed and are then transformed from the time domain to the frequency domain. Afterwards, the multi-channel audio with missing data is modeled to construct a third-order multi-channel audio tensor. In the next part, the tensor completion algorithm is used to complete the third-order tensor. The optimal solution of the convex optimization model of the tensor completion is obtained by using the convex relaxation technique and, ultimately, the data recovery of the multi-channel audio with data loss is accomplished. The experimental results of the tensor completion algorithm and the traditional matrix completion algorithm are compared using both objective and subjective indicators. The final result shows that the high-order tensor completion algorithm has a better completion ability and can restore the audio signal better.

Funder

National Natural Science Foundation of China

Publisher

MDPI AG

Reference30 articles.

1. Dolby Atmos, DTS:X, Multiroom Come to More Soundbars;Palenchar;TWICE,2017

2. Change from simple to Complex 20 Years of History of Audio-visual technology (Multi-Channel Technology);Deng;Home Theater Tech.,2017

3. Audio Inpainting;Adler;IEEE Trans. Audio Speech Lang. Process.,2012

4. Low Rank Tensor Completion for Recovering Missing Data in Multi-channel Audio Signal;Yang;J. Electron. Inf. Technol.,2016

5. Adler, A., Emiya, V., Jafari, M.G., Elad, M., Gribonval, R., and Plumbley, M.D. (2011, January 22–27). A Constrained Matching Pursuit Approach to Audio Declipping. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Prague, Czech Republic.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3