A SPEECH SYNTHESIZER USING FACIAL EMG SIGNALS

Author:

TSUJI TOSHIO1,BU NAN2,ARITA JUN1,OHGA MAKOTO3

Affiliation:

1. Department of Artificial Complex Systems Engineering, Hiroshima University, Higashi-Hiroshima 739-8527, Japan

2. National Institute of Advanced Industrial Science and Technology, Tosu 841-0052, Japan

3. Eastern Hiroshima Prefecture Industrial Research Institute, Fukuyama 721-0974, Japan

Abstract

This paper proposes a novel phoneme classification method using facial electromyography (EMG) signals. This method makes use of differential EMG signals between muscles for phoneme classification, which enables a speech synthesizer to be constructed using fewer electrodes. The EMG signal is derived as a differential between monopolar electrodes attached to two different muscles, unlike conventional methods in which the EMG signal is derived as a differential between bipolar electrodes attached to the same muscle. Frequency-based feature patterns are then extracted using a filter bank, and the phonemes are classified using a probabilistic neural network, called a reduced-dimensional log-linearized Gaussian mixture network (RD-LLGMN). Since RD-LLGMN merges feature extraction and pattern classification processes into a single network structure, a lower-dimensional feature set that is consistent with classification purposes can be extracted; consequently, classification performance can be improved. Experimental results indicate that the proposed method with a fewer number of electrodes can achieve a considerably high classification accuracy.

Publisher

World Scientific Pub Co Pte Lt

Subject

Computer Science Applications,Theoretical Computer Science,Software

Cited by 9 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Human–Machine Interfaces Based on Bioelectric Signals: A Narrative Review with a Novel System Proposal;IEEJ Transactions on Electrical and Electronic Engineering;2022-06-07

2. A speech recognition system based on electromyography for the rehabilitation of dysarthric patients: A Thai syllable study;Biocybernetics and Biomedical Engineering;2019-01

3. Efficient Logo Insertion Method for High-Resolution H.265/HEVC Compressed Video;Advances in Multimedia Information Processing – PCM 2017;2018

4. EMG-to-Speech: Direct Generation of Speech From Facial Electromyographic Signals;IEEE/ACM Transactions on Audio, Speech, and Language Processing;2017-12

5. EMG-Controlled Human-Robot Interfaces;Human Modelling for Bio-Inspired Robotics;2017

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3