Presentation 2017-03-01
Noisy speech reconstruction based on deep neural network with optical microphone
Tomoyuki Mizuno, Takahiro Fukumori, Masato Nakayama, Takanobu Nishiura,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Measuring distant-talking speech with high accuracy is important for detecting criminal activity. Various microphones such as the parabolic and shotgun microphones have been developed for measuring it. However, most of them have difficulty in extracting distant-talking speech at a target position if they are surrounded by noisy sound sources. Therefore, this study focuses on an optical microphone which uses a laser light for extracting the distant-talking speech. The optical microphone is realized by a laser doppler vibrometer. The sound quality of the optical microphone is especially degraded at higher frequencies because it utilizes an external diaphragm consisting of various materials as the vibrating papery object. In this study, we therefore propose a reconstruction method with a deep neural network that uses a complex spectrum as an input signal. Finally, we confirmed the effectiveness of the proposed system through an evaluation experiment.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Optical microphone / Speech reconstruction / Deep neural network / Laser doppler vibrometer / Complex spectrum
Paper # EA2016-84,SIP2016-139,SP2016-79
Date of Issue 2017-02-22 (EA, SIP, SP)

Conference Information
Committee SP / SIP / EA
Conference Date 2017/3/1(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Okinawa Industry Support Center
Topics (in Japanese) (See Japanese page)
Topics (in English) Speech, Engineering/Electro Acoustics, Signal Processing, and Related Topics
Chair Kazunori Mano(Shibaura Inst. of Tech.) / Makoto Nakashizuka(Chiba Inst. of Tech.) / Mitsunori Mizumachi(Kyushu Inst. of Tech.)
Vice Chair Hiroki Mori(Utsunomiya Univ.) / Masahiro Okuda(Univ. of Kitakyushu) / Shogo Muramatsu(Niigata Univ.) / Yoichi Haneda(Univ. of Electro-Comm.) / Suehiro Shimauchi(NTT)
Secretary Hiroki Mori(Kobe Univ.) / Masahiro Okuda(Shizuoka Univ.) / Shogo Muramatsu(Ritsumeikan Univ.) / Yoichi Haneda(Chiba Inst. of Tech.) / Suehiro Shimauchi(KDDI R&D Labs.)
Assistant Taichi Asami(NTT) / Kei Hashimoto(Nagoya Inst. of Tech.) / Osamu Watanabe(Takushoku Univ.) / Shigeto Takeoka(Shizuoka Inst. of Science and Tech.) / TREVINO Jorge(Tohoku Univ.)

Paper Information
Registration To Technical Committee on Speech / Technical Committee on Signal Processing / Technical Committee on Engineering Acoustics
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Noisy speech reconstruction based on deep neural network with optical microphone
Sub Title (in English)
Keyword(1) Optical microphone
Keyword(2) Speech reconstruction
Keyword(3) Deep neural network
Keyword(4) Laser doppler vibrometer
Keyword(5) Complex spectrum
1st Author's Name Tomoyuki Mizuno
1st Author's Affiliation Ritsumeikan University(Ritsumeikan Univ.)
2nd Author's Name Takahiro Fukumori
2nd Author's Affiliation Ritsumeikan University(Ritsumeikan Univ.)
3rd Author's Name Masato Nakayama
3rd Author's Affiliation Ritsumeikan University(Ritsumeikan Univ.)
4th Author's Name Takanobu Nishiura
4th Author's Affiliation Ritsumeikan University(Ritsumeikan Univ.)
Date 2017-03-01
Paper # EA2016-84,SIP2016-139,SP2016-79
Volume (vol) vol.116
Number (no) EA-475,SIP-476,SP-477
Page pp.pp.13-18(EA), pp.13-18(SIP), pp.13-18(SP),
#Pages 6
Date of Issue 2017-02-22 (EA, SIP, SP)