Presentation 2014-12-16
Speaker adaptation using speaker-normalized DNN based on speaker codes
Yosuke KASHIWAGI, Daisuke SAITO, Nobuaki MINEMATSU, Keikichi HIROSE,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Recently, deep neural network (DNN) becomes one of the main streams of acoustic modeling for automatic speech recognition. Further, speaker adaptation techniques have been tested for DNN-based speech recognition, including one based on a framework of bias adaptation using speaker codes. This paper introduces speaker-normalized training to this framework and experimentally shows its effectiveness. In the conventional method using speaker codes, two kinds of networks of speaker-independent (SI) DNNs and subnetworks for speaker adaptation were trained sequentially. We expect that, by training the SI networks and the subnetworks simultaneously, this method can be tuned so that it can handle both SI information and speaker-dependent (SD) information more adequately. Further, different from the conventional method, the speaker code vector is generated through networks from a 1-of-N speaker representation. This will reduce the training cost of the SI models and the subnetworks and avoid the over-fitting problem. Experimental evaluations using the TIMIT database demonstrate that our proposed training method can reduce the phoneme error rate by 5.7% relative.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) automatic speech recognition / acoustic model / speaker adaptation / speaker normalized training / deep neural network
Paper # SP2014-118
Date of Issue

Conference Information
Committee SP
Conference Date 2014/12/8(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Speech (SP)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Speaker adaptation using speaker-normalized DNN based on speaker codes
Sub Title (in English)
Keyword(1) automatic speech recognition
Keyword(2) acoustic model
Keyword(3) speaker adaptation
Keyword(4) speaker normalized training
Keyword(5) deep neural network
1st Author's Name Yosuke KASHIWAGI
1st Author's Affiliation The University of Tokyo()
2nd Author's Name Daisuke SAITO
2nd Author's Affiliation The University of Tokyo
3rd Author's Name Nobuaki MINEMATSU
3rd Author's Affiliation The University of Tokyo
4th Author's Name Keikichi HIROSE
4th Author's Affiliation The University of Tokyo
Date 2014-12-16
Paper # SP2014-118
Volume (vol) vol.114
Number (no) 365
Page pp.pp.-
#Pages 6
Date of Issue