Presentation 1997/10/17
A Study of Language Modeling using Stochastic Context Free Grammar with "Dependency Grammar"
Masanobu YAGINUMA, Masaharu KATOH, Akinori ITO, Masaki KOHDA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In this paper, we propose a language model using stochastic context free grammar (SCFG) for speech recognition. To train an SCFG, inside-outside (I/O) algorithm is used. We modified I/O algorithm to treat with dependency grammar. To express dependency grammar, two categories of word are introduced : functional words (particle, auxiliary, suffix, etc.) and content words (noun, verb, adjective, etc.). Using dependency grammar, training time is reduced from the cube of number of nonterminal symbols to the square of it. We carried out an experiment to compare the proposed method with two conventional methods : the trigram model and the original SCFG model. We obtained significant reduction of training time compared with the original SCFG. The perplexity of the proposed model was smaller than other two models. Furthermore, we researched initial values to reduce training time andimprove performance.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) language model / stochastic contextfree grammar / dependency grammar / inside-outside algorithm
Paper # NLC97-33
Date of Issue

Conference Information
Committee NLC
Conference Date 1997/10/17(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Natural Language Understanding and Models of Communication (NLC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) A Study of Language Modeling using Stochastic Context Free Grammar with "Dependency Grammar"
Sub Title (in English)
Keyword(1) language model
Keyword(2) stochastic contextfree grammar
Keyword(3) dependency grammar
Keyword(4) inside-outside algorithm
1st Author's Name Masanobu YAGINUMA
1st Author's Affiliation Faculty of Engineering, Yamagata University()
2nd Author's Name Masaharu KATOH
2nd Author's Affiliation Faculty of Engineering, Yamagata University
3rd Author's Name Akinori ITO
3rd Author's Affiliation Faculty of Engineering, Yamagata University
4th Author's Name Masaki KOHDA
4th Author's Affiliation Faculty of Engineering, Yamagata University
Date 1997/10/17
Paper # NLC97-33
Volume (vol) vol.97
Number (no) 330
Page pp.pp.-
#Pages 8
Date of Issue