Presentation 2009-07-14
On the Posterior Distribution of HMMs for a Long Sequence
Keisuke YAMAZAKI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Hidden Markov models (HMMs) are widely applied to analysis of time-dependent data sequences, such as non-linear signal processing, natural language processing, and bioinformatics. There are two possible formats of the training data in HMMs; One is a set of many time-dependent sequential data, and the other is an infinitely long sequence. The learning process is one of the main concerns in machine learning. For the former case, there is a method to reveal the generalization ability based on algebraic geometry. However, there is no theoretical analysis on the latter case. To construct its foundation, this paper reports some unique properties of the likelihood function in an experimental manner, and explains them in a theoretical manner. The results show that the likelihood function implicitly includes a local maxima factor, which can make the learning process slow, and that this slow learning realizes high performance in a stationary state evaluation.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Hidden Markov Models / Parameter Learning / Stationary Density
Paper # NLP2009-31,NC2009-24
Date of Issue

Conference Information
Committee NLP
Conference Date 2009/7/6(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Nonlinear Problems (NLP)
Language ENG
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) On the Posterior Distribution of HMMs for a Long Sequence
Sub Title (in English)
Keyword(1) Hidden Markov Models
Keyword(2) Parameter Learning
Keyword(3) Stationary Density
1st Author's Name Keisuke YAMAZAKI
1st Author's Affiliation P & I Laboratory, Tokyo Institute of Technology()
Date 2009-07-14
Paper # NLP2009-31,NC2009-24
Volume (vol) vol.109
Number (no) 124
Page pp.pp.-
#Pages 6
Date of Issue