| Presentation | 2000/10/6 The algorithms for the acquisition of linguistic speech units based on integrating perceptual information KyeongJu Kim, Naoto Iwahashi, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This report describes a theory and algorithm for acquistion of words and speech segments, which compose a word, by integrating speech and image information. Main argument is how to acquire a hierarchical structure of speech units by using image information combined with speech. An information theoretical principle of learning algorithm based on maximum mutual information criteria is proposed as a solution to this argument. Speech segments, the word consisting of speech segments, and image concepts corresponding to each word are acquired simultaneously by applying proposed learning method. In the algorithm, speech segments, words, and dynamic image concepts (motions) are represented by Hidden Markov Models, and static image concepts are represented by multivariate mormal distribution. The number of these stochastic models and the values of model parameters are automatically determined. The utterances of isolated words and the images of stuffed toys are used for the learning data in experiments. The experimental results show that linguistic speech units and image concepts were adequately acquired. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | language acquistion / concept acquisition / hierarchical learning / mutual information / information integration |
| Paper # | TL2000-21 |
| Date of Issue |
| Conference Information | |
| Committee | TL |
|---|---|
| Conference Date | 2000/10/6(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Thought and Language (TL) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | The algorithms for the acquisition of linguistic speech units based on integrating perceptual information |
| Sub Title (in English) | |
| Keyword(1) | language acquistion |
| Keyword(2) | concept acquisition |
| Keyword(3) | hierarchical learning |
| Keyword(4) | mutual information |
| Keyword(5) | information integration |
| 1st Author's Name | KyeongJu Kim |
| 1st Author's Affiliation | Sony Computer Science Labs Inc. : Department of Electrical, Electronics and Computer Engineering, Waseda University() |
| 2nd Author's Name | Naoto Iwahashi |
| 2nd Author's Affiliation | Sony Computer Science Labs Inc. |
| Date | 2000/10/6 |
| Paper # | TL2000-21 |
| Volume (vol) | vol.100 |
| Number (no) | 336 |
| Page | pp.pp.- |
| #Pages | 8 |
| Date of Issue | |