| Presentation | 2004/11/11 Research of dialog-based communication based on facial image processing : Improvement of recognition algorithm by using mutual subspace method Natsuko Nishi, Mutsumi Watanabe, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The authors are developing a vision-based intension transfer system by recognizing user's face expressions and movements, to help free and convenient communications with aged or disabled persons who find difficulties in talking, discriminating small character prints and operating keyboards by hands and fingers. In this paper, introduces a prototype system, where layered daily conversations are successively selected by recognizing the transition in shape of user's mouth part using camera image settled in front of the user and correspondent synthetic speech is automatically broadcasted. The four mouth patterns are automatically recognized by using the mutual subspace method by analyzing the intensity histogram data around the mouth part region. The confirmation of selection result by the user is executed by detecting the open and shut movements of mouth though the temporal change in intensity histogram data. Experimental results of mouth pattern recognition by twenty persons have shown the effectiveness of the proposed method. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Human Interface / Multi-modal Conversation / Mouth Part Pattern Recognition / Intensity Histogram Analysis / Mutual Subspace Method / Computer Vision |
| Paper # | PRMU2004-100,HIP2004-40 |
| Date of Issue |
| Conference Information | |
| Committee | HIP |
|---|---|
| Conference Date | 2004/11/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Human Information Processing (HIP) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Research of dialog-based communication based on facial image processing : Improvement of recognition algorithm by using mutual subspace method |
| Sub Title (in English) | |
| Keyword(1) | Human Interface |
| Keyword(2) | Multi-modal Conversation |
| Keyword(3) | Mouth Part Pattern Recognition |
| Keyword(4) | Intensity Histogram Analysis |
| Keyword(5) | Mutual Subspace Method |
| Keyword(6) | Computer Vision |
| 1st Author's Name | Natsuko Nishi |
| 1st Author's Affiliation | Graduate School of Science and Engineering, Kagoshima University() |
| 2nd Author's Name | Mutsumi Watanabe |
| 2nd Author's Affiliation | Graduate School of Science and Engineering, Kagoshima University |
| Date | 2004/11/11 |
| Paper # | PRMU2004-100,HIP2004-40 |
| Volume (vol) | vol.104 |
| Number (no) | 449 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |