| Presentation | 2015-07-18 Eye fixation location in speaker's facial expression during speech comprehension Maiko Takahashi, Sachiko Takagi, Akihiro Tanaka, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This study examined the influence of speaker’s facial expression and observer’s eye movement on spoken language comprehension. In Experiment 1, participants were presented with a movie showing a female speaking an expository story with angry, happy, or neutral facial expression. They were instructed to attend to the speaker’s face in three conditions; attending to whole face, eyes, and mouth. After the movie presentation, they were asked to answer the question about literal memory and sentential comprehension of the story. The results showed that when the speaker’s facial expression was happy, and participants attended to the speaker’s mouth, comprehension performance was facilitated. In Experiment 2, we examined the speech comprehension without facial expression, and found the happy voice without face did not facilitate the comprehension. Based on the results, conversation process with facial expression was discussed. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Spoken language comprehension / Facial expression / Eye movement / Multimodal communication |
| Paper # | HIP2015-45 |
| Date of Issue | 2015-07-11 (HIP) |
| Conference Information | |
| Committee | HIP |
|---|---|
| Conference Date | 2015/7/18(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kyushu Sangyo University |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Hideyuki Ando(Osaka Univ.) |
| Vice Chair | Masahiro Ishii(Sapporo City Univ.) / Miyuki Kamachi(Kogakuin Univ.) |
| Secretary | Masahiro Ishii(NICT) / Miyuki Kamachi(KDDI R&D Labs.) |
| Assistant | Sinobu Kuroki(NTT) / Mutsumi Suganuma(Waseda Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Human Information Processing |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Eye fixation location in speaker's facial expression during speech comprehension |
| Sub Title (in English) | |
| Keyword(1) | Spoken language comprehension |
| Keyword(2) | Facial expression |
| Keyword(3) | Eye movement |
| Keyword(4) | Multimodal communication |
| 1st Author's Name | Maiko Takahashi |
| 1st Author's Affiliation | Japan Society for the Promotion of Science/Tokyo Woman's Christian University(JSPS/Tokyo Woman's Christian Univ.) |
| 2nd Author's Name | Sachiko Takagi |
| 2nd Author's Affiliation | Tokyo Woman's Christian University(Tokyo Woman's Christian Univ.) |
| 3rd Author's Name | Akihiro Tanaka |
| 3rd Author's Affiliation | Tokyo Woman's Christian University(Tokyo Woman's Christian Univ.) |
| Date | 2015-07-18 |
| Paper # | HIP2015-45 |
| Volume (vol) | vol.115 |
| Number (no) | HIP-149 |
| Page | pp.pp.19-24(HIP), |
| #Pages | 6 |
| Date of Issue | 2015-07-11 (HIP) |