| Presentation | 2022-03-11 Proposal of Multi-Modal Diary Service for Assisting Elderly Self-Care Using Spoken Dialogue Agent Sinan Chen, Hayato Ozono, Masahide Nakamura, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | As Japan's aging population and low birth rate, the self-care of elderly people at home has become increasingly in demand. Although the rapid progress of AI-enabled smart healthcare is developing, diversity and reusability of in-home daily living data to be recorded and analyzed are still challenging points. In our previous study, a system utilizing spoken dialogue agents for listening to the minds of elderly people was developed. The purpose of this study is to propose a multi-modal diary service that records and analyzes dialogue data with a diversified viewpoint. Our key idea is to retrieve not only the text logs but also audio and images and execute multi-modal visualization of them. In the proposed method, main steps including heterogeneous data extraction, Web API development, multi-modal diary generation, and heterogeneous data analysis are described. Moreover, the approach to extending heterogeneous data is also discussed. Using the proposed method, elderly people can recollect the past for their own better. In this way, the more correct improvement of in-home care and health management for all individuals is promising. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Self-care / Spoken dialogue agent / Heterogeneous data / Multi-modal visualization / Smart healthcare |
| Paper # | SC2021-48 |
| Date of Issue | 2022-03-04 (SC) |
| Conference Information | |
| Committee | SC |
|---|---|
| Conference Date | 2022/3/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | EventIn |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Service Computing under DX, and general topics |
| Chair | Shinji Kikuchi(NIMS) |
| Vice Chair | Yoji Yamato(NTT) / Kosaku Kimura(Fujitsu Lab.) |
| Secretary | Yoji Yamato(Kobe Univ.) / Kosaku Kimura(Tokyo Univ. of Tech.) |
| Assistant | Shin Tezuka(Hitachi) / Takao Nakaguchi(KCGI) |
| Paper Information | |
| Registration To | Technical Committee on Service Computing |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Proposal of Multi-Modal Diary Service for Assisting Elderly Self-Care Using Spoken Dialogue Agent |
| Sub Title (in English) | |
| Keyword(1) | Self-care |
| Keyword(2) | Spoken dialogue agent |
| Keyword(3) | Heterogeneous data |
| Keyword(4) | Multi-modal visualization |
| Keyword(5) | Smart healthcare |
| 1st Author's Name | Sinan Chen |
| 1st Author's Affiliation | Kobe University(Kobe Univ.) |
| 2nd Author's Name | Hayato Ozono |
| 2nd Author's Affiliation | Kobe University(Kobe Univ.) |
| 3rd Author's Name | Masahide Nakamura |
| 3rd Author's Affiliation | Kobe University(Kobe Univ.) |
| Date | 2022-03-11 |
| Paper # | SC2021-48 |
| Volume (vol) | vol.121 |
| Number (no) | SC-437 |
| Page | pp.pp.75-80(SC), |
| #Pages | 6 |
| Date of Issue | 2022-03-04 (SC) |