| Presentation | 2003/12/12 Preliminary study on the evaluation of a quality of spoken dialogue system in terms of user factors Ayako SHIROSE, Sunao HARA, Hiroshi FUJIMURA, Katsunobu ITO, Kauya TAKEDA, Fumitada ITAKURA, |
|---|---|
| PDF Download Page | PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This study aims to describe user problems and process of learning skill in using spoken dialogue systems and to reveal how these impact on the evaluation of the system usefulness. For this aim, we designed a new dialogue system and carried out a field test for a large number of subjects and asked them to evaluate the usefulness of the system. The results showed that the evaluation of the system did not correlate a recognition rate but user satisfaction and comprehension. This suggested that the spoken dialogue systems should be evaluated in terms of user factors. Controlled experiments are needed to discuss in detail. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Spoken Dialogue System / Evaluation of a Quality of System / Task Completion / User Skill / Correlation |
| Paper # | NLC2003-92 |
| Date of Issue |
| Conference Information | |
| Committee | NLC |
|---|---|
| Conference Date | 2003/12/12(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Natural Language Understanding and Models of Communication (NLC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Preliminary study on the evaluation of a quality of spoken dialogue system in terms of user factors |
| Sub Title (in English) | |
| Keyword(1) | Spoken Dialogue System |
| Keyword(2) | Evaluation of a Quality of System |
| Keyword(3) | Task Completion |
| Keyword(4) | User Skill |
| Keyword(5) | Correlation |
| 1st Author's Name | Ayako SHIROSE |
| 1st Author's Affiliation | Department of Information Science/CIAIR, Nagoya University() |
| 2nd Author's Name | Sunao HARA |
| 2nd Author's Affiliation | Department of Information Science/CIAIR, Nagoya University |
| 3rd Author's Name | Hiroshi FUJIMURA |
| 3rd Author's Affiliation | Department of Information Science/CIAIR, Nagoya University |
| 4th Author's Name | Katsunobu ITO |
| 4th Author's Affiliation | Department of Information Science/CIAIR, Nagoya University |
| 5th Author's Name | Kauya TAKEDA |
| 5th Author's Affiliation | Department of Information Science/CIAIR, Nagoya University |
| 6th Author's Name | Fumitada ITAKURA |
| 6th Author's Affiliation | Department of Information Science/CIAIR, Nagoya University |
| Date | 2003/12/12 |
| Paper # | NLC2003-92 |
| Volume (vol) | vol.103 |
| Number (no) | 518 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |