| Presentation | 2010-07-23 Design and Evaluation for Back-Channel Feedback Corpus Tomohiro OHNO, Yuki KAMIYA, Shigeki MATSUBARA, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This paper describes design of a back-channel feedback corpus and its evaluation, aiming at realizing in-car spoken dialogue systems with the high responsiveness. Our corpus is constructed by comprehensively tagging proper points at which back-channel feedbacks should be provided, for the existing spoken dialogue corpus. Therefore, our corpus is the practically available data in developing the dialogue systems which can provide the back-channel feedbacks. We constructed the large-scale corpus including 5,416 back-channel feedbacks by using 11,181 dialogue turns of driver's utterances in CIAIR in-car spoken dialogue corpus. As the result of an experiment on the tagging by another annotators to confirm that the tagging is coherently performed in the corpus, the kappa value was 0.731, and thus we can see the substantial agreement between annotators. In addition, we conducted a subjective experiment to evaluate the naturalness of the back-channel feedback timings tagged in our corpus. As the result, back-channel feedbacks judged to be natural occupied 98.47% of the whole. From these evaluation results, we confirmed that our design enabled construction of the back-channel feedback corpus with high coherency and naturalness. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | corpus / spoken language / dialogue system / tagging |
| Paper # | NLC2010-6 |
| Date of Issue |
| Conference Information | |
| Committee | NLC |
|---|---|
| Conference Date | 2010/7/15(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Natural Language Understanding and Models of Communication (NLC) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Design and Evaluation for Back-Channel Feedback Corpus |
| Sub Title (in English) | |
| Keyword(1) | corpus |
| Keyword(2) | spoken language |
| Keyword(3) | dialogue system |
| Keyword(4) | tagging |
| 1st Author's Name | Tomohiro OHNO |
| 1st Author's Affiliation | Graduate School of International Development, Nagoya University() |
| 2nd Author's Name | Yuki KAMIYA |
| 2nd Author's Affiliation | Graduate School of Information Science, Nagoya University |
| 3rd Author's Name | Shigeki MATSUBARA |
| 3rd Author's Affiliation | Graduate School of Information Science, Nagoya University |
| Date | 2010-07-23 |
| Paper # | NLC2010-6 |
| Volume (vol) | vol.110 |
| Number (no) | 142 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |