| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2008-12-09 16:00 User modeling for a satisfaction evaluation of a speech recognition system Sunao Hara, Norihide Kitaoka, Kazuya Takeda (Nagoya Univ.)  NLC2008-34 SP2008-89 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | A mathematical model for predicting the user satisfaction of a speech dialogue systems is studied based on a field trial of a voice-navigated music retrieval system. The {\em Subjective} Word Accuracy (\sWA), of the user is introduced as a background psychometrics for the satisfaction. In the field test, \sWA is collected through questionnaires together with satisfactory indexes and various user profiles. First we show that the \sWA is more significant to the user satisfactory than ({\em Objective}) Word Accuracy (\oWA), which is calculated using the manually given transcriptions for the recorded dialogue. Then through top-down clustering of the joint distribution of {\it subjective}- and {\it objective}-WAs, we show that the user population can be grouped into several sub-groups in terms of sensitivity to recognition accuracy. The lower bound of the \oWA for the given \sWA is also calculated from the joint distribution. Finally, a graphical model is build that predicts the user satisfactory index from user profiles and reduces the distribution uncertainty of user satisfaction by 13\% of its variance. |
|
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | System Evaluation / Performance Measure / User Profile / Field Test / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 108, no. 338, SP2008-89, pp. 61-66, Dec. 2008. | |
| Paper # | SP2008-89 | |
| Date of Issue | 2008-12-02 (NLC, SP) | |
| ISSN | Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | NLC2008-34 SP2008-89 |
|
| Conference Information | |
| Committee | SP NLC |
| Conference Date | 2008-12-09 - 2008-12-10 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Waseda Univ. |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Paper Information | |
| Registration To | SP |
| Conference Code | 2008-12-SP-NLC |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | User modeling for a satisfaction evaluation of a speech recognition system |
| Sub Title (in English) | |
| Keyword(1) | System Evaluation |
| Keyword(2) | Performance Measure |
| Keyword(3) | User Profile |
| Keyword(4) | Field Test |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Sunao Hara |
| 1st Author's Affiliation | Nagoya Unibersity (Nagoya Univ.) |
| 2nd Author's Name | Norihide Kitaoka |
| 2nd Author's Affiliation | Nagoya Unibersity (Nagoya Univ.) |
| 3rd Author's Name | Kazuya Takeda |
| 3rd Author's Affiliation | Nagoya Unibersity (Nagoya Univ.) |
| 4th Author's Name | |
| 4th Author's Affiliation | () |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2008-12-09 16:00:00 |
| Presentation Time | 25 minutes |
| Registration for | SP |
| Paper # | NLC2008-34, SP2008-89 |
| Volume (vol) | vol.108 |
| Number (no) | no.337(NLC), no.338(SP) |
| Page | pp.61-66 |
| #Pages | 6 |
| Date of Issue | 2008-12-02 (NLC, SP) |
[Return to Top Page]