|
This paper proposes an evaluation protocol for text-to-speech for spoken dialogue systems with respect to communication of intentions. Evaluating this sometimes produce unreliable results because participants can misinterpret definitions of intentions due to implicit description of intentions. To address this problem, this work explicitly defines each intention following theoretical definitions, “felicity conditions”, in speech-act theory. We compared the proposed protocol with the conventional baseline. The experimental results with 10 participants showed that the proposed protocol produced smaller within-group variation and larger between-group variation, which indicates higher inter-rater reliability and sensitivity.
|
