Presentation 2018-07-06
A long-term evaluation of a chat-oriented dialogue system that utilizes user information acquired through dialogue
Yuiko Tsunomori, Ryuichiro Higashinaka, Takeshi Yoshimura,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) A chat-oriented dialogue system can be more attractive if it can remember information about users and use that information during a dialogue. In this paper, we describe our development of a chat-oriented dialogue system that can remember user information(e.g., user's preferences etc.) acquired through dialogue. We also describe our experiment in which human users chat with the system for five consecutive days. In our experiment, three systems were compared: a system that can remember user information over multiple days, a system that can only remember user informationwithin a single dialogue session, and a system that does not remember any user information. As a result of the experiment that spanned five days, we found that, although there was little difference between the systems in terms of user satisfaction on the first day, as days went by, the user satisfaction of the system that can remember user information over multiple days became significantly better than other systems.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) chat-oriented dialogue systems / dialogue systems / evaluation
Paper # NLC2018-4
Date of Issue 2018-06-29 (NLC)

Conference Information
Committee NLC / IPSJ-ICS
Conference Date 2018/7/6(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Hokkaido University
Topics (in Japanese) (See Japanese page)
Topics (in English) Application of natural language processing and intelligent systems, and general topic of NLP
Chair Takeshi Sakaki(Hottolink)
Vice Chair Mitsuo Yoshida(Toyohashi Univ. of Tech.) / Kazutaka Shimada(Kyushu Inst. of Tech.)
Secretary Mitsuo Yoshida(Ryukoku Univ.) / Kazutaka Shimada(NTT)
Assistant Takeshi Kobayakawa(NHK) / Hiroki Sakaji(Univ. of Tokyo)

Paper Information
Registration To Technical Committee on Natural Language Understanding and Models of Communication / Special Interest Group on Intelligence and Complex Systems
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) A long-term evaluation of a chat-oriented dialogue system that utilizes user information acquired through dialogue
Sub Title (in English)
Keyword(1) chat-oriented dialogue systems
Keyword(2) dialogue systems
Keyword(3) evaluation
1st Author's Name Yuiko Tsunomori
1st Author's Affiliation NTT DOCOMO, INC.(NTT DOCOMO)
2nd Author's Name Ryuichiro Higashinaka
2nd Author's Affiliation Nippon Telegraph and Telephone Corporation(NTT)
3rd Author's Name Takeshi Yoshimura
3rd Author's Affiliation NTT DOCOMO, INC.(NTT DOCOMO)
Date 2018-07-06
Paper # NLC2018-4
Volume (vol) vol.118
Number (no) NLC-122
Page pp.pp.29-34(NLC),
#Pages 6
Date of Issue 2018-06-29 (NLC)