Presentation 2023-09-22
Character dialogue system considering the character appearance image
Keito Fukuoka, Miyamori Hisashi,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Dialogue systems are useful for increasing communication opportunities for the elderly and people living alone. In particular, it is known that adding character to dialogue systems can increase user interest and promote communication. In previous studies of character dialogue systems, only textual information is given as characterization. However, the appearance of a character is an important feature in conveying the characterization that the user wants to reproduce to the system, because it is drawn to reflect the characterization. Therefore, we propose a character dialogue system that takes into account not only text but also appearance images as character traits, with the goal of enabling users to chat with a dialogue system that has any character traits they have in mind. We expect that the proposed system will be able to accurately reproduce the user's character even with a smaller amount of speech data. In experiments, we will compare dialogues without and with appearance images, and analyze and evaluate the differences in characterization and dialogue content.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) characterization / dialogue system / multimodal / natural language process
Paper # DE2023-25
Date of Issue 2023-09-14 (DE)

Conference Information
Committee DE / IPSJ-DBS / IPSJ-IFAT
Conference Date 2023/9/21(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Kitakyushu International Conference Center
Topics (in Japanese) (See Japanese page)
Topics (in English) Bigdata management, information retrieval, knowledge discovery, etc.
Chair Masashi Toyoda(Univ. of Tokyo)
Vice Chair Kosuke Takano(Kanagawa Inst. of Tech.) / Chiemi Watanabe(Tsukuba Univ. of Technology)
Secretary Kosuke Takano(Univ. of Tsukuba) / Chiemi Watanabe(Komazawa Univ.)
Assistant Takahiro Komamizu(Nagoya Univ.)

Paper Information
Registration To Technical Committee on Data Engineering / Special Interest Group on Database System / Special Interest Group on Information Fundamentals and Access Technologies
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Character dialogue system considering the character appearance image
Sub Title (in English)
Keyword(1) characterization
Keyword(2) dialogue system
Keyword(3) multimodal
Keyword(4) natural language process
1st Author's Name Keito Fukuoka
1st Author's Affiliation Kyoto Sangyo University(Kyoto Sangyo Univ.)
2nd Author's Name Miyamori Hisashi
2nd Author's Affiliation Kyoto Sangyo University(Kyoto Sangyo Univ.)
Date 2023-09-22
Paper # DE2023-25
Volume (vol) vol.123
Number (no) DE-192
Page pp.pp.84-88(DE),
#Pages 5
Date of Issue 2023-09-14 (DE)