Presentation 2019-02-28
[招待講演]Visual Question Generation for Class Acquisition of Unknown Objects (ECCV2018)
, , , ,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Traditional image recognition methods only consider objects belonging to already learned classes. However, since training a recognition model with every object class in the world is unfeasible, a way of getting information on unknown objects (i.e., objects whose class has not been learned) is necessary. A way for an image recognition system to learn new classes could be asking a human about objects that are unknown. In this paper, we propose a method for generating questions about unknown objects in an image, as means to get information about classes that have not been learned. Our method consists of a module for proposing objects, a module for identifying unknown objects, and a module for generating questions about unknown objects. The experimental results via human evaluation show that our method can successfully get information about unknown objects in an image dataset. Our code and dataset are available at https://github.com/mil-tokyo/vqg-unknown
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Visual question generation / Unknown object recognition / Unknown object class acquisition / Real world recognition
Paper # PRMU2018-114,CNR2018-37
Date of Issue 2019-02-21 (PRMU, CNR)

Conference Information
Committee PRMU / CNR
Conference Date 2019/2/28(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Shinichi Sato(NII) / Tetsuo Ono(Hokkaido Univ.)
Vice Chair Yoshihisa Ijiri(Omron) / Toru Tamaki(Hiroshima Univ.) / Masayuki Kanbara(NAIST) / Kazunori Takashio(Keio Univ.)
Secretary Yoshihisa Ijiri(NEC) / Toru Tamaki(Osaka Univ.) / Masayuki Kanbara(Hokkaido Univ.) / Kazunori Takashio(Panasonic)
Assistant Go Irie(NTT) / Yoshitaka Ushiku(Univ. of Tokyo) / Wataru Mito(SECOM) / Yuka Kobayashi(Toshiba) / Tatsuya Ishihara(NTT)

Paper Information
Registration To Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Cloud Network Robotics
Language JPN-ONLY
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English)
Sub Title (in English)
Keyword(1) Visual question generation
Keyword(2) Unknown object recognition
Keyword(3) Unknown object class acquisition
Keyword(4) Real world recognition
1st Author's Name
1st Author's Affiliation ()
2nd Author's Name
2nd Author's Affiliation ()
3rd Author's Name
3rd Author's Affiliation ()
4th Author's Name
4th Author's Affiliation ()
Date 2019-02-28
Paper # PRMU2018-114,CNR2018-37
Volume (vol) vol.118
Number (no) PRMU-459,CNR-460
Page pp.pp.5-5(PRMU), pp.5-5(CNR),
#Pages 1
Date of Issue 2019-02-21 (PRMU, CNR)