Presentation 2023-05-19
Object-Centric Representation Learning with Attention Mechanism
Hidemoto Nakada, Hideki Asoh,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) For object-centric representation learning, several slot-based methods, that separate objects using masks and learn the objects separately, are proposed. While these methods are proved to be useful on various downstream tasks, it is known that they require a significant amount of computation for training. We propose the introduction of attention mechanisms into slot-based method to simplify and speed up the computation. We pick ViMON as the base structure and propose two methods, named AttnViMON and SFA.We evaluate them in terms of reconstruction error and computation time, and a downstream task. The proposed methods demonstrate that they achieve significant speed-up while showing even better performance.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Representation Learning / Unsupervised Learning / Attention Mechanism
Paper # PRMU2023-13
Date of Issue 2023-05-11 (PRMU)

Conference Information
Committee PRMU / IPSJ-CVIM
Conference Date 2023/5/18(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Seiichi Uchida(Kyushu Univ.)
Vice Chair Takuya Funatomi(NAIST) / Mitsuru Anpai(Denso IT Lab.)
Secretary Takuya Funatomi(CyberAgent) / Mitsuru Anpai(Univ. of Tokyo)
Assistant Nakamasa Inoue(Tokyo Inst. of Tech.) / Yasutomo Kawanishi(Riken)

Paper Information
Registration To Technical Committee on Pattern Recognition and Media Understanding / Special Interest Group on Computer Vision and Image Media
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Object-Centric Representation Learning with Attention Mechanism
Sub Title (in English)
Keyword(1) Representation Learning
Keyword(2) Unsupervised Learning
Keyword(3) Attention Mechanism
1st Author's Name Hidemoto Nakada
1st Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
2nd Author's Name Hideki Asoh
2nd Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
Date 2023-05-19
Paper # PRMU2023-13
Volume (vol) vol.123
Number (no) PRMU-30
Page pp.pp.68-73(PRMU),
#Pages 6
Date of Issue 2023-05-11 (PRMU)