Presentation 2023-03-03
Eye-contact Transformer: Eye contact detection of distant pedestrians using a sequence of skeletons and scene features
Ryusei Hata, Daisuke Deguchi, Takatsugu Hirayama, Yasutomo Kawanishi, Hiroshi Murase,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) While driving, eye-contact from pedestrians is an important factor in determining whether they are aware of own vehicle or not. Most conventional eye-contact detection methods rely on eye measurement, which is difficult to apply against pedestrians who are distant from the vehicle, such as in a road environment. To solve this problem, we propose Eye-contact Transformer (EyeT), a method for eye-contact detection considering not only the pedestrian but also the surrounding environment. Through the experiments using in-vehicle camera images, we confirmed the effectiveness of the proposed method.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) eye-contact detection / a sequence of skeletons / scene context / Transformer / self-attention
Paper # PRMU2022-112,IBISML2022-119
Date of Issue 2023-02-23 (PRMU, IBISML)

Conference Information
Committee PRMU / IBISML / IPSJ-CVIM
Conference Date 2023/3/2(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Future University Hakodate
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Seiichi Uchida(Kyushu Univ.) / Masashi Sugiyama(Univ. of Tokyo)
Vice Chair Takuya Funatomi(NAIST) / Mitsuru Anpai(Denso IT Lab.) / Toshihiro Kamishima(AIST) / Koji Tsuda(Univ. of Tokyo)
Secretary Takuya Funatomi(CyberAgent) / Mitsuru Anpai(Univ. of Tokyo) / Toshihiro Kamishima(NTT) / Koji Tsuda(Hokkaido Univ.)
Assistant Nakamasa Inoue(Tokyo Inst. of Tech.) / Yasutomo Kawanishi(Riken) / Yoshinobu Kawahara(Osaka Univ.) / Taiji Suzuki(Tokyo Inst. of Tech.)

Paper Information
Registration To Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Information-Based Induction Sciences and Machine Learning / Special Interest Group on Computer Vision and Image Media
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Eye-contact Transformer: Eye contact detection of distant pedestrians using a sequence of skeletons and scene features
Sub Title (in English)
Keyword(1) eye-contact detection
Keyword(2) a sequence of skeletons
Keyword(3) scene context
Keyword(4) Transformer
Keyword(5) self-attention
1st Author's Name Ryusei Hata
1st Author's Affiliation Nagoya University(Nagoya Univ)
2nd Author's Name Daisuke Deguchi
2nd Author's Affiliation Nagoya University(Nagoya Univ)
3rd Author's Name Takatsugu Hirayama
3rd Author's Affiliation University of Human Environments/Nagoya University(UHE/Nagoya Univ)
4th Author's Name Yasutomo Kawanishi
4th Author's Affiliation RIKEN/Nagoya University(RIKEN/Nagoya Univ)
5th Author's Name Hiroshi Murase
5th Author's Affiliation Nagoya University(Nagoya Univ)
Date 2023-03-03
Paper # PRMU2022-112,IBISML2022-119
Volume (vol) vol.122
Number (no) PRMU-404,IBISML-405
Page pp.pp.281-286(PRMU), pp.281-286(IBISML),
#Pages 6
Date of Issue 2023-02-23 (PRMU, IBISML)