Presentation 2021-03-02
Visual place recognition from eye reflection
Yuki Ohshima, Kyosuke Maeda, Yusuke Edamoto, Atsushi Nakazawa,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) The cornea in the human eye reflects incoming environmental light, which means we can obtain information about the surrounding environment from the corneal reflection in facial images. In recent years, as the quality of consumer cameras increases, this has caused privacy concerns in terms of identifying the people around the subject or where the photo is taken. This paper investigates the security risk of eye corneal reflection images: specifically, visual place recognition from eye reflection images. First, we constructed two datasets containing pairs of scene and corneal reflection images. We developed several visual place recognition algorithms, including CNN-based image descriptors featuring a naive Siamese network and AFD-Net combined with entire image feature representations including VLAD and NetVLAD, and compared the results. We found that AFD-Net+VLAD performed the best and was able to accurately determine the scene in 73.08% of the top-five candidate scenes. These results demonstrate the potential to estimate the location at which a facial picture was taken.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Corneal Reflection / Computer Vision / Deep Learning / Image Recognition / Biometrics / Privacy / Security
Paper # BioX2020-48,CNR2020-21
Date of Issue 2021-02-23 (BioX, CNR)

Conference Information
Committee BioX / CNR
Conference Date 2021/3/2(1days)
Place (in Japanese) (See Japanese page)
Place (in English) Online
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Akira Otsuka(AIST) / Kazunori Takashio(Keio Univ.)
Vice Chair Takahiro Aoki(Fujitsu Labs.) / Masatsugu Ichino(Univ. of Electro-Comm.) / Masayuki Kanbara(NAIST) / Yoshihiko Murakawa(Fujitsu Labs.)
Secretary Takahiro Aoki(SECOM) / Masatsugu Ichino(KDDI Research) / Masayuki Kanbara(Shibaura Inst. of Tech.) / Yoshihiko Murakawa(Panasonic)
Assistant Emiko Sano(MitsubishiElectric) / Akihiro Hayasaka(NEC) / Yuka Kobayashi(Toshiba) / Masanori Yokoyama(NTT)

Paper Information
Registration To Technical Committee on Biometrics / Technical Committee on Cloud Network Robotics
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Visual place recognition from eye reflection
Sub Title (in English)
Keyword(1) Corneal Reflection
Keyword(2) Computer Vision
Keyword(3) Deep Learning
Keyword(4) Image Recognition
Keyword(5) Biometrics
Keyword(6) Privacy
Keyword(7) Security
1st Author's Name Yuki Ohshima
1st Author's Affiliation Kyoto University(Kyoto Univ.)
2nd Author's Name Kyosuke Maeda
2nd Author's Affiliation Kyoto University(Kyoto Univ.)
3rd Author's Name Yusuke Edamoto
3rd Author's Affiliation Kyoto University(Kyoto Univ.)
4th Author's Name Atsushi Nakazawa
4th Author's Affiliation Kyoto University(Kyoto Univ.)
Date 2021-03-02
Paper # BioX2020-48,CNR2020-21
Volume (vol) vol.120
Number (no) BioX-393,CNR-394
Page pp.pp.44-49(BioX), pp.44-49(CNR),
#Pages 6
Date of Issue 2021-02-23 (BioX, CNR)