Presentation 2020-03-05
Motion Robust Remote Heart Rate Estimation based on RGB/NIR Imaging Under Varying Illumination
Kosuke Kurihara, Daisuke Sugimura, Takayuki Hamamoto,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) We propose a method for heart rate (HR) estimation that is robust to various illumination conditions and subject's head motion. We introduce a scheme for adaptive fusion of RGB and NIR signals by analyzing variations in background illuminations. NIR signals are more reliable in HR estimation than RGB ones in complex illumination scenes, because NIR signals can be captured independent to changes in the background illuminations. By measuring correlations of signals between background and face regions, we adaptively utilize RGB and NIR signals for HR estimation. Furthermore, to achieve robustness against subject's head motion, we introduce motion-robust time-series filtering. When we observe large head movements, we put a confidence to the past HR probability rather than the current RGB/NIR observation. Experiments demonstrate the effectiveness of our method.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Remote vital sensing / RGB/NIR camera / Varying illumination / Varying head pose
Paper # IMQ2019-24,IE2019-106,MVE2019-45
Date of Issue 2020-02-27 (IMQ, IE, MVE)

Conference Information
Committee IE / IMQ / MVE / CQ
Conference Date 2020/3/5(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Kyushu Institute of Technology
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Hideaki Kimata(NTT) / Toshiya Nakaguchi(Chiba Univ.) / Kenji Mase(Nagoya Univ.) / Hideyuki Shimonishi(NEC)
Vice Chair Kazuya Kodama(NII) / Keita Takahashi(Nagoya Univ.) / Mitsuru Maeda(Canon) / Kenya Uomori(Osaka Univ.) / Masayuki Ihara(NTT) / Jun Okamoto(NTT) / Takefumi Hiraguri(Nippon Inst. of Tech.)
Secretary Kazuya Kodama(NTT) / Keita Takahashi(NHK) / Mitsuru Maeda(Shizuoka Univ.) / Kenya Uomori(Sony Semiconductor Solutions) / Masayuki Ihara(Nagoya Univ.) / Jun Okamoto(NTT) / Takefumi Hiraguri(Nippon Inst. of Tech.)
Assistant Kyohei Unno(KDDI Research) / Norishige Fukushima(Nagoya Inst. of Tech.) / Hiroaki Kudo(Nagoya Univ.) / Masaru Tsuchida(NTT) / Keita Hirai(Chiba Univ.) / Satoshi Nishiguchi(Oosaka Inst. of Tech.) / Masanori Yokoyama(NTT) / Shogo Fukushima(Univ. of ToKyo) / Chikara Sasaki(KDDI Research) / Yoshiaki Nishikawa(NEC) / Takuto Kimura(NTT)

Paper Information
Registration To Technical Committee on Image Engineering / Technical Committee on Image Media Quality / Technical Committee on Media Experience and Virtual Environment / Technical Committee on Communication Quality
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Motion Robust Remote Heart Rate Estimation based on RGB/NIR Imaging Under Varying Illumination
Sub Title (in English)
Keyword(1) Remote vital sensing
Keyword(2) RGB/NIR camera
Keyword(3) Varying illumination
Keyword(4) Varying head pose
1st Author's Name Kosuke Kurihara
1st Author's Affiliation Tokyo University of Science(Tokyo Univ. of Science)
2nd Author's Name Daisuke Sugimura
2nd Author's Affiliation Tsuda University(Tsuda Univ.)
3rd Author's Name Takayuki Hamamoto
3rd Author's Affiliation Tokyo University of Science(Tokyo Univ. of Science)
Date 2020-03-05
Paper # IMQ2019-24,IE2019-106,MVE2019-45
Volume (vol) vol.119
Number (no) IMQ-454,IE-456,MVE-457
Page pp.pp.47-50(IMQ), pp.47-50(IE), pp.47-50(MVE),
#Pages 4
Date of Issue 2020-02-27 (IMQ, IE, MVE)