Presentation 2022-03-11
Research on state recognition and behavior prediction of surrounding people using a stereo camera in a human coexistence type autonomous mobile robotResearch on State Recognition and Behavior Prediction of Surrounding People using a Stereo Camera in a Huma
Masaaki Hayashi, Jun Ohya, Junji Yamato, Mitsuhiro Kamezaki, Kyousuke Saitou, Tarou Hamada, Eriko Sakurai, Shigeki Sugano,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In recent years, major advanced countries have been developing autonomous mobile robots to replace human labor as a countermeasure for declining population and aging society. In order for an autonomous mobile robot to work safely in an environment coexisting with humans, a system that adaptively selects the robot's behavior based on human observation and insight is necessary. Conventional robots handle human information mainly in the form of position and velocity, but there are various situations in which it is difficult to make decisions based on these alone. In this paper, we propose a method to estimate the recognition of a person from RGB images, to recognize a specific action, and to predict a specific action state, and to calculate the danger level as the degree of attention that the robot pays to each person. We evaluated each system and the degree of danger from experiments, and obtained results suggesting the effectiveness of the proposed method.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Autonomous Mobile Robot / Coexistence with People / danger level / Machine Learning
Paper # IMQ2021-52,IE2021-114,MVE2021-81
Date of Issue 2022-03-02 (IMQ, IE, MVE)

Conference Information
Committee CQ / IMQ / MVE / IE
Conference Date 2022/3/9(3days)
Place (in Japanese) (See Japanese page)
Place (in English) Online (Zoom)
Topics (in Japanese) (See Japanese page)
Topics (in English) Media of five senses, Multimedia, Media experience, Picture codinge, Image media quality, Network,quality and reliability, etc
Chair Jun Okamoto(NTT) / Kenya Uomori(Osaka Univ.) / Masayuki Ihara(RIKEN) / Kazuya Kodama(NII)
Vice Chair Takefumi Hiraguri(Nippon Inst. of Tech.) / Gou Hasegawa(Tohoku Univ.) / Mitsuru Maeda(Canon) / Kiyoshi Kiyokawa(NAIST) / Hiroyuki Bandoh(NTT) / Toshihiko Yamazaki(Univ. of Tokyo)
Secretary Takefumi Hiraguri(NTT) / Gou Hasegawa(Ritsumeikan Univ.) / Mitsuru Maeda(Nagoya Univ.) / Kiyoshi Kiyokawa(NTT) / Hiroyuki Bandoh(Oosaka Inst. of Tech.) / Toshihiko Yamazaki(NTT)
Assistant Yoshiaki Nishikawa(NEC) / Ryoichi Kataoka(KDDI Research) / Kimiko Kawashima(NTT) / Masato Tsukada(NEC) / Takashi Yamazoe(Seikei Univ.) / Naoya Isoyama(NAIST) / Takenori Hara(DNP) / Mitsuhiro Goto(NTT) / Shunsuke Iwamura(NHK) / Shinobu Kudo(NTT)

Paper Information
Registration To Technical Committee on Communication Quality / Technical Committee on Image Media Quality / Technical Committee on Media Experience and Virtual Environment / Technical Committee on Image Engineering
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Research on state recognition and behavior prediction of surrounding people using a stereo camera in a human coexistence type autonomous mobile robotResearch on State Recognition and Behavior Prediction of Surrounding People using a Stereo Camera in a Huma
Sub Title (in English)
Keyword(1) Autonomous Mobile Robot
Keyword(2) Coexistence with People
Keyword(3) danger level
Keyword(4) Machine Learning
1st Author's Name Masaaki Hayashi
1st Author's Affiliation Waseda University(Waseda Univ)
2nd Author's Name Jun Ohya
2nd Author's Affiliation Waseda University(Waseda Univ)
3rd Author's Name Junji Yamato
3rd Author's Affiliation Kogakuin University(KUTE-TOKYO)
4th Author's Name Mitsuhiro Kamezaki
4th Author's Affiliation Waseda University/:Japan Science and Technology Agency PRESTO(Waseda Univ/JST PRESTO)
5th Author's Name Kyousuke Saitou
5th Author's Affiliation Waseda University(Waseda Univ)
6th Author's Name Tarou Hamada
6th Author's Affiliation Waseda University(Waseda Univ)
7th Author's Name Eriko Sakurai
7th Author's Affiliation Waseda University(Waseda Univ)
8th Author's Name Shigeki Sugano
8th Author's Affiliation Waseda University(Waseda Univ)
Date 2022-03-11
Paper # IMQ2021-52,IE2021-114,MVE2021-81
Volume (vol) vol.121
Number (no) IMQ-420,IE-422,MVE-423
Page pp.pp.216-221(IMQ), pp.216-221(IE), pp.216-221(MVE),
#Pages 6
Date of Issue 2022-03-02 (IMQ, IE, MVE)