Presentation 2022-06-23
Development and Evaluation of Indoor Activity Tracking System Using Sensor Fusion with Audio and 3D Point Cloud Observation
Mana Nishigaki, Hiroshi Yamamoto,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) With the current spread of COVID-19, there has been a growing interest in monitoring behavior of people to control the spread of infectious diseases indoor. In addition, in recent years, the probability of evacuation of residents to refuges has increased due to natural disasters such as earthquakes and typhoons. So far, the existing studies have proposed tracking systems for the indoor position of individuals using a wireless tag which is linked to personal information or LiDAR. However, it is difficult to prepare enough tags before the occurrence of the disaster, and it is impossible to identify each person by the observation with LiDAR. Therefore, in this system, we propose a new tracking system that identifies individuals in each direction by deploying microphones of estimating the direction of sound source on multiple locations and by analyzing the voiceprints. In addition, by installing LiDAR, the system observes the three-dimensional structure in the area to be observed and identify the location of people in real time. Furthermore, by combining these observations, the system achieves the tracking of individuals indoor and detects the intensive contact among users. By the proposed system, the location and behavior of users can automatically be tracked even if they do not possess specific devices, and the facility managers can check the visualization of the tracking results.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) IoT / voice analysis / machine Learning / point cloud analysis / LiDAR
Paper # IA2022-7,ICSS2022-7
Date of Issue 2022-06-16 (IA, ICSS)

Conference Information
Committee IA / ICSS
Conference Date 2022/6/23(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Univ. of Nagasaki
Topics (in Japanese) (See Japanese page)
Topics (in English) Internet Security, etc.
Chair Tomoki Yoshihisa(Osaka Univ.) / Katsunari Yoshioka(Yokohama National Univ.)
Vice Chair Toru Kondo(Hiroshima Univ.) / Yuichiro Hei(KDDI Research) / Hiroshi Yamamoto(Ritsumeikan Univ.) / Kazunori Kamiya(NTT) / Takahiro Kasama(NICT)
Secretary Toru Kondo(Osaka Univ.) / Yuichiro Hei(Kogakuin Univ.) / Hiroshi Yamamoto(NEC) / Kazunori Kamiya(KDDI labs.) / Takahiro Kasama(Okayama Univ.)
Assistant Daisuke Kotani(Kyoto Univ.) / Ryo Nakamurai(Fukuoka Univ.) / Daiki Nobayashi(Kyushu Inst. of Tech.) / Keisuke Kito(Mitsubishi Electric) / Takeshi Sugawara(Univ. of Electro-Comm.)

Paper Information
Registration To Technical Committee on Internet Architecture / Technical Committee on Information and Communication System Security
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Development and Evaluation of Indoor Activity Tracking System Using Sensor Fusion with Audio and 3D Point Cloud Observation
Sub Title (in English)
Keyword(1) IoT
Keyword(2) voice analysis
Keyword(3) machine Learning
Keyword(4) point cloud analysis
Keyword(5) LiDAR
1st Author's Name Mana Nishigaki
1st Author's Affiliation Ritsumeikan University(Ritsumei Univ.)
2nd Author's Name Hiroshi Yamamoto
2nd Author's Affiliation Ritsumeikan University(Ritsumei Univ.)
Date 2022-06-23
Paper # IA2022-7,ICSS2022-7
Volume (vol) vol.122
Number (no) IA-85,ICSS-86
Page pp.pp.37-42(IA), pp.37-42(ICSS),
#Pages 6
Date of Issue 2022-06-16 (IA, ICSS)