Presentation 2004/1/16
Multimodal Description of Human Behavior Using Wearable Camera
Ryoichi KATO, Shigeki AOKI, Atsuhiro KOJIMA, Kunio FUKUNAGA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In this paper, we propose a method of recognizing human behavior using video images of a wearable camera in addition to the data of GPS(Global Positioning System) and expressing it in the form of multimodal description. Firstly, location of the person is estimated by movements of the person from the change of images obtained by the camera, and the position given by the GPS in the case of outdoor. The actions are inferred from the combinatorial movements of hands, faces which are extracted by skin color statistics from images. The region of objects is extracted by change of the images, and is recognized using the model-based matching. Using these recognized results, we represent the behavior of the person by the form of multimodal expression such as natural language, still picture and video images (video picture).
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Wearable Camera / Recognition of Human Activities / Multimodal Description
Paper # PRMU2003-210
Date of Issue

Conference Information
Committee PRMU
Conference Date 2004/1/16(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Pattern Recognition and Media Understanding (PRMU)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Multimodal Description of Human Behavior Using Wearable Camera
Sub Title (in English)
Keyword(1) Wearable Camera
Keyword(2) Recognition of Human Activities
Keyword(3) Multimodal Description
1st Author's Name Ryoichi KATO
1st Author's Affiliation raduate School of Engineering, Osaka Prefecture University()
2nd Author's Name Shigeki AOKI
2nd Author's Affiliation raduate School of Engineering, Osaka Prefecture University
3rd Author's Name Atsuhiro KOJIMA
3rd Author's Affiliation Library and Science Infomation Center, Osaka Prefecture University
4th Author's Name Kunio FUKUNAGA
4th Author's Affiliation raduate School of Engineering, Osaka Prefecture University
Date 2004/1/16
Paper # PRMU2003-210
Volume (vol) vol.103
Number (no) 585
Page pp.pp.-
#Pages 6
Date of Issue