Presentation 2018-02-26
Evaluation of Hand Gesture Annotation in Remote Collaboration Using Mixed Reality
Shohei Yamada, Naiwala P. Chandrasiri,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In cases where it is difficult for local staff alone to deal with emergency problems at industrial facilities or construction sites, by using remote work support system, it is possible to receive assistance from experts in remote locations via video/audio two-way communication. Recently, thanks to smartglasses, field workers can look at documents and instructional annotations without taking their eyes off from their work. In many existing systems, the helper can show the annotation to the worker with drawn lines or arrows, but their display in the smartglasses is planar. Therefore it is unsuitable for expressing the depth information or instructing complicated work to the worker. In this research, we have devised a system that can deal with conveying of complicated tasks which involve depth information to the worker by using the hand gestures of the helper. In this system, by using Mixed Reality technology, it is possible to display as if the helper's hand model actually exist in front of the worker. In order to evaluate the usefulness of the proposed system, we conducted comparative experiments on remote work support by instruction annotations using conventional method of drawn lines and the proposed method of by using hand gesture instructions respectively. As a result, no significant difference was found between two methods in terms of the understandability of the instructions, however regarding working time, the hand gesture instructions were shorter by 20 seconds (shortened by 19%) on average than the other.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Mixed reality / Smartglasses / Remote collaboration / Hand gesture
Paper # MoNA2017-63
Date of Issue 2018-02-19 (MoNA)

Conference Information
Committee MoNA / ASN / IPSJ-MBL / IPSJ-UBI
Conference Date 2018/2/26(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Sophia University
Topics (in Japanese) (See Japanese page)
Topics (in English) Ubiquitous system, Ambient intelligence, Next generation wireless communicasion, Mobile network, etc.
Chair Ryoichi Shinkuma(Kyoto Univ.) / Hiraku Okada(Nagoya Univ.) / 河口 信夫(名大) / 寺田 努(神戸大)
Vice Chair Shigeaki Tagashira(Kansai Univ.) / Gen Kitagata(Tohoku Univ.) / Shigeki Shiokawa(KAIT) / Jin Nakazawa(Keio Univ.) / Satoru Yamano(NEC) / 深澤 佑介(ドコモ) / 久保 健(KDDI) / 北村 操代(三菱電気)
Secretary Shigeaki Tagashira(Kyushu Univ.) / Gen Kitagata(NTT) / Shigeki Shiokawa(NEC) / Jin Nakazawa(NICT) / Satoru Yamano(Sophia Univ.) / 深澤 佑介(愛知工大) / 久保 健(阪大) / 北村 操代(豊橋技科大) / (NTT)
Assistant Takayuki Nishio(Kyoto Univ.) / Takato Saito(NTT) / Hiroto Aida(Doshisha Univ.) / Tomoyuki Ota(Hiroshima City Univ.) / Tatsuya Kikuzuki(Fujitu Lab.) / Ryo Nakano(HITACHI) / Yoshifumi Hotta(Mitsubishi Electric)

Paper Information
Registration To Technical Committee on Mobile Network and Applications / Technical Committee on Ambient intelligence and Sensor Networks / Special Interest Group on Mobile Computing and Pervasive Systems / Special Interest Group on Ubiquitous Computing System
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Evaluation of Hand Gesture Annotation in Remote Collaboration Using Mixed Reality
Sub Title (in English)
Keyword(1) Mixed reality
Keyword(2) Smartglasses
Keyword(3) Remote collaboration
Keyword(4) Hand gesture
1st Author's Name Shohei Yamada
1st Author's Affiliation Kogakuin University(Kogakuin Univ.)
2nd Author's Name Naiwala P. Chandrasiri
2nd Author's Affiliation Kogakuin University(Kogakuin Univ.)
Date 2018-02-26
Paper # MoNA2017-63
Volume (vol) vol.117
Number (no) MoNA-450
Page pp.pp.81-85(MoNA),
#Pages 5
Date of Issue 2018-02-19 (MoNA)