Presentation 2020-03-05
3D pose estimation using OpenPose and depth data for endoscope operation analysis
Yuki Abe, Katsuya Kondo, Kazu Mishiba, Tomohiro Shimoda, Masashi Fujii, Kazutake Uehara, Masaru Ueki,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) This report relates to a method for accurately extracting key points of 3dimensional(3D) posture of an operator when analyzing 3D motion from an endoscope operation video captured by a single camera. In particular, we verify whether the motion analysis of the endoscope operation can be performed by a single camera capture system. In 3D pose estimating by only 2D pose estimation(OpenPose), erroneous estimate occurs. We propose a method that estimates the motion of the endoscope operation together with OpenPose after the depth data estimated from 2D image. Experimental results show that important key points of posture can be effectively estimated by the proposed method, and it is useful for analyzing the motion of endoscope operation.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) endoscope operation / pose estimation / motion analysis / OpenPose / 3d-pose-baseline
Paper # SIS2019-46
Date of Issue 2020-02-27 (SIS)

Conference Information
Committee SIS
Conference Date 2020/3/5(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Saitama Hall
Topics (in Japanese) (See Japanese page)
Topics (in English) Soft Computing, etc.
Chair Takayuki Nakachi(NTT)
Vice Chair Noriaki Suetake(Yamaguchi Univ.) / Tomoaki Kimura(Kanagawa Inst. of Tech.)
Secretary Noriaki Suetake(Tokyo Metropolitan Univ.) / Tomoaki Kimura(Kindai Univ.)
Assistant Hideaki Misawa(National Inst. of Tech., Ube College) / Yukihiro Bandoh(NTT)

Paper Information
Registration To Technical Committee on Smart Info-Media Systems
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) 3D pose estimation using OpenPose and depth data for endoscope operation analysis
Sub Title (in English)
Keyword(1) endoscope operation
Keyword(2) pose estimation
Keyword(3) motion analysis
Keyword(4) OpenPose
Keyword(5) 3d-pose-baseline
1st Author's Name Yuki Abe
1st Author's Affiliation Tottori University Faculty of Engineering(Tottori Univ. Eng.)
2nd Author's Name Katsuya Kondo
2nd Author's Affiliation Tottori University Faculty of Engineering(Tottori Univ. Eng.)
3rd Author's Name Kazu Mishiba
3rd Author's Affiliation Tottori University Faculty of Engineering(Tottori Univ. Eng.)
4th Author's Name Tomohiro Shimoda
4th Author's Affiliation MICOTO Technology Inc.(MICOTO Tech.)
5th Author's Name Masashi Fujii
5th Author's Affiliation Tottori University Hospital(Tottori Univ. Hospital)
6th Author's Name Kazutake Uehara
6th Author's Affiliation Tottori University Hospital(Tottori Univ. Hospital)
7th Author's Name Masaru Ueki
7th Author's Affiliation Tottori University Faculty of Medicine(Tottori Univ. Med.)
Date 2020-03-05
Paper # SIS2019-46
Volume (vol) vol.119
Number (no) SIS-458
Page pp.pp.51-56(SIS),
#Pages 6
Date of Issue 2020-02-27 (SIS)