Presentation 2022-07-09
CT Volume Registration on X Ray Image Using 3D Reconstruction Network
Pragyan Shrestha, Chun Xie, Hidehiko Shishido, Yuichi Yoshii, Itaru Kitahara,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In this research, we propose a novel method for registering X-ray images to CT volumes by reconstructing 3D point clouds and 2D image point matches. Previous methods have utilized mutual information and correlation as the distance function for comparing digitally reconstructed radiographs with target X-ray image for registration. These methods require good initial pose estimates otherwise the optimization would result in local minima. In order to obtain an automatic registration pipeline, we utilize 3D reconstruction network and traditional camera estimation techniques using dense 2D-3D correspondences.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) 2D-3D Registration / Deep learning / 3D reconstruction / Camera pose estimation / PnP / ICP
Paper # MI2022-48
Date of Issue 2022-07-01 (MI)

Conference Information
Committee MI
Conference Date 2022/7/8(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English) Medical imaging, recoginition, etc.
Chair Hidekata Hontani(Nagoya Inst. of Tech.)
Vice Chair Hideaki Haneishi(Chiba Univ.) / Takayuki Kitasaka(Aichi Inst. of Tech.)
Secretary Hideaki Haneishi(Yamaguchi Univ.) / Takayuki Kitasaka(Univ. of Hyogo)
Assistant Takeshi Hara(Gifu Univ.) / Yoshito Otake(NAIST)

Paper Information
Registration To Technical Committee on Medical Imaging
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) CT Volume Registration on X Ray Image Using 3D Reconstruction Network
Sub Title (in English)
Keyword(1) 2D-3D Registration
Keyword(2) Deep learning
Keyword(3) 3D reconstruction
Keyword(4) Camera pose estimation
Keyword(5) PnP
Keyword(6) ICP
1st Author's Name Pragyan Shrestha
1st Author's Affiliation University of Tsukuba(Univ. of Tsukuba)
2nd Author's Name Chun Xie
2nd Author's Affiliation University of Tsukuba(Univ. of Tsukuba)
3rd Author's Name Hidehiko Shishido
3rd Author's Affiliation University of Tsukuba(Univ. of Tsukuba)
4th Author's Name Yuichi Yoshii
4th Author's Affiliation Tokyo Medical University(Tokyo Medical Univ.)
5th Author's Name Itaru Kitahara
5th Author's Affiliation University of Tsukuba(Univ. of Tsukuba)
Date 2022-07-09
Paper # MI2022-48
Volume (vol) vol.122
Number (no) MI-98
Page pp.pp.61-65(MI),
#Pages 5
Date of Issue 2022-07-01 (MI)