Presentation 2013-03-11
Fundamental Study of Estimating the Light Source Position by Comparing the 3D Reconstruction Obtained from RGB Image with Depth Image
Tomoki Hayashida, Shohei Takahashi, Takeshi Okuya, Jun Ohya, Harumi Kawamura,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) This paper proposes a method for estimating the light source direction from RGB image and Depth image (K-D image), which can be acquired by Kinect sensor etc. The proposed method utilizes the property that the 3D reconstructed result, which is obtained by converting the RGB image to gray-level image and then converting that gray-level image to depth image (D-D image) by Khan et al. 's method based on "Deep is dark paradigm", is deformed to the light source direction. The value difference at each pixel of the D-D image and K-D image is obtained, and that pixel's surface normal is computed from the K-D image. In the 2D space defined by the two angle parameters that represent the surface normal's direction, each pixel's difiFerence is added to the cell that corresponds to that pixel's normal's direction. After this process is performed for all the pixels, the light source direction is determined based on the peak in the parameter space. Experiments using some diflferent objects under different light source directions were performed. Promising results were obtained.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Light Estimation / 3D Reconstruction / Augmented reality / image compisition
Paper # IMQ2012-60,IE2012-164,MVE2012-121,WIT2012-70
Date of Issue

Conference Information
Committee MVE
Conference Date 2013/3/4(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Media Experience and Virtual Environment (MVE)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Fundamental Study of Estimating the Light Source Position by Comparing the 3D Reconstruction Obtained from RGB Image with Depth Image
Sub Title (in English)
Keyword(1) Light Estimation
Keyword(2) 3D Reconstruction
Keyword(3) Augmented reality
Keyword(4) image compisition
1st Author's Name Tomoki Hayashida
1st Author's Affiliation School of Fundamental Science and Engineering, Waseda Univ.()
2nd Author's Name Shohei Takahashi
2nd Author's Affiliation Graduate School of Global Inatformion and Telecommunication Studies, Waseda University
3rd Author's Name Takeshi Okuya
3rd Author's Affiliation Graduate School of Fundamental Science and Engineering, Waseda University
4th Author's Name Jun Ohya
4th Author's Affiliation Graduate School of Global Inatformion and Telecommunication Studies, Waseda University
5th Author's Name Harumi Kawamura
5th Author's Affiliation NTT Media Intelligence Laboratories
Date 2013-03-11
Paper # IMQ2012-60,IE2012-164,MVE2012-121,WIT2012-70
Volume (vol) vol.112
Number (no) 474
Page pp.pp.-
#Pages 6
Date of Issue