Presentation 2022-03-10
Diminished reality that combines observation and inpainting based methods
Taiki Kato, Naoya Isoyama, Norihiko Kawai, Hideaki Uchiyama, Nobuchika Sakata, Kiyoshi Kiyokawa,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In contrast to Augmented Reality (AR), which visually adds objects to the real world, there is a technology called Diminished Reality (DR), which hides or erases visually unnecessary objects or allows obstructive objects to pass through. DR technologies are mainly divided into observation and inpainting types. The observation type complements the image by using color information observed in the past, while the inpainting type complements the image by inferring the area to be erased from the surrounding pixels. In this study, in order to combine the advantages of the observation type and the inpainting type, we use a depth camera to specify the area to be erased in three dimensions, and complement the area where the depth is obtained by moving the camera device with the observation type. In this paper, we propose a method to switch from the inpainting type to the observation type by moving the camera device, and the completion by the inpainting type is performed in the area where the depth cannot be acquired by the camera device.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Diminished Reality / Mixed Reality / Image Inpainting / Computer Graphics
Paper # IMQ2021-47,IE2021-109,MVE2021-76
Date of Issue 2022-03-02 (IMQ, IE, MVE)

Conference Information
Committee CQ / IMQ / MVE / IE
Conference Date 2022/3/9(3days)
Place (in Japanese) (See Japanese page)
Place (in English) Online (Zoom)
Topics (in Japanese) (See Japanese page)
Topics (in English) Media of five senses, Multimedia, Media experience, Picture codinge, Image media quality, Network,quality and reliability, etc
Chair Jun Okamoto(NTT) / Kenya Uomori(Osaka Univ.) / Masayuki Ihara(RIKEN) / Kazuya Kodama(NII)
Vice Chair Takefumi Hiraguri(Nippon Inst. of Tech.) / Gou Hasegawa(Tohoku Univ.) / Mitsuru Maeda(Canon) / Kiyoshi Kiyokawa(NAIST) / Hiroyuki Bandoh(NTT) / Toshihiko Yamazaki(Univ. of Tokyo)
Secretary Takefumi Hiraguri(NTT) / Gou Hasegawa(Ritsumeikan Univ.) / Mitsuru Maeda(Nagoya Univ.) / Kiyoshi Kiyokawa(NTT) / Hiroyuki Bandoh(Oosaka Inst. of Tech.) / Toshihiko Yamazaki(NTT)
Assistant Yoshiaki Nishikawa(NEC) / Ryoichi Kataoka(KDDI Research) / Kimiko Kawashima(NTT) / Masato Tsukada(NEC) / Takashi Yamazoe(Seikei Univ.) / Naoya Isoyama(NAIST) / Takenori Hara(DNP) / Mitsuhiro Goto(NTT) / Shunsuke Iwamura(NHK) / Shinobu Kudo(NTT)

Paper Information
Registration To Technical Committee on Communication Quality / Technical Committee on Image Media Quality / Technical Committee on Media Experience and Virtual Environment / Technical Committee on Image Engineering
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Diminished reality that combines observation and inpainting based methods
Sub Title (in English)
Keyword(1) Diminished Reality
Keyword(2) Mixed Reality
Keyword(3) Image Inpainting
Keyword(4) Computer Graphics
1st Author's Name Taiki Kato
1st Author's Affiliation Nara Institute of Science and Technology(Naist)
2nd Author's Name Naoya Isoyama
2nd Author's Affiliation Nara Institute of Science and Technology(Naist)
3rd Author's Name Norihiko Kawai
3rd Author's Affiliation Osaka Institute of Technology(Oit)
4th Author's Name Hideaki Uchiyama
4th Author's Affiliation Nara Institute of Science and Technology(Naist)
5th Author's Name Nobuchika Sakata
5th Author's Affiliation Ryukoku University(Ryukoku Univ.)
6th Author's Name Kiyoshi Kiyokawa
6th Author's Affiliation Nara Institute of Science and Technology(Naist)
Date 2022-03-10
Paper # IMQ2021-47,IE2021-109,MVE2021-76
Volume (vol) vol.121
Number (no) IMQ-420,IE-422,MVE-423
Page pp.pp.193-198(IMQ), pp.193-198(IE), pp.193-198(MVE),
#Pages 6
Date of Issue 2022-03-02 (IMQ, IE, MVE)