| Presentation | 2024-03-13 A study on reproduction of specular reflection using NeRF in dimished reality for AR marker hiding Issa Narutomi, Norihiko Kawai, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In games using AR markers, the markers are recognized and 3DCG is synthesized and presented accordingly. However, if the AR markers remain visible, the game does not look good. The problem can be solved by using Diminished Reality (DR), which visually removes AR markers from the real-time image and show the background without. However, conventional methods of diminished reality have difficulties with dealing with areas containing local luminance changes such as specular reflections. In this study, we propose a method for marker hiding that can handle specular reflections by using Neural Radiance Fields (NeRF), which generates free viewpoint images from a set of 2D images, to synthesize a texture in the marker region that reproduces the appearance of specular reflections according to the current camera position in AR. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | AR marker / Specular reflection / NeRF / Diminished reality / Loss function |
| Paper # | IMQ2023-20,IE2023-75,MVE2023-49 |
| Date of Issue | 2024-03-06 (IMQ, IE, MVE) |
| Conference Information | |
| Committee | IE / MVE / CQ / IMQ |
|---|---|
| Conference Date | 2024/3/13(3days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Okinawa Sangyo Shien Center |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Media of five senses, Multimedia, Media experience, Picture codinge, Image media quality, Network,quality and reliability, etc（AC） |
| Chair | Hiroyuki Bandoh(NTT) / Kiyoshi Kiyokawa(NAIST) / Takefumi Hiraguri(Nippon Inst. of Tech.) / Hiroaki Kudo(Nagoya Univ.) |
| Vice Chair | Yuichi Tanaka(Osaka Univ.) / Toshihiko Yamazaki(Univ. of Tokyo) / Sumaru Niida(KDDI Research) / Takahiro Matsuda(Tokyo Metropolitan Univ.) / Gou Hasegawa(Tohoku Univ.) / Sumaru Niida(KDDI Research) / Gosuke Ohashi(Shizuka Univ.) |
| Secretary | Yuichi Tanaka(NHK) / Toshihiko Yamazaki(Tottori Univ.) / Sumaru Niida(Otsuma Women's Univ.) / Takahiro Matsuda(DNP) / Gou Hasegawa(NTT) / Sumaru Niida(NTT) / Gosuke Ohashi(Tama Univ.) |
| Assistant | Kazunori Uruma(Kogakuin Univ.) / Shinobu Kudo(KDDI Research) / Hidehiko Shishido(Univ. of Tsukuba) / Atsushi Nakazawa(Kyoto Univ.) / Naoya Tojo(KDDI Research) / Naoki Hagiyama(NTT) / Yuji Tatada(Univ. of Tokyo) / Ryo Nakamura(Fukuoka Univ.) / Toshiro Nakahira(NTT) / Kenta Tsukatsune(Okayama Univ. of Science) / Kuniharu Imai(Nagoya Univ.) / Takashi Yamazoe(Seikei Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Image Engineering / Technical Committee on Media Experience and Virtual Environment / Technical Committee on Communication Quality / Technical Committee on Image Media Quality |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A study on reproduction of specular reflection using NeRF in dimished reality for AR marker hiding |
| Sub Title (in English) | |
| Keyword(1) | AR marker |
| Keyword(2) | Specular reflection |
| Keyword(3) | NeRF |
| Keyword(4) | Diminished reality |
| Keyword(5) | Loss function |
| 1st Author's Name | Issa Narutomi |
| 1st Author's Affiliation | Osaka Institute of Technology(OIT) |
| 2nd Author's Name | Norihiko Kawai |
| 2nd Author's Affiliation | Osaka Institute of Technology(OIT) |
| Date | 2024-03-13 |
| Paper # | IMQ2023-20,IE2023-75,MVE2023-49 |
| Volume (vol) | vol.123 |
| Number (no) | IMQ-430,IE-432,MVE-433 |
| Page | pp.pp.41-44(IMQ), pp.41-44(IE), pp.41-44(MVE), |
| #Pages | 4 |
| Date of Issue | 2024-03-06 (IMQ, IE, MVE) |