| Presentation | 2022-01-24 4D light field compression based on view interpolation using multi-focus images Shuho Umebayashi, Kazuya Kodama, Takayuki Hamamoto, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Light field reproduction by 3D reconstruction using multi-view videos has been widely developed. For example, while such multi-view videos consist of enormous data due to the increase of viewpoints, various efficient methods for light field compression as extension of video coding are being studied. Actually, model-based or deep-learning-based view interpolation is often introduced into such compression methods because it leads to high efficiency by predicting dense light fields from reduced data of sparse multi-view images. On the other hand, a method of reconstructing dense light fields via multi-focus images synthesized from only sparse multi-view images is successfully derived as a kind of view interpolation by our proposed 3D frequency analysis. In this paper, we study a method of 4D light field compression based on our view interpolation using multi-focus images. We selectively encode some of multi-view images to reconstruct dense light fields via multi-focus images synthesized from only them, where appropriate 2D filters work for such prediction. At any bit-rates, the number of selected viewpoints is determined for effectively improving prediction quality, while they are used as reference views to correct the reconstruction based on block matching. We show experimental results by using real multi-view images, and compression quality of our novel method is compared to that of a deep-learning-based method and our previous method without view interpolation for analyzing characteristics of its performance. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | light field / multi-view / multi-focus / encoding / compression |
| Paper # | IE2021-28 |
| Date of Issue | 2022-01-17 (IE) |
| Conference Information | |
| Committee | IE |
|---|---|
| Conference Date | 2022/1/24(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | National Institute of Informatics |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Image Processing, Image Coding, etc. |
| Chair | Kazuya Kodama(NII) |
| Vice Chair | Hiroyuki Bandoh(NTT) / Toshihiko Yamazaki(Univ. of Tokyo) |
| Secretary | Hiroyuki Bandoh(KDDI Research) / Toshihiko Yamazaki(Nagoya Inst. of Tech.) |
| Assistant | Shunsuke Iwamura(NHK) / Shinobu Kudo(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Image Engineering |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | 4D light field compression based on view interpolation using multi-focus images |
| Sub Title (in English) | |
| Keyword(1) | light field |
| Keyword(2) | multi-view |
| Keyword(3) | multi-focus |
| Keyword(4) | encoding |
| Keyword(5) | compression |
| 1st Author's Name | Shuho Umebayashi |
| 1st Author's Affiliation | Tokyo University of Science/National Institute of Informatics,(TUS/NII) |
| 2nd Author's Name | Kazuya Kodama |
| 2nd Author's Affiliation | National Institute of Informatics,(NII) |
| 3rd Author's Name | Takayuki Hamamoto |
| 3rd Author's Affiliation | Tokyo University of Science/National Institute of Informatics,(TUS) |
| Date | 2022-01-24 |
| Paper # | IE2021-28 |
| Volume (vol) | vol.121 |
| Number (no) | IE-346 |
| Page | pp.pp.5-8(IE), |
| #Pages | 4 |
| Date of Issue | 2022-01-17 (IE) |