Paper Abstract and Keywords |
Presentation |
2022-01-24 11:35
4D light field compression based on view interpolation using multi-focus images Shuho Umebayashi (TUS/NII), Kazuya Kodama (NII), Takayuki Hamamoto (TUS) IE2021-28 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Light field reproduction by 3D reconstruction using multi-view videos has been widely developed. For example, while such multi-view videos consist of enormous data due to the increase of viewpoints, various efficient methods for light field compression as extension of video coding are being studied. Actually, model-based or deep-learning-based view interpolation is often introduced into such compression methods because it leads to high efficiency by predicting dense light fields from reduced data of sparse multi-view images. On the other hand, a method of reconstructing dense light fields via multi-focus images synthesized from only sparse multi-view images is successfully derived as a kind of view interpolation by our proposed 3D frequency analysis. In this paper, we study a method of 4D light field compression based on our view interpolation using multi-focus images. We selectively encode some of multi-view images to reconstruct dense light fields via multi-focus images synthesized from only them, where appropriate 2D filters work for such prediction. At any bit-rates, the number of selected viewpoints is determined for effectively improving prediction quality, while they are used as reference views to correct the reconstruction based on block matching. We show experimental results by using real multi-view images, and compression quality of our novel method is compared to that of a deep-learning-based method and our previous method without view interpolation for analyzing characteristics of its performance. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
light field / multi-view / multi-focus / encoding / compression / / / |
Reference Info. |
IEICE Tech. Rep., vol. 121, no. 346, IE2021-28, pp. 5-8, Jan. 2022. |
Paper # |
IE2021-28 |
Date of Issue |
2022-01-17 (IE) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
IE2021-28 |
Conference Information |
Committee |
IE |
Conference Date |
2022-01-24 - 2022-01-24 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
National Institute of Informatics |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Image Processing, Image Coding, etc. |
Paper Information |
Registration To |
IE |
Conference Code |
2022-01-IE |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
4D light field compression based on view interpolation using multi-focus images |
Sub Title (in English) |
|
Keyword(1) |
light field |
Keyword(2) |
multi-view |
Keyword(3) |
multi-focus |
Keyword(4) |
encoding |
Keyword(5) |
compression |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Shuho Umebayashi |
1st Author's Affiliation |
Tokyo University of Science/National Institute of Informatics, (TUS/NII) |
2nd Author's Name |
Kazuya Kodama |
2nd Author's Affiliation |
National Institute of Informatics, (NII) |
3rd Author's Name |
Takayuki Hamamoto |
3rd Author's Affiliation |
Tokyo University of Science/National Institute of Informatics, (TUS) |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2022-01-24 11:35:00 |
Presentation Time |
25 minutes |
Registration for |
IE |
Paper # |
IE2021-28 |
Volume (vol) |
vol.121 |
Number (no) |
no.346 |
Page |
pp.5-8 |
#Pages |
4 |
Date of Issue |
2022-01-17 (IE) |
|