Presentation 2018-03-18
Toward image inbetweening using Latent Model
Paulino Cristovao, Yusuke Tanimura, Hidemoto Nakada, Hideki Asoh,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Image interpolation is a well known problem in computer vision. Many approaches are restricted to optical flow and convolutional neural network. In this work, we present an alternative approach based on generative models to generate in between images (interpolation) using variational autoencoders (VAE). The goals are: Gener- ate in between images using hidden structures (latent variables), and yield latent features that generalize well. Our architecture composed of three networks (VAE) that share weights. We train the network feeding three continous frames so that the second latent variables become close to the average of the first and third latent variables. To get interporated image from two images, we can just reconstract the image from the avarage of the two images’ latent variables. We evaluate the result by comparing the ground truth image and the generated one to evaluate the in between image. In addition we show the reconstructed images using the same network.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Variational Autoencoder / Machine Learning / Deep Learning
Paper # BioX2017-49,PRMU2017-185
Date of Issue 2018-03-11 (BioX, PRMU)

Conference Information
Committee PRMU / BioX
Conference Date 2018/3/18(2days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Shinichi Sato(NII) / Kazuhiko Sumi(AGU)
Vice Chair Hironobu Fujiyoshi(Chubu Univ.) / Yoshihisa Ijiri(Omron) / Hiroshi Takano(Toyama Pref. Univ.) / Hitoshi Imaoka(NEC)
Secretary Hironobu Fujiyoshi(AIST) / Yoshihisa Ijiri(NAIST) / Hiroshi Takano(Shizuoka Univ.) / Hitoshi Imaoka(Fujitsu Labs.)
Assistant Masato Ishii(NEC) / Yusuke Sugano(Osaka Univ.) / Masatsugu Ichino(Univ. of Electro-Comm.) / Naoyuki Takada(Secom) / Norihiro Okui(KDDI Research)

Paper Information
Registration To Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Biometrics
Language ENG
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Toward image inbetweening using Latent Model
Sub Title (in English)
Keyword(1) Variational Autoencoder
Keyword(2) Machine Learning
Keyword(3) Deep Learning
1st Author's Name Paulino Cristovao
1st Author's Affiliation University of Tsukuba(Univ. of Tsukuba)
2nd Author's Name Yusuke Tanimura
2nd Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
3rd Author's Name Hidemoto Nakada
3rd Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
4th Author's Name Hideki Asoh
4th Author's Affiliation National Institute of Advanced Industrial Science and Technology(AIST)
Date 2018-03-18
Paper # BioX2017-49,PRMU2017-185
Volume (vol) vol.117
Number (no) BioX-513,PRMU-514
Page pp.pp.79-84(BioX), pp.79-84(PRMU),
#Pages 6
Date of Issue 2018-03-11 (BioX, PRMU)