| Presentation | 2017-09-16 [Invited Talk] Transportation aspect of deep neural network Sho Sonoda, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | What is happening in deep neural networks? In this talk, we formulate them as transport maps. From the transportation viewpoint, we can identify a deep neural network with trajectories on both the Euclidean and Wasserstein spaces. We derive the transport map of denoising autoencoders (DAEs) in an analytic form. We can understand that what deep networks do is to transport mass to decrease a certain potential functional of the data distribution. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | deep neural network / transport map / continuity equation / Wasserstein gradient flow / denoising autoencoder |
| Paper # | PRMU2017-60,IBISML2017-32 |
| Date of Issue | 2017-09-08 (PRMU, IBISML) |
| Conference Information | |
| Committee | PRMU / IBISML / IPSJ-CVIM |
|---|---|
| Conference Date | 2017/9/15(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Shinichi Sato(NII) / Kenji Fukumizu(ISM) |
| Vice Chair | Hironobu Fujiyoshi(Chubu Univ.) / Yoshihisa Ijiri(Omron) / Masashi Sugiyama(Univ. of Tokyo) |
| Secretary | Hironobu Fujiyoshi(AIST) / Yoshihisa Ijiri(NAIST) / Masashi Sugiyama(Kyoto Univ.) / (Univ. of Tokyo) |
| Assistant | Masato Ishii(NEC) / Yusuke Sugano(Osaka Univ.) / Ichiro Takeuchi(Nagoya Inst. of Tech.) / Toshihiro Kamishima(AIST) |
| Paper Information | |
| Registration To | Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Infomation-Based Induction Sciences and Machine Learning / Special Interest Group on Computer Vision and Image Media |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Invited Talk] Transportation aspect of deep neural network |
| Sub Title (in English) | |
| Keyword(1) | deep neural network |
| Keyword(2) | transport map |
| Keyword(3) | continuity equation |
| Keyword(4) | Wasserstein gradient flow |
| Keyword(5) | denoising autoencoder |
| 1st Author's Name | Sho Sonoda |
| 1st Author's Affiliation | Waseda University(Waseda Univ.) |
| Date | 2017-09-16 |
| Paper # | PRMU2017-60,IBISML2017-32 |
| Volume (vol) | vol.117 |
| Number (no) | PRMU-210,IBISML-211 |
| Page | pp.pp.185-188(PRMU), pp.185-188(IBISML), |
| #Pages | 4 |
| Date of Issue | 2017-09-08 (PRMU, IBISML) |