| Presentation | 2021-03-05 Learning from Synthetic Shadows Naoto Inoue, Toshihiko Yamasaki, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Shadow removal is essential for some downstream tasks in computer vision and computer graphics. Recent shadow removal approaches all train convolutional neural networks (CNN) on real paired shadow/shadow-free/mask image datasets. However, obtaining a large-scale, diverse, and accurate dataset has been a primary challenge. It limits the generalization performance of the learned models on shadow images with unseen shapes/intensities. We present SynShadow, a novel large-scale synthetic shadow/shadow-free/matte image triplets dataset and a pipeline to synthesize it to tackle this challenge. We extend a physically-grounded shadow illumination model and synthesize a shadow image given an arbitrary combination of a shadow-free image, a matte image, and shadow attenuation parameters. This pipeline enables us to sample a countless number of the triplets. SynShadow offers a dataset with high fidelity and diversity. We demonstrate that shadow removal models trained on SynShadow perform favorably in removing shadows with various shapes and intensities. Furthermore, we show that simply fine-tuning from a SynShadow-pre-trained model improves existing shadow detection and removal models. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | shadow removalshadow detectionCNN |
| Paper # | PRMU2020-92 |
| Date of Issue | 2021-02-25 (PRMU) |
| Conference Information | |
| Committee | PRMU / IPSJ-CVIM |
|---|---|
| Conference Date | 2021/3/4(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Computer Vision and Pattern Recognition for specific environment |
| Chair | Yoichi Sato(Univ. of Tokyo) |
| Vice Chair | Akisato Kimura(NTT) / Masakazu Iwamura(Osaka Pref. Univ.) |
| Secretary | Akisato Kimura(Mobility Technologies) / Masakazu Iwamura(Chubu Univ.) |
| Assistant | Takashi Shibata(NTT) / Masashi Nishiyama(Tottori Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Pattern Recognition and Media Understanding / Special Interest Group on Computer Vision and Image Media |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Learning from Synthetic Shadows |
| Sub Title (in English) | |
| Keyword(1) | shadow removalshadow detectionCNN |
| 1st Author's Name | Naoto Inoue |
| 1st Author's Affiliation | The University of Tokyo(UTokyo) |
| 2nd Author's Name | Toshihiko Yamasaki |
| 2nd Author's Affiliation | The University of Tokyo(UTokyo) |
| Date | 2021-03-05 |
| Paper # | PRMU2020-92 |
| Volume (vol) | vol.120 |
| Number (no) | PRMU-409 |
| Page | pp.pp.133-138(PRMU), |
| #Pages | 6 |
| Date of Issue | 2021-02-25 (PRMU) |