| Presentation | 2020-02-27 [Special Talk] Neighbor-Aware Approaches for Pixel Labeling Ryosuke Furuta, Naoto Inoue, Toshihiko Yamasaki, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Pixel labeling is one of the most classical and important problems in the field of computer vision because it has a variety of applications. We tackle two major challenges of pixel labeling: (i) how to deal with the large solution space, and (ii) how to learn the relationships between neighbor labels effectively. For the first challenge, we present two neighbor-aware fast optimization methods. One is the fast optimization method for general pixel-labeling problems based on Markov random field (MRF) models where the smoothness between the neighbor labels is forced. The other is the fast optimization method for the special case of pixel-labeling problems where the neighbor labels are forced to be connected. For the second challenge, we present two novel neighbor-aware learning methods that boost the performance of pixel labeling. Based on the mathematical relationship between the fixed point iteration of dense conditional random field (CRF) and recurrent convolution, we present a new model based on dense CRF, which automatically learns the relationships between neighbor labels from training data and enables joint training with deep neural networks. In addition, we present a novel problem setting (pixelRL), and an effective neighbor-aware learning method for pixelRL named reward map convolution. PixelRL is a novel pixel-labeling problem combined with reinforcement learning, where the label is a sequence of actions at each pixel, and its objective is to maximize the accumulated total rewards at all pixels. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Pixel labeling / Markov random field / conditional random field / reinforcement learning |
| Paper # | ITS2019-45,IE2019-83 |
| Date of Issue | 2020-02-20 (ITS, IE) |
| Conference Information | |
| Committee | ITE-HI / IE / ITS / ITE-MMS / ITE-ME / ITE-AIT |
|---|---|
| Conference Date | 2020/2/27(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Hokkaido Univ. |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Image Processing, etc. |
| Chair | Takehiro Nagai(Tokyo Inst. of Tech.) / / / Norihiko Ishii(NHK) / Norio Tagawa(Tokyo Metropolitan Univ.) / Nobuhiko Mukai(Tokyo Cisy Univ.) |
| Vice Chair | / / / / Hiroyuki Arai(Nippon Institute of Technology) / Hisaki Nate(Tokyo Polytechnic Univ.) |
| Secretary | (NTT) / / / (Fukuoka Univ.) / Hiroyuki Arai(NHK) / Hisaki Nate(NHK) |
| Assistant | |
| Paper Information | |
| Registration To | Technical Group on Human Inormation / Technical Committee on Image Engineering / Technical Committee on Intelligent Transport Systems Technology / Technical Group on Multi-media Storage / Technical Group on Media Engineering / Technical Group on Artistic Image Technology |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Special Talk] Neighbor-Aware Approaches for Pixel Labeling |
| Sub Title (in English) | |
| Keyword(1) | Pixel labeling |
| Keyword(2) | Markov random field |
| Keyword(3) | conditional random field |
| Keyword(4) | reinforcement learning |
| 1st Author's Name | Ryosuke Furuta |
| 1st Author's Affiliation | Tokyo University of Science(TUS) |
| 2nd Author's Name | Naoto Inoue |
| 2nd Author's Affiliation | The University of Tokyo(UT) |
| 3rd Author's Name | Toshihiko Yamasaki |
| 3rd Author's Affiliation | The University of Tokyo(UT) |
| Date | 2020-02-27 |
| Paper # | ITS2019-45,IE2019-83 |
| Volume (vol) | vol.119 |
| Number (no) | ITS-421,IE-422 |
| Page | pp.pp.239-239(ITS), pp.239-239(IE), |
| #Pages | 1 |
| Date of Issue | 2020-02-20 (ITS, IE) |