| Presentation | 2022-10-06 Estimation of out-of-view attention region Koki Hara, AtsuShi Nakazawa, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Gazing behavior is one of the most important elements of human attention to the outward things. The study of saliency estimation using machine learning is to estimate the location of attention in a given image or video. On the other hand, in daily life, people's attention is not necessarily limited to the field of view, but may shift to the surrounding areas depending on the situation. If such function can be realized by machine learning, etc., it will be possible to predict important information located outside of the input video. To realize this function, we studied an algorithm for estimating the gaze area of an entire egocentric video image from only the central part of the image. We implemented the algorithm for estimating the gaze area including outside of the image from the DR(eye)VE video + gaze point dataset, using only the central part video as input. We implemented two networks using only RGB images and using both RGB images and optical flow as input, and compared them with a conventional method (SP Module). The results show that the proposed method with only RGB images as input has the best results with an average accuracy of 0.957 ($F$-1 = 0.846). This confirms that the proposed method can predict gaze behavior including outside of the image from the image features of the central area only. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | gaze estimation / egocentric video / active vision |
| Paper # | MVE2022-18 |
| Date of Issue | 2022-09-29 (MVE) |
| Conference Information | |
| Committee | MVE / VRSJ-SIG-MR / IPSJ-EC / HI-SIG-DeMO / VRSJ-SIG-CS |
|---|---|
| Conference Date | 2022/10/6(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Kiyoshi Kiyokawa(NAIST) |
| Vice Chair | Sumaru Niida(KDDI Research) |
| Secretary | Sumaru Niida(NAIST) / (DNP) / (Univ. of ToKyo) / (NTT) |
| Assistant | Hidehiko Shishido(Univ. of Tsukuba) / Atsushi Nakazawa(Kyoto Univ.) / Naoya Tojo(KDDI Research) / Naoki Hagiyama(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Media Experience and Virtual Environment / SIG-MR / Special Interest Group on Entertainment Computing / Special Interest Group on De-vice Media Oriented UI / SIG-CS |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Estimation of out-of-view attention region |
| Sub Title (in English) | |
| Keyword(1) | gaze estimation |
| Keyword(2) | egocentric video |
| Keyword(3) | active vision |
| 1st Author's Name | Koki Hara |
| 1st Author's Affiliation | Kyoto Unversity(Kyoto Univ) |
| 2nd Author's Name | AtsuShi Nakazawa |
| 2nd Author's Affiliation | Kyoto Unversity(Kyoto Univ) |
| Date | 2022-10-06 |
| Paper # | MVE2022-18 |
| Volume (vol) | vol.122 |
| Number (no) | MVE-200 |
| Page | pp.pp.1-6(MVE), |
| #Pages | 6 |
| Date of Issue | 2022-09-29 (MVE) |