| Presentation | 2021-03-05 Retrieving Interesting Planetary Images based on Captions Hiya Roy, Toshihiko Yamasaki, Tatsuaki Hashimoto, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Planetary images are collected by sophisticated imaging devices onboard the orbiting or roving spacecraft. As the number of acquired images continues to grow exponentially with each ongoing mission, it becomes increasingly difficult to return all the data to Earth because of limited bandwidth between Earth and other planets and planetary bodies through Deep Space Network. In this paper, we aim to solve this problem by developing an onboard image analysis algorithm. We propose an image-text matching algorithm to enhance the onboard analysis capabilities by detecting objects in the observed image and sending only much smaller-sized metadata to Earth that describes the image. The proposed algorithm is also helpful to retrieve images of interest~(images with desired geologic and/or non-geologic features), from a large database based on query text. We use the Mars surface images captured by the navigation camera of NASA’s Mars Science Laboratory (MSL) Curiosity rover for experimental purposes and demonstrate that our method can accurately detect objects on the Mars surface images. Our experimental results also verify that our method can successfully retrieve images of interest, based on textual queries with superior performance (as evidenced by higher R@K value) compared to the state-of-the-art approaches. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Image retrievalObject detectionMars surface images |
| Paper # | PRMU2020-95 |
| Date of Issue | 2021-02-25 (PRMU) |
| Conference Information | |
| Committee | PRMU / IPSJ-CVIM |
|---|---|
| Conference Date | 2021/3/4(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Computer Vision and Pattern Recognition for specific environment |
| Chair | Yoichi Sato(Univ. of Tokyo) |
| Vice Chair | Akisato Kimura(NTT) / Masakazu Iwamura(Osaka Pref. Univ.) |
| Secretary | Akisato Kimura(Mobility Technologies) / Masakazu Iwamura(Chubu Univ.) |
| Assistant | Takashi Shibata(NTT) / Masashi Nishiyama(Tottori Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Pattern Recognition and Media Understanding / Special Interest Group on Computer Vision and Image Media |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Retrieving Interesting Planetary Images based on Captions |
| Sub Title (in English) | |
| Keyword(1) | Image retrievalObject detectionMars surface images |
| 1st Author's Name | Hiya Roy |
| 1st Author's Affiliation | University of Tokyo(UTokyo) |
| 2nd Author's Name | Toshihiko Yamasaki |
| 2nd Author's Affiliation | University of Tokyo(UTokyo) |
| 3rd Author's Name | Tatsuaki Hashimoto |
| 3rd Author's Affiliation | University of Tokyo(UTokyo) |
| Date | 2021-03-05 |
| Paper # | PRMU2020-95 |
| Volume (vol) | vol.120 |
| Number (no) | PRMU-409 |
| Page | pp.pp.151-156(PRMU), |
| #Pages | 6 |
| Date of Issue | 2021-02-25 (PRMU) |