| Presentation | 2024-01-25 Multi-modal Model Yugo Kubota, Seiichi Uchida, Daichi Haraguchi, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | This study aims to verify whether a model based on CLIP (Contrastive Language-Image Pretraining) can associate the image properties of a font with its impression. CLIP embeds images and text into the shared latent space and thus associates both modalities together. In this study, we attempted to associate the shape of a font with its impression by using a vocabulary of impressions and shapes (impression words) assigned to the font as text. In the experiment, we evaluated the accuracy of font retrieval using each impression word as a query. As a result, we confirmed that these are impression words that clearly correspond to font shape and that do not. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | |
| Paper # | PRMU2023-43 |
| Date of Issue | 2024-01-18 (PRMU) |
| Conference Information | |
| Committee | PRMU / MVE / VRSJ-SIG-MR / IPSJ-CVIM |
|---|---|
| Conference Date | 2024/1/25(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Keio Univ. (Hiyoshi Campus) |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Kunio Kashio(NTT) / Kiyoshi Kiyokawa(NAIST) / / 日浦 慎作(兵庫県立大) |
| Vice Chair | Takuya Funatomi(NAIST) / Go Irie(Tokyo Univ. of Science) / Sumaru Niida(KDDI Research) |
| Secretary | Takuya Funatomi(Tokyo Inst. of Tech.) / Go Irie(Riken) / Sumaru Niida(Otsuma Women's University) / (DNP) / (Kyushu Univ.) |
| Assistant | Kei Shimonishi(Kyoto Univ.) / Kensho Hara(AIST) / Hidehiko Shishido(Soka University) / Atsushi Nakazawa(Kyoto Univ.) / Naoya Tojo(KDDI Research) / Naoki Hagiyama(NTT) / Yuji Tatada(Univ. of Tokyo) |
| Paper Information | |
| Registration To | Technical Committee on Pattern Recognition and Media Understanding / Technical Committee on Media Experience and Virtual Environment / SIG-MR / Special Interest Group on Computer Vision and Image Media |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Multi-modal Model |
| Sub Title (in English) | |
| Keyword(1) | |
| Keyword(2) | |
| Keyword(3) | |
| Keyword(4) | |
| 1st Author's Name | Yugo Kubota |
| 1st Author's Affiliation | Kyushu University(Kyushu Univ.) |
| 2nd Author's Name | Seiichi Uchida |
| 2nd Author's Affiliation | Kyushu University(Kyushu Univ.) |
| 3rd Author's Name | Daichi Haraguchi |
| 3rd Author's Affiliation | Kyushu University(Kyushu Univ.) |
| Date | 2024-01-25 |
| Paper # | PRMU2023-43 |
| Volume (vol) | vol.123 |
| Number (no) | PRMU-358 |
| Page | pp.pp.20-25(PRMU), |
| #Pages | 6 |
| Date of Issue | 2024-01-18 (PRMU) |