| Presentation | 2021-03-02 StyleGAN-based Emotion Transfer for Facial Motions Shiki Takeuchi, Atsushi Nakazawa, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The facial expression, especially its emotion, has a great influence on audiences' impression. With an increasing number of speaking movies such as on-demand lectures and video sharing sites, transferring emotion for facial motion is an applicated valuable technique. Emotion transfer can be regarded as a Style Transfer task. It transfers Style: marginal information while preserving Content: semantic information. We utilized StyleGANcite{karras2019style} architecture to realize emotion transfer. Facial Motion is represented as a set of facial landmarks. Using facial landmarks' row rank structure, we realize the natural transform of facial motions. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Style Transfer / Emotion Transfer / Facial Expression / Facial Motion / Motion Transfer |
| Paper # | IMQ2020-26,IE2020-66,MVE2020-58 |
| Date of Issue | 2021-02-22 (IMQ, IE, MVE) |
| Conference Information | |
| Committee | MVE / IMQ / IE / CQ |
|---|---|
| Conference Date | 2021/3/1(3days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Masayuki Ihara(NTT) / Toshiya Nakaguchi(Chiba Univ.) / Hideaki Kimata(NTT) / Hideyuki Shimonishi(NEC) |
| Vice Chair | Kiyoshi Kiyokawa(NAIST) / Mitsuru Maeda(Canon) / Kenya Uomori(Osaka Univ.) / Kazuya Kodama(NII) / Keita Takahashi(Nagoya Univ.) / Jun Okamoto(NTT) / Takefumi Hiraguri(Nippon Inst. of Tech.) |
| Secretary | Kiyoshi Kiyokawa(Oosaka Inst. of Tech.) / Mitsuru Maeda(NTT) / Kenya Uomori(Univ. of ToKyo) / Kazuya Kodama(Shizuoka Univ.) / Keita Takahashi(Sony Semiconductor Solutions) / Jun Okamoto(KDDI Research) / Takefumi Hiraguri(Nagoya Inst. of Tech.) |
| Assistant | Naoya Isoyama(NAIST) / Takenori Hara(DNP) / Mitsuhiro Goto(NTT) / Hiroaki Kudo(Nagoya Univ.) / Masaru Tsuchida(NTT) / Keita Hirai(Chiba Univ.) / Shunsuke Iwamura(NHK) / Shinobu Kudo(NTT) / Yoshiaki Nishikawa(NEC) / Takuto Kimura(NTT) / Ryoichi Kataoka(KDDI Research) |
| Paper Information | |
| Registration To | Technical Committee on Media Experience and Virtual Environment / Technical Committee on Image Media Quality / Technical Committee on Image Engineering / Technical Committee on Communication Quality |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | StyleGAN-based Emotion Transfer for Facial Motions |
| Sub Title (in English) | |
| Keyword(1) | Style Transfer |
| Keyword(2) | Emotion Transfer |
| Keyword(3) | Facial Expression |
| Keyword(4) | Facial Motion |
| Keyword(5) | Motion Transfer |
| Keyword(6) | |
| 1st Author's Name | Shiki Takeuchi |
| 1st Author's Affiliation | Kyoto University(Kyoto Univ.) |
| 2nd Author's Name | Atsushi Nakazawa |
| 2nd Author's Affiliation | Kyoto University(Kyoto Univ.) |
| Date | 2021-03-02 |
| Paper # | IMQ2020-26,IE2020-66,MVE2020-58 |
| Volume (vol) | vol.120 |
| Number (no) | IMQ-389,IE-390,MVE-391 |
| Page | pp.pp.76-81(IMQ), pp.76-81(IE), pp.76-81(MVE), |
| #Pages | 6 |
| Date of Issue | 2021-02-22 (IMQ, IE, MVE) |