| Presentation | 2022-12-15 [Short Paper] A transformer based feature-level fusion approach for Audiovisual Depression Prediction Shiyu Teng, Shurong Chai, Jiaqing Liu, Tateyama Tomoko, Xinyin Huang, Yen-wei Chen, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Depression is a prevalent mental ailment that causes many diseases all over the world. Identification of people with mental illness faces a challenge, as there is no difference between mentally ill people and normal people in physiology, and clinicians can only make a subjective diagnosis according to the relevant information of patients. Hence, it has become imperative to develop automated methods for audiovisual depression prediction. In this study, we proposed an intra- and inter-modality transformer-based fusion model to improve the depression level prediction accuracy. We evaluate our approach on the Chinese Soochow University depressive severity dataset and demonstrate that our method outperforms the existing method. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Depression Prediction / Multi-Modalities / Fusion / Transformer |
| Paper # | PRMU2022-42 |
| Date of Issue | 2022-12-08 (PRMU) |
| Conference Information | |
| Committee | PRMU |
|---|---|
| Conference Date | 2022/12/15(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Toyama International Conference Center |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | Seiichi Uchida(Kyushu Univ.) |
| Vice Chair | Takuya Funatomi(NAIST) / Mitsuru Anpai(Denso IT Lab.) |
| Secretary | Takuya Funatomi(CyberAgent) / Mitsuru Anpai(Univ. of Tokyo) |
| Assistant | Nakamasa Inoue(Tokyo Inst. of Tech.) / Yasutomo Kawanishi(Riken) |
| Paper Information | |
| Registration To | Technical Committee on Pattern Recognition and Media Understanding |
|---|---|
| Language | ENG |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | [Short Paper] A transformer based feature-level fusion approach for Audiovisual Depression Prediction |
| Sub Title (in English) | |
| Keyword(1) | Depression Prediction |
| Keyword(2) | Multi-Modalities |
| Keyword(3) | Fusion |
| Keyword(4) | Transformer |
| 1st Author's Name | Shiyu Teng |
| 1st Author's Affiliation | Ritsumeikan University(Ritsumeikan Univ.) |
| 2nd Author's Name | Shurong Chai |
| 2nd Author's Affiliation | Ritsumeikan University(Ritsumeikan Univ.) |
| 3rd Author's Name | Jiaqing Liu |
| 3rd Author's Affiliation | Ritsumeikan University(Ritsumeikan Univ.) |
| 4th Author's Name | Tateyama Tomoko |
| 4th Author's Affiliation | Fujita Health University(Fujita Health Univ.) |
| 5th Author's Name | Xinyin Huang |
| 5th Author's Affiliation | Soochow University(Soochow Univ.) |
| 6th Author's Name | Yen-wei Chen |
| 6th Author's Affiliation | Ritsumeikan University(Ritsumeikan Univ.) |
| Date | 2022-12-15 |
| Paper # | PRMU2022-42 |
| Volume (vol) | vol.122 |
| Number (no) | PRMU-314 |
| Page | pp.pp.54-56(PRMU), |
| #Pages | 3 |
| Date of Issue | 2022-12-08 (PRMU) |