| Presentation | 2023-11-11 Uncertainty Estimation in Neural Automatic Scoring Applying Multitask Learning of Regression and Classification Yuto Takahashi, Masaki Uto, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In writing tests, grading by humans can be expensive and is not always sufficiently accurate. To resolve this problem, automatic scoring methods have attracted much attention. In recent years, approaches rooted in deep learning have attained notably high accuracy. However, the possibility of errors produced by an automatic scoring system cannot be eliminated, and this hinders the practical application of automatic scoring. One conventional solution to this problem is to estimate uncertainty in the automatic scoring model's predictions to detect prediction errors. In this study, we introduce a novel automatic scoring model based on deep learning which predict score and estimate uncertainty to improve both score accuracy and uncertainty estimation performance. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Writing tests / automatic scoring / deep neural networks / multi-task learning / natural language processing |
| Paper # | ET2023-31 |
| Date of Issue | 2023-11-04 (ET) |
| Conference Information | |
| Committee | ET |
|---|---|
| Conference Date | 2023/11/11(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kagawa University Saiwai-cho (Main) Campus / Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Sessions for Young Researchers (Young Researcher Awards Selection), etc. |
| Chair | Tomoko Kojiri(Kansai Univ.) |
| Vice Chair | Hisayoshi Kunimune(Chiba Inst. of Tech.) |
| Secretary | Hisayoshi Kunimune(Mejiro Univ.) |
| Assistant | Kazuaki Yoshihara(Kinki Univ.) / Kazuhiro Ura(Ehime Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Educational Technology |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Uncertainty Estimation in Neural Automatic Scoring Applying Multitask Learning of Regression and Classification |
| Sub Title (in English) | |
| Keyword(1) | Writing tests |
| Keyword(2) | automatic scoring |
| Keyword(3) | deep neural networks |
| Keyword(4) | multi-task learning |
| Keyword(5) | natural language processing |
| 1st Author's Name | Yuto Takahashi |
| 1st Author's Affiliation | University of Electro-Communications(UEC) |
| 2nd Author's Name | Masaki Uto |
| 2nd Author's Affiliation | University of Electro-Communications(UEC) |
| Date | 2023-11-11 |
| Paper # | ET2023-31 |
| Volume (vol) | vol.123 |
| Number (no) | ET-254 |
| Page | pp.pp.40-46(ET), |
| #Pages | 7 |
| Date of Issue | 2023-11-04 (ET) |