| Presentation | 2020-12-02 Error Probability of Classification Based on the Analysis of the Bayes Code Shota Saito, Toshiyasu Matsushima, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Suppose that we have two training sequences generated by parametrized distributions $P_{theta^*}$ and $P_{xi^*}$, where $theta^*$ and $xi^*$ are unknown true parameters. Given training sequences, we study the problem of classifying whether a test sequence was generated according to $P_{theta^*}$ or $P_{xi^*}$. This problem can be thought of as a hypothesis testing problem and our aim is to analyze the weighted sum of type-I and type-II error probabilities. Utilizing the analysis of the codeword lengths of the Bayes code, our previous study derived more refined bounds on the error probability than known previously. However, our previous study had the following deficiencies: i) the prior distributions of $theta$ and $xi$ are the same; ii) the prior distributions of two hypotheses are uniform; iii) the tightness of the upper and lower bounds were not clear. This study solves these problems. We remove the restrictions i) and ii) and derive more general results than obtained previously. To deal with the problem iii), we perform numerical calculation for a concrete model. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Bayes code / Chernoff information / hypothesis testing / statistical classification problem |
| Paper # | IT2020-32 |
| Date of Issue | 2020-11-24 (IT) |
| Conference Information | |
| Committee | IT |
|---|---|
| Conference Date | 2020/12/1(3days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Lectures for Young Researchers, General |
| Chair | Tadashi Wadayama(Nagoya Inst. of Tech.) |
| Vice Chair | Tetsuya Kojima(Tokyo Kosen) |
| Secretary | Tetsuya Kojima(Yamaguchi Univ.) |
| Assistant | Takahiro Ohta(Senshu Univ.) |
| Paper Information | |
| Registration To | Technical Committee on Information Theory |
|---|---|
| Language | ENG-JTITLE |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Error Probability of Classification Based on the Analysis of the Bayes Code |
| Sub Title (in English) | Extension and Example |
| Keyword(1) | Bayes code |
| Keyword(2) | Chernoff information |
| Keyword(3) | hypothesis testing |
| Keyword(4) | statistical classification problem |
| 1st Author's Name | Shota Saito |
| 1st Author's Affiliation | Waseda University(Waseda Univ.) |
| 2nd Author's Name | Toshiyasu Matsushima |
| 2nd Author's Affiliation | Waseda University(Waseda Univ.) |
| Date | 2020-12-02 |
| Paper # | IT2020-32 |
| Volume (vol) | vol.120 |
| Number (no) | IT-268 |
| Page | pp.pp.44-49(IT), |
| #Pages | 6 |
| Date of Issue | 2020-11-24 (IT) |