Presentation | 2022-01-21 Meta-Bound for Lower Bounds of Bayes Risk Shota Saito, |
---|---|
PDF Download Page | PDF download Page Link |
Abstract(in Japanese) | (See Japanese page) |
Abstract(in English) | In the parameter estimation problem of statistics and machine learning, information-theoretic lower bounds of the Bayes risk have been investigated. Previous studies prove the lower bound of the Bayes risk differently and characterize the lower bound via different quantities such as the mutual information, the Sibson's $alpha$-mutual information, and $f$-informativity. In this paper, we introduce an inequality called ``meta-bound'' and show that the results of these previous studies can be derived from the meta-bound. |
Keyword(in Japanese) | (See Japanese page) |
Keyword(in English) | Bayes risk / data-processing inequality / $f$-divergence / $g$-divergence / Renyi divergence |
Paper # | IT2021-82,SIP2021-90,RCS2021-250 |
Date of Issue | 2022-01-13 (IT, SIP, RCS) |
Conference Information | |
Committee | RCS / SIP / IT |
---|---|
Conference Date | 2022/1/20(2days) |
Place (in Japanese) | (See Japanese page) |
Place (in English) | Online |
Topics (in Japanese) | (See Japanese page) |
Topics (in English) | |
Chair | Eiji Okamoto(Nagoya Inst. of Tech.) / Yukihiro Bandou(NTT) / Tadashi Wadayama(Nagoya Inst. of Tech.) |
Vice Chair | Toshihiko Nishimura(Hokkaido Univ.) / Tomoya Tandai(Toshiba) / Fumihide Kojima(NICT) / Toshihisa Tanaka(Tokyo Univ. Agri.&Tech.) / Takayuki Nakachi(Ryukyu Univ.) / Tetsuya Kojima(Tokyo Kosen) |
Secretary | Toshihiko Nishimura(NEC) / Tomoya Tandai(Panasonic) / Fumihide Kojima(Xiaomi) / Toshihisa Tanaka(Takushoku Univ.) / Takayuki Nakachi(Tokyo Univ. Agri.&Tech.) / Tetsuya Kojima(Saitamai Univ.) |
Assistant | Koichi Adachi(Univ. of Electro-Comm.) / Osamu Nakamura(Sharp) / Manabu Sakai(Mitsubishi Electric) / Masashi Iwabuchi(NTT) / Tatsuki Okuyama(NTT DOCOMO) / Taichi Yoshida(UEC) / Seisuke Kyochi(Univ. of Kitakyushu) / Masanori Hirotomo(Saga Univ.) |
Paper Information | |
Registration To | Technical Committee on Radio Communication Systems / Technical Committee on Signal Processing / Technical Committee on Information Theory |
---|---|
Language | ENG-JTITLE |
Title (in Japanese) | (See Japanese page) |
Sub Title (in Japanese) | (See Japanese page) |
Title (in English) | Meta-Bound for Lower Bounds of Bayes Risk |
Sub Title (in English) | |
Keyword(1) | Bayes risk |
Keyword(2) | data-processing inequality |
Keyword(3) | $f$-divergence |
Keyword(4) | $g$-divergence |
Keyword(5) | Renyi divergence |
1st Author's Name | Shota Saito |
1st Author's Affiliation | Gunma University(Gunma Univ.) |
Date | 2022-01-21 |
Paper # | IT2021-82,SIP2021-90,RCS2021-250 |
Volume (vol) | vol.121 |
Number (no) | IT-327,SIP-328,RCS-329 |
Page | pp.pp.301-305(IT), pp.301-305(SIP), pp.301-305(RCS), |
#Pages | 5 |
Date of Issue | 2022-01-13 (IT, SIP, RCS) |