Presentation 2022-01-21
Meta-Bound for Lower Bounds of Bayes Risk
Shota Saito,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) In the parameter estimation problem of statistics and machine learning, information-theoretic lower bounds of the Bayes risk have been investigated. Previous studies prove the lower bound of the Bayes risk differently and characterize the lower bound via different quantities such as the mutual information, the Sibson's $alpha$-mutual information, and $f$-informativity. In this paper, we introduce an inequality called ``meta-bound'' and show that the results of these previous studies can be derived from the meta-bound.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Bayes risk / data-processing inequality / $f$-divergence / $g$-divergence / Renyi divergence
Paper # IT2021-82,SIP2021-90,RCS2021-250
Date of Issue 2022-01-13 (IT, SIP, RCS)

Conference Information
Committee RCS / SIP / IT
Conference Date 2022/1/20(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Online
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair Eiji Okamoto(Nagoya Inst. of Tech.) / Yukihiro Bandou(NTT) / Tadashi Wadayama(Nagoya Inst. of Tech.)
Vice Chair Toshihiko Nishimura(Hokkaido Univ.) / Tomoya Tandai(Toshiba) / Fumihide Kojima(NICT) / Toshihisa Tanaka(Tokyo Univ. Agri.&Tech.) / Takayuki Nakachi(Ryukyu Univ.) / Tetsuya Kojima(Tokyo Kosen)
Secretary Toshihiko Nishimura(NEC) / Tomoya Tandai(Panasonic) / Fumihide Kojima(Xiaomi) / Toshihisa Tanaka(Takushoku Univ.) / Takayuki Nakachi(Tokyo Univ. Agri.&Tech.) / Tetsuya Kojima(Saitamai Univ.)
Assistant Koichi Adachi(Univ. of Electro-Comm.) / Osamu Nakamura(Sharp) / Manabu Sakai(Mitsubishi Electric) / Masashi Iwabuchi(NTT) / Tatsuki Okuyama(NTT DOCOMO) / Taichi Yoshida(UEC) / Seisuke Kyochi(Univ. of Kitakyushu) / Masanori Hirotomo(Saga Univ.)

Paper Information
Registration To Technical Committee on Radio Communication Systems / Technical Committee on Signal Processing / Technical Committee on Information Theory
Language ENG-JTITLE
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Meta-Bound for Lower Bounds of Bayes Risk
Sub Title (in English)
Keyword(1) Bayes risk
Keyword(2) data-processing inequality
Keyword(3) $f$-divergence
Keyword(4) $g$-divergence
Keyword(5) Renyi divergence
1st Author's Name Shota Saito
1st Author's Affiliation Gunma University(Gunma Univ.)
Date 2022-01-21
Paper # IT2021-82,SIP2021-90,RCS2021-250
Volume (vol) vol.121
Number (no) IT-327,SIP-328,RCS-329
Page pp.pp.301-305(IT), pp.301-305(SIP), pp.301-305(RCS),
#Pages 5
Date of Issue 2022-01-13 (IT, SIP, RCS)