| Presentation | 2016-03-10 Relations Between Conditional Shannon Entropy and Expectation of Norm and Their Applications Yuta Sakai, Ken-ichi Iwata, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | The paper investigates the extremal relations between the Shannon entropy and the $ell_{alpha}$-norm. More precisely, the exact ranges between the Shannon entropy and the $ell_{alpha}$-norm are examined for probability distributions on a finite alphabet. Furthermore, we extend the above results from unconditional information measures to conditional information measures. Then, we reveal the exact ranges between the conditional Shannon entropy and the expectation of ell_{alpha}-norm for joint probability distributions. As applications, we examine the tight bounds of reliability functions for discrete memoryless channels. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Shannon entropy / $ell_{alpha}$-norm / R'{e}nyi entropy / conditional entropy / Gallager's $E_{0}$ function |
| Paper # | IT2015-109,ISEC2015-68,WBS2015-92 |
| Date of Issue | 2016-03-03 (IT, ISEC, WBS) |
| Conference Information | |
| Committee | IT / ISEC / WBS |
|---|---|
| Conference Date | 2016/3/10(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | The University of Electro-Communications |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | joint meeting of IT, ISEC, and WBS |
| Chair | Yasutada Oohama(Univ. of Electro-Comm.) / Yukiyasu Tsunoo(NEC) / Hiromasa Habuchi(Ibaraki Univ.) |
| Vice Chair | Tadashi Wadayama(Nagoya Inst. of Tech.) / Masahiro Mambo(Kanazawa Univ.) / Kazuto Ogawa(NHK) / Fumiaki Maehara(Waseda Univ.) / Minoru Okada(NAIST) |
| Secretary | Tadashi Wadayama(Univ. of Electro-Comm.) / Masahiro Mambo(Wakayama Univ.) / Kazuto Ogawa(AIST) / Fumiaki Maehara(Toshiba) / Minoru Okada(Univ. of Kitakyushu) |
| Assistant | Takuya Kusaka(Okayama Univ.) / Tetsuya Izu(Fujitsu Lab.) / Takaaki Mizuki(Tohoku Univ.) / Noritaka Yamashita(NEC) / Yusuke Kozawa(Tokyo Univ. of Science) / Akira Nakamura(Tokyo Univ. of Science) / Ryohei Nakamura(National Defense Academy) |
| Paper Information | |
| Registration To | Technical Committee on Information Theory / Technical Committee on Information Security / Technical Committee on Wideband System |
|---|---|
| Language | ENG-JTITLE |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Relations Between Conditional Shannon Entropy and Expectation of Norm and Their Applications |
| Sub Title (in English) | |
| Keyword(1) | Shannon entropy |
| Keyword(2) | $ell_{alpha}$-norm |
| Keyword(3) | R'{e}nyi entropy |
| Keyword(4) | conditional entropy |
| Keyword(5) | Gallager's $E_{0}$ function |
| 1st Author's Name | Yuta Sakai |
| 1st Author's Affiliation | University of Fukui(Univ. of Fukui) |
| 2nd Author's Name | Ken-ichi Iwata |
| 2nd Author's Affiliation | University of Fukui(Univ. of Fukui) |
| Date | 2016-03-10 |
| Paper # | IT2015-109,ISEC2015-68,WBS2015-92 |
| Volume (vol) | vol.115 |
| Number (no) | IT-500,ISEC-501,WBS-502 |
| Page | pp.pp.49-54(IT), pp.49-54(ISEC), pp.49-54(WBS), |
| #Pages | 6 |
| Date of Issue | 2016-03-03 (IT, ISEC, WBS) |