Presentation 2023-05-12
Equivalences among Some Information Measures for Individual Sequences and Their Applications for Fixed-Length Coding Problems
Tomohiko Uyematsu, Tetsunao Matsuta,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) This paper proposes three new information measures for individual sequences and clarifies their properties. Our new information measures are called as the non-overlapping max-entropy, the overlapping smooth max-entropy, and the non-overlapping smooth max-entropy, respectively. These measures are related to the fixed-length coding of individual sequences. We investigate these measures, and show the following two properties: (1) The non-overlapping max-entropy coincides with the topological entropy. (2) The overlapping smooth max-entropy and the non-overlapping smooth max-entropycoincide with the Ziv-entropy. Further, we apply these information measures to the fixed-length coding of individual sequences, and propose two new universal coding schemes which are asymptotically optimum.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) fixed-length coding / individual sequence / information measure / topological entropy / universal coding / Ziv-entropy
Paper # IT2023-12,EMM2023-12
Date of Issue 2023-05-04 (IT, EMM)

Conference Information
Committee EMM / IT
Conference Date 2023/5/11(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Rakuyu Kaikan (Kyoto Univ. Yoshida-South Campus)
Topics (in Japanese) (See Japanese page)
Topics (in English) Information Security, Information Theory, Information Hiding, etc.
Chair Ryoichi Nishimura(NICT) / Tetsuya Kojima(Tokyo Kosen)
Vice Chair Kotaro Sonoda(Nagasaki Univ.) / Masatsugu Ichino(Univ. of Electro-Comm.) / Yasuyuki Nogami(Okayama Univ.)
Secretary Kotaro Sonoda(Kaishi Professional Univ.) / Masatsugu Ichino(Chiba Univ.) / Yasuyuki Nogami(Saitamai Univ.)
Assistant Tomoko Kajiyama(Hiroshima City Univ.) / Shieyuki Sakazawa(Osaka Inst. of Tech.) / Takayuki Nozaki(Yamaguchi Univ.)

Paper Information
Registration To Technical Committee on Enriched MultiMedia / Technical Committee on Information Theory
Language ENG-JTITLE
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Equivalences among Some Information Measures for Individual Sequences and Their Applications for Fixed-Length Coding Problems
Sub Title (in English)
Keyword(1) fixed-length coding
Keyword(2) individual sequence
Keyword(3) information measure
Keyword(4) topological entropy
Keyword(5) universal coding
Keyword(6) Ziv-entropy
1st Author's Name Tomohiko Uyematsu
1st Author's Affiliation Tokyo Institute of Technology(Tokyo Tech.)
2nd Author's Name Tetsunao Matsuta
2nd Author's Affiliation Saitama University(Saitama Univ.)
Date 2023-05-12
Paper # IT2023-12,EMM2023-12
Volume (vol) vol.123
Number (no) IT-14,EMM-15
Page pp.pp.61-66(IT), pp.61-66(EMM),
#Pages 6
Date of Issue 2023-05-04 (IT, EMM)