Paper Abstract and Keywords |
Presentation |
2014-07-17 16:15
Bounds on the Entropy of Multinomial Distribution Yuichi Kaji (NAIST) IT2014-23 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
The purpose of this study is to derive an upper-bound and a lower-bound of the entropy of a multinomial distribution. In spite of its practicality and versatility, there is no closed-form formula of the entropy of the multinomial distribution. Cich'{o}n derived an asymptotic formula that approximates the entropy, but the approximation is not very useful because it can yield fatal error for non-asymptotic parameters, and there is no clear perspective of the approximation error. This paper proposes an upper-bound and a lower-bound formulas of the entropy of the multinomial distribution. The formulas are effective for arbitrary parameters, and contribute to the quantitative discussion of the entropy of the multinomial distribution. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
entropy / multinomial distribution / binomial distribution / bound formula / Stirling's formula / / / |
Reference Info. |
IEICE Tech. Rep., vol. 114, no. 138, IT2014-23, pp. 65-70, July 2014. |
Paper # |
IT2014-23 |
Date of Issue |
2014-07-10 (IT) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
IT2014-23 |
Conference Information |
Committee |
IT |
Conference Date |
2014-07-17 - 2014-07-18 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Kobe University |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
freshman session, general |
Paper Information |
Registration To |
IT |
Conference Code |
2014-07-IT |
Language |
English (Japanese title is available) |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Bounds on the Entropy of Multinomial Distribution |
Sub Title (in English) |
|
Keyword(1) |
entropy |
Keyword(2) |
multinomial distribution |
Keyword(3) |
binomial distribution |
Keyword(4) |
bound formula |
Keyword(5) |
Stirling's formula |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Yuichi Kaji |
1st Author's Affiliation |
Nara Institute of Science and Technology (NAIST) |
2nd Author's Name |
|
2nd Author's Affiliation |
() |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2014-07-17 16:15:00 |
Presentation Time |
25 minutes |
Registration for |
IT |
Paper # |
IT2014-23 |
Volume (vol) |
vol.114 |
Number (no) |
no.138 |
Page |
pp.65-70 |
#Pages |
6 |
Date of Issue |
2014-07-10 (IT) |
|