IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
... (for ESS/CS/ES/ISS)
Tech. Rep. Archives
... (for ES/CS)
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2014-11-21 11:50
Hyper-parameter estimation for compressive sensing with a Bernoulli-Gauss prior distribution
Toshiyuki Watanabe, Jun-ichi Inoue (Hokkaido Univ.)
Abstract (in Japanese) (See Japanese page) 
(in English) Compressive sensing is a theory that estimates sparse
information signals which has few non-zero elements
from less observations. In terms of Bayesian estimation,
Laplasian distribution ($L_{1}$-regularization) is normally
chosen for the prior distribution. However, if a true
distribution is a Bernoulli normal distribution whose zero
or non-zero element is generated by a Bernoulli distribution
of a non-zero rate (sparse rate as a `hyper-parameter') and
the non-zero elements is normally distributed, the Bernoulli
normal distribution should be chosen for a candidate
of the prior distribution in the sense of Bayesian optimality.
In this paper, we evaluate a dependence of
the hyper-parameter on the mean-square error by
replica method and discuss the dynamics of hyper-parameter
estimation by means of EM algorithm to maximize
the marginal likelihood indirectly.
Keyword (in Japanese) (See Japanese page) 
(in English) Compressive sensing / Statistical mechanics / Replica method / EM algorithm / Markov chain Monte Carlo method / / /  
Reference Info. IEICE Tech. Rep., vol. 114, no. 326, NC2014-28, pp. 15-20, Nov. 2014.
Paper # NC2014-28 
Date of Issue 2014-11-14 (NC) 
ISSN Print edition: ISSN 0913-5685  Online edition: ISSN 2432-6380

Conference Information
Committee MBE NC  
Conference Date 2014-11-21 - 2014-11-22 
Place (in Japanese) (See Japanese page) 
Place (in English) Tohoku University 
Topics (in Japanese) (See Japanese page) 
Topics (in English)  
Paper Information
Registration To NC 
Conference Code 2014-11-MBE-NC 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) Hyper-parameter estimation for compressive sensing with a Bernoulli-Gauss prior distribution 
Sub Title (in English)  
Keyword(1) Compressive sensing  
Keyword(2) Statistical mechanics  
Keyword(3) Replica method  
Keyword(4) EM algorithm  
Keyword(5) Markov chain Monte Carlo method  
1st Author's Name Toshiyuki Watanabe  
1st Author's Affiliation Hokkaido University (Hokkaido Univ.)
2nd Author's Name Jun-ichi Inoue  
2nd Author's Affiliation Hokkaido University (Hokkaido Univ.)
3rd Author's Name  
3rd Author's Affiliation ()
4th Author's Name  
4th Author's Affiliation ()
5th Author's Name  
5th Author's Affiliation ()
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Date Time 2014-11-21 11:50:00 
Presentation Time 25 
Registration for NC 
Paper # IEICE-NC2014-28 
Volume (vol) IEICE-114 
Number (no) no.326 
Page pp.15-20 
#Pages IEICE-6 
Date of Issue IEICE-NC-2014-11-14 

[Return to Top Page]

[Return to IEICE Web Page]

The Institute of Electronics, Information and Communication Engineers (IEICE), Japan