Paper Abstract and Keywords |
Presentation |
2022-02-22 15:20
A Note on Perceived Visual Content Estimation Based on Compressed Reconstruction Network Using Brain Signals While Gazing on Images Takaaki Higashi, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama (Hokkaido University) |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
In this paper, we propose a method to reconstruct a perceived image using brain signals obtained during gazing images. Specifically, a compressive reconstruction network, which can reconstruct a perceived image, is constructed. We estimate the compressed representation of the perceived image obtained as latent variables from brain signals, and the decoder of the compressive reconstruction network can reconstruct the perceived image. Furthermore, in our method, we construct a multimodal compressive reconstruction network that can reconstruct not only a perceived image but also visual features of the image. Then, latent variables considering semantic information of the perceived image can be extracted. By taking account of semantic information of the perceived image, it is expected to improve both the estimation accuracy of the compressed representation and the reconstruction accuracy of the perceived image. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
brain decoding / functional magnetic resonance imaging / convolutional neural network / machine learning / multimodal VAE / / / |
Reference Info. |
IEICE Tech. Rep. |
Paper # |
|
Date of Issue |
|
ISSN |
|
Download PDF |
|
Conference Information |
Committee |
IE ITS ITE-AIT ITE-ME ITE-MMS |
Conference Date |
2022-02-21 - 2022-02-22 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Online |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Image Processing, etc. |
Paper Information |
Registration To |
ITE-ME |
Conference Code |
2022-02-AIT-ME-MMS-IE-ITS |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
A Note on Perceived Visual Content Estimation Based on Compressed Reconstruction Network Using Brain Signals While Gazing on Images |
Sub Title (in English) |
|
Keyword(1) |
brain decoding |
Keyword(2) |
functional magnetic resonance imaging |
Keyword(3) |
convolutional neural network |
Keyword(4) |
machine learning |
Keyword(5) |
multimodal VAE |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Takaaki Higashi |
1st Author's Affiliation |
Hokkaido University (Hokkaido University) |
2nd Author's Name |
Keisuke Maeda |
2nd Author's Affiliation |
Hokkaido University (Hokkaido University) |
3rd Author's Name |
Takahiro Ogawa |
3rd Author's Affiliation |
Hokkaido University (Hokkaido University) |
4th Author's Name |
Miki Haseyama |
4th Author's Affiliation |
Hokkaido University (Hokkaido University) |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2022-02-22 15:20:00 |
Presentation Time |
15 minutes |
Registration for |
ITE-ME |
Paper # |
|
Volume (vol) |
vol.121 |
Number (no) |
|
Page |
|
#Pages |
|
Date of Issue |
|