Presentation 2013-07-14
Decoding Humor Experiences from Brain Activity Obtained during Comedy Movie Viewing
Yasuhito Sawahata, Kazuteru Komine, Toshiya Morita, Nobuyuki Hiruma,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Content providers or directors have been searching for a means to objectively evaluate viewers' subjective states while viewing films. Even by using state of the art technologies of image, audio and natural language processing, it would not be easy to extract high level semantics from media contents that contribute to content evaluations. By regarding biological responses as 'features' of movie contents, we attempt to extract such high level semantics from movie contents. It is difficult to define a universal criterion to judge the value of arbitrary movie contents, since metrics for enjoyability largely depend on the genre. In this report, focusing on a specific genre, comedy, we validate our framework in which movie contents are evaluated via biological responses, by extracting viewers subjective mental states that contribute to movie-evaluations from brain activity obtained during movie viewing. We conducted experiments in which we measured viewers' fMRI responses for comedy movies and levels of humor they were experiencing during movie viewing via a response device. Assuming that there are several mental states before and/or after a humor report, we analyzed fMRI data by using a decoding technique (a machine learning algorithm). Then, we found that statistically significant prediction accuracies were derived from the decoders constructed using fMRI data obtained even at two seconds ahead of the humor reports. The objective measurement of 'expectation of humor' contributes to an evaluation of humorous scenes because we can obtain the detailed reactions of viewers for specific scenes. These results indicated that the objective measurement of movie-induced mental states contributes to a movie-evaluation, and showed the proof of concept of the frame work that evaluates movie contents via biological signals.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) movie evaluation / biological signals / fMRI / decoding / humor
Paper # HIP2013-44
Date of Issue

Conference Information
Committee HIP
Conference Date 2013/7/6(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Human Information Processing (HIP)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Decoding Humor Experiences from Brain Activity Obtained during Comedy Movie Viewing
Sub Title (in English)
Keyword(1) movie evaluation
Keyword(2) biological signals
Keyword(3) fMRI
Keyword(4) decoding
Keyword(5) humor
1st Author's Name Yasuhito Sawahata
1st Author's Affiliation Science ang Technology Research Laboratories, Japan Broadcasting Corporation()
2nd Author's Name Kazuteru Komine
2nd Author's Affiliation Science ang Technology Research Laboratories, Japan Broadcasting Corporation
3rd Author's Name Toshiya Morita
3rd Author's Affiliation Science ang Technology Research Laboratories, Japan Broadcasting Corporation
4th Author's Name Nobuyuki Hiruma
4th Author's Affiliation Science ang Technology Research Laboratories, Japan Broadcasting Corporation
Date 2013-07-14
Paper # HIP2013-44
Volume (vol) vol.113
Number (no) 128
Page pp.pp.-
#Pages 6
Date of Issue