Presentation 2005/1/17
Temporal factors influence on the location of auditory-visual integrative processing in human cortex
Xilong Zhi, Yasuhiko Saito,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Two major factors that determine whether different modal cues will be perceived as arising from the same event and integrated for perceptual gain, they are proximity in time and space. Although the recent studies found that the locations of auditory-visual integrative processing in human cortex, under synchronous bimodal stimulation condition, are different from that under bimodal stimuli onset asynchrony (SOA) condition, nothing is known about whether the different temporal gaps of auditory-visual SOA (SOA is unequal zero ms) may influence on the location. To detect this influence, event-related potentials (ERPs) were recorded from 121 scalp electrodes while subjects performed a forced-choice categorization task : At each trial, the subjects had to indicate which of two objects was presented by pressing one of two buttons. The two objects, 'A' and 'B', were defined by auditory stimulus alone, visual stimulus alone, or the combination of auditory and visual stimulus. In combination condition, visual stimulus onset was earlier 15 ms (experiment 1, SOA 15 ms) and 30 ms (experiment 2, SOA 30 ms) than the auditory stimulus onset. Spatiotemporal analysis of ERPs and high-density electrical mapping revealed several auditory-visual interaction components temporally, spatially, and functionally distinct 200 ms after visual stimulus onset in both experiment 1 and experiment 2. Comparing the effects under SOA 15 ms condition with that under SOA 30 ms condition, the results showed that (1) in prefrontal cortex, the effects may be observed not only under SOA 15 ms condition but also under SOA 30 ms condition, suggest these multisensory cells do not process auditory-visual temporal information, it is consistent with previous study that prefrontal regions specialized in auditory and visual spatial processing; (2) left visual area and right parieto-occipital area were selectively activated under SOA 15 ms condition, right temporal-occipital area and right temporal were activated for SOA 30 ms, suggest that these regions are relative to 'compensation for sound delay in human perception', and support the proposition that the different regions may be set-up to optimize audiovisual integration at different ranges of distance from the observer.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Mutisensory integration / auditory-visual interaction / temporal factor / SOA / ERP
Paper # NC2004-117
Date of Issue

Conference Information
Committee NC
Conference Date 2005/1/17(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Neurocomputing (NC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Temporal factors influence on the location of auditory-visual integrative processing in human cortex
Sub Title (in English)
Keyword(1) Mutisensory integration
Keyword(2) auditory-visual interaction
Keyword(3) temporal factor
Keyword(4) SOA
Keyword(5) ERP
1st Author's Name Xilong Zhi
1st Author's Affiliation Sleep Research Center, Ashikaga Institute of Technolog()
2nd Author's Name Yasuhiko Saito
2nd Author's Affiliation Sleep Research Center, Ashikaga Institute of Technolog
Date 2005/1/17
Paper # NC2004-117
Volume (vol) vol.104
Number (no) 585
Page pp.pp.-
#Pages 6
Date of Issue