Presentation 2013-06-13
Application of augmented reality to voice output communication aid
Naohiro CHIKAMATSU, Toyohiko HAYASHI, Maiko IRIYAMA, Satuki AOKI,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Children with autism should acquire communication abilities as early as possible. Since they cannot easily acquire such abilities solely by using conventional methods, image-based learning is applied by using pictures and symbols for communication. Voice-output communication aid (VOCA) is one of the typical tools. Children with both autism and severe intellectual disability, however, tend not to be interested in such images. Then, we utilized two characteristics of human visual perception that we are interested in self mirror-images and unexpected sights. If an unexpected image is added to a self mirror-image, there is a possibility that the children become more interested in the images. To materialize such complex images, we applied augmented reality (AR) into VOCA. In a trial system named VCAN/AR, several cards with individual pictures are monitored on a computer display in real-time by using a Web camera. When one of the cards is hidden by user's hand, the corresponding sound is output, subsequently a 3D motion of a cube with the picture being virtually added at the position of the hidden card on the display. To access clinical efficiency of VCAN/AR, we interviewed speech-language-hearing therapists and teachers all being familiar with VOCA. Results suggested that it not only attracts children's attention in learning but also has a potential of creating innovative training methods.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Autism / Augmentative and Alternative Communication / VOCA / Augmented reality / Assistive device
Paper # SP2013-36,WIT2013-6
Date of Issue

Conference Information
Committee WIT
Conference Date 2013/6/6(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Well-being Information Technology(WIT)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Application of augmented reality to voice output communication aid
Sub Title (in English)
Keyword(1) Autism
Keyword(2) Augmentative and Alternative Communication
Keyword(3) VOCA
Keyword(4) Augmented reality
Keyword(5) Assistive device
1st Author's Name Naohiro CHIKAMATSU
1st Author's Affiliation Graduate School of Science and Techonology, Niigata University()
2nd Author's Name Toyohiko HAYASHI
2nd Author's Affiliation Graduate School of Science and Techonology, Niigata University:Department of Biocybemetics, Faculty of Engineering
3rd Author's Name Maiko IRIYAMA
3rd Author's Affiliation Science of Education, Niigata University
4th Author's Name Satuki AOKI
4th Author's Affiliation Graduate School of Science and Techonology, Niigata University:Meirin College Dental Clinic
Date 2013-06-13
Paper # SP2013-36,WIT2013-6
Volume (vol) vol.113
Number (no) 77
Page pp.pp.-
#Pages 6
Date of Issue