Presentation 2021-06-18
Speech Intelligibility Experiments using crowdsourcing
Ayako Yamamoto, Toshio Irino, Kenichi Arai, Shoko Araki, Atsunori Ogawa, Keisuke Kinoshita, Tomohiro Nakatani,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) Many subjective experiments have been performed to develop objective speech intelligibility measures, but the novel coronavirus outbreak has made it very difficult to conduct experiments in a laboratory. One solution is to perform remote testing using crowdsourcing; however, because we cannot control the listening conditions, it is unclear whether the results are entirely reliable. In this study, we compared speech intelligibility scores obtained in remote and laboratory experiments. The results showed that the mean and standard deviation (SD) of the remote experiments' speech reception threshold (SRT) were higher than those of the laboratory experiments. However, the variance in the SRTs across the speech-enhancement conditions revealed similarities, implying that remote testing results may be as useful as laboratory experiments to develop an objective measure. We also show that the practice session scores correlate with the SRT values. This is a priori information before performing the main tests and would be useful for data screening to reduce the variability of the SRT distribution.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) speech Intelligibility / subjective evaluation / objective index / remote testing / crowd sourcing / reliability / data screening
Paper # SP2021-5
Date of Issue 2021-06-11 (SP)

Conference Information
Committee SP / IPSJ-SLP / IPSJ-MUS
Conference Date 2021/6/18(2days)
Place (in Japanese) (See Japanese page)
Place (in English) Online
Topics (in Japanese) (See Japanese page)
Topics (in English) OTOGAKU Symposium 2021
Chair Hisashi Kawai(NICT) / 北岡 教英(豊橋技科大) / 竹川 佳成(はこだて未来大)
Vice Chair
Secretary (Univ. of Tokyo) / (Waseda Univ.) / (京大)
Assistant Yusuke Ijima(NTT)

Paper Information
Registration To Technical Committee on Speech / Special Interest Group on Spoken Language Processing / Special Interest Group on Music and Computer
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Speech Intelligibility Experiments using crowdsourcing
Sub Title (in English) from designing Web page to Data screening
Keyword(1) speech Intelligibility
Keyword(2) subjective evaluation
Keyword(3) objective index
Keyword(4) remote testing
Keyword(5) crowd sourcing
Keyword(6) reliability
Keyword(7) data screening
1st Author's Name Ayako Yamamoto
1st Author's Affiliation Wakayama University(Wakayama Univ.)
2nd Author's Name Toshio Irino
2nd Author's Affiliation Wakayama University(Wakayama Univ.)
3rd Author's Name Kenichi Arai
3rd Author's Affiliation NTT Communication Science Laboratories(NTT)
4th Author's Name Shoko Araki
4th Author's Affiliation NTT Communication Science Laboratories(NTT)
5th Author's Name Atsunori Ogawa
5th Author's Affiliation NTT Communication Science Laboratories(NTT)
6th Author's Name Keisuke Kinoshita
6th Author's Affiliation NTT Communication Science Laboratories(NTT)
7th Author's Name Tomohiro Nakatani
7th Author's Affiliation NTT Communication Science Laboratories(NTT)
Date 2021-06-18
Paper # SP2021-5
Volume (vol) vol.121
Number (no) SP-66
Page pp.pp.25-30(SP),
#Pages 6
Date of Issue 2021-06-11 (SP)