| Presentation | 2010-07-09 CQ2010-34 Performance Comparisons of Subjective Video Quality Assessment Methods for Mobile Communications Toshiko TOMINAGA, Takanori HAYASHI, Jun OKAMOTO, Akira TAKAHASHI, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | There are many subjective assessment methods, depending on the purpose of the video quality evaluation, provided by ITU-T and ITU-R recommendations. We compared eight subjective assessment methods, Double-Stimulus Continuous Quality-Scale (DSCQS), Double-Stimulus Impairment Scale (DSIS), 5-grade Absolute Category Rating (ACR5), ACR5 with Hidden Reference (ACR5-HR), 11-grade ACR (ACR11), ACR11-HR, Subjective Assessment of Multimedia Video Quality (SAMVIQ), and SAMVIQ-HR, to clarify their applicability to a variety of video quality assessment. To do this, we evaluated the total assessment time and difficult/ease in evaluation for the participants, as well as the characteristics of different rating scales and their statistical reliability. As a result, we clarified that the correlation coefficients and rank correlation coefficients of the mean opinion scores between pairs of the eight methods were high. As for statistical reliability of each rating method, DSIS, ACR5, and SAMVIQ outperformed the other methods. Moreover, participant questionnaire results showed that ACR5 was a suitable method from the viewpoint of total assessment time and ease of evaluation. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Video quality / Subjective assessment method / QoE / ACR / DSIS / DSCQS / SAMVIQ |
| Paper # | CQ2010-34 |
| Date of Issue |
| Conference Information | |
| Committee | CQ |
|---|---|
| Conference Date | 2010/7/1(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Chair | |
| Vice Chair | |
| Secretary | |
| Assistant | |
| Paper Information | |
| Registration To | Communication Quality (CQ) |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | CQ2010-34 Performance Comparisons of Subjective Video Quality Assessment Methods for Mobile Communications |
| Sub Title (in English) | |
| Keyword(1) | Video quality |
| Keyword(2) | Subjective assessment method |
| Keyword(3) | QoE |
| Keyword(4) | ACR |
| Keyword(5) | DSIS |
| Keyword(6) | DSCQS |
| Keyword(7) | SAMVIQ |
| 1st Author's Name | Toshiko TOMINAGA |
| 1st Author's Affiliation | NTT Service Integration Laboratories, NTT Corporation() |
| 2nd Author's Name | Takanori HAYASHI |
| 2nd Author's Affiliation | NTT Service Integration Laboratories, NTT Corporation |
| 3rd Author's Name | Jun OKAMOTO |
| 3rd Author's Affiliation | NTT Service Integration Laboratories, NTT Corporation |
| 4th Author's Name | Akira TAKAHASHI |
| 4th Author's Affiliation | NTT Service Integration Laboratories, NTT Corporation |
| Date | 2010-07-09 |
| Paper # | CQ2010-34 |
| Volume (vol) | vol.110 |
| Number (no) | 118 |
| Page | pp.pp.- |
| #Pages | 6 |
| Date of Issue | |