| Presentation | 2021-08-22 A Study on Performance Feedback and Bonus Payment in Crowdsourcing Services Yoshinori Hijikata, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | In recent years, crowdsourcing services have been used to diversify work styles of people and improve work efficiency in companies. Services in the IT field particularly have become to incorporate intelligent systems using machine learning techniques. In order to create training data, it is necessary to manually assign correct labels to a large number of objects, and this task is often performed by crowdsourcing. In this study, assuming the above task, the author investigates whether the presentation of the deliverable (or outcome) evaluation and the provision of additional rewards contribute to the improvement of workers’ persistence and performance (correct answer rate). The author conducted a user experiment on a real crowdsourcing service and found that the presentation of deliverable evaluations increased the persistence rate of high-quality workers, while the provision of additional rewards decreased the persistence rate of low-quality workers and kept high correctness of their deliverables. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Crowdsourcing / Quality Assurance / Deliverable Assessment / Bonus Payment / Motivation / Correctness |
| Paper # | HCS2021-25 |
| Date of Issue | 2021-08-14 (HCS) |
| Conference Information | |
| Committee | HCS |
|---|---|
| Conference Date | 2021/8/21(2days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Theory and practice about CSCW |
| Chair | Tomoo Inoue(Univ. of Tsukuba) |
| Vice Chair | Yugo Hayashi(Ritsumeikan Univ.) / Tomoko Kanda(Osaka Inst. of Tech.) |
| Secretary | Yugo Hayashi(Nihon Univ.) / Tomoko Kanda(National Chung Cheng Univ) |
| Assistant | HUANG HUNGHSUAN(Univ. of Fukuchiyama) / Shigeyoshi Iizuka(Kanagawa Univ.) / Kazuki Takashima(Tohoku Univ.) / Hiroto Saito(Tokyo Denki Univ.) / Ryo Ishii(NTT) |
| Paper Information | |
| Registration To | Technical Committee on Human Communication Science |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | A Study on Performance Feedback and Bonus Payment in Crowdsourcing Services |
| Sub Title (in English) | |
| Keyword(1) | Crowdsourcing |
| Keyword(2) | Quality Assurance |
| Keyword(3) | Deliverable Assessment |
| Keyword(4) | Bonus Payment |
| Keyword(5) | Motivation |
| Keyword(6) | Correctness |
| 1st Author's Name | Yoshinori Hijikata |
| 1st Author's Affiliation | Kwansei Gakuin University(KGU) |
| Date | 2021-08-22 |
| Paper # | HCS2021-25 |
| Volume (vol) | vol.121 |
| Number (no) | HCS-143 |
| Page | pp.pp.45-50(HCS), |
| #Pages | 6 |
| Date of Issue | 2021-08-14 (HCS) |