| Presentation | 2016-01-15 Estimating Skills of Crowd Workers Based on Awarded Contracts Shogo Ito, Donghui Lin, Toru Ishida, |
|---|---|
| PDF Download Page |  PDF download Page Link |
| Abstract(in Japanese) | (See Japanese page) |
| Abstract(in English) | Worker selection is an important issue in crowdsourcing. In most crowdsourcing systems, reputation score is an essential indicator for requesters to make decisions when hiring workers. This reputation score is always calculated based on mutual feedbacks between requesters and workers after a task is completed. However, it is reported that the reputation in crowdsourcing platforms is skewed towards a high score because workers and requesters are afraid of retaliation if sending bad feedbacks. In this research, we propose SkillRating, a method to estimate skills of workers based on awarded contracts as a reference for selecting workers for requesters. Moreover, we evaluate our proposed approach by using real data of a crowdsourcing system. |
| Keyword(in Japanese) | (See Japanese page) |
| Keyword(in English) | Crowdsourcing / relevance of skill / reputation system / rating |
| Paper # | SC2015-18 |
| Date of Issue | 2016-01-08 (SC) |
| Conference Information | |
| Committee | SC |
|---|---|
| Conference Date | 2016/1/15(1days) |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kyoto University (Design Innovation Center) |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Cloud, IoT, and Service Innovation |
| Chair | Shigeru Hosono(NEC) |
| Vice Chair | Incheon Paik(Univ. of Aizu) |
| Secretary | Incheon Paik(NICT) |
| Assistant | |
| Paper Information | |
| Registration To | Technical Committee on Service Computing |
|---|---|
| Language | JPN |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Estimating Skills of Crowd Workers Based on Awarded Contracts |
| Sub Title (in English) | |
| Keyword(1) | Crowdsourcing |
| Keyword(2) | relevance of skill |
| Keyword(3) | reputation system |
| Keyword(4) | rating |
| 1st Author's Name | Shogo Ito |
| 1st Author's Affiliation | Kyoto University(Kyoto Univ.) |
| 2nd Author's Name | Donghui Lin |
| 2nd Author's Affiliation | Kyoto University(Kyoto Univ.) |
| 3rd Author's Name | Toru Ishida |
| 3rd Author's Affiliation | Kyoto University(Kyoto Univ.) |
| Date | 2016-01-15 |
| Paper # | SC2015-18 |
| Volume (vol) | vol.115 |
| Number (no) | SC-393 |
| Page | pp.pp.19-24(SC), |
| #Pages | 6 |
| Date of Issue | 2016-01-08 (SC) |