Presentation 2014-01-10
Applying Blackboard Architecture on Crowdsourcing
Shinsuke GOTO, Donghui LIN, Yohei MURAKAMI, Toru ISHIDA,
PDF Download Page PDF download Page Link
Abstract(in Japanese) (See Japanese page)
Abstract(in English) The emergence of crowdsourcing brings high possibilities for solving complex tasks with crowd workers. In such environments, complex tasks are always decomposed into small subtasks that are controlled by workflows. However, uncertain ability and reliability of crowd workers make it difficult to define the best workflow beforehand. To provide flexible mechanisms for coordination of crowd workers, we propose a blackboard architecture for controlling the crowdsourcing environments. For example, multiple subtasks can be executed by multiple crowd workers in parallel, and next candidate subtasks are determined based on evaluation of workers' results. In the proposed blackboard architecture, the data-driven model enables the dynamic control of task execution by evaluating the reliability of workers' results, which are used to predict the ability of workers for improvement of execution control. Moreover, we use an example of complex task for Japanese-Indonesian translation to illustrate the proposed approach and discuss the possibility of applying blackboard architecture in crowdsourcing environments.
Keyword(in Japanese) (See Japanese page)
Keyword(in English) Crowdsourcing / Translation / Blackboard Architecture
Paper # SC2013-15
Date of Issue

Conference Information
Committee SC
Conference Date 2014/1/3(1days)
Place (in Japanese) (See Japanese page)
Place (in English)
Topics (in Japanese) (See Japanese page)
Topics (in English)
Chair
Vice Chair
Secretary
Assistant

Paper Information
Registration To Services Computing (SC)
Language JPN
Title (in Japanese) (See Japanese page)
Sub Title (in Japanese) (See Japanese page)
Title (in English) Applying Blackboard Architecture on Crowdsourcing
Sub Title (in English)
Keyword(1) Crowdsourcing
Keyword(2) Translation
Keyword(3) Blackboard Architecture
1st Author's Name Shinsuke GOTO
1st Author's Affiliation Graduate School of Informatics, Kyoto University()
2nd Author's Name Donghui LIN
2nd Author's Affiliation Graduate School of Informatics, Kyoto University
3rd Author's Name Yohei MURAKAMI
3rd Author's Affiliation Graduate School of Informatics, Kyoto University
4th Author's Name Toru ISHIDA
4th Author's Affiliation Graduate School of Informatics, Kyoto University
Date 2014-01-10
Paper # SC2013-15
Volume (vol) vol.113
Number (no) 376
Page pp.pp.-
#Pages 6
Date of Issue