人工知能学会論文誌
Online ISSN : 1346-8030
Print ISSN : 1346-0714
原著論文
クラウドソーシングワーカーの段階的育成方法の提案
芦川 将之川村 隆浩大須賀 昭彦
著者情報
ジャーナル フリー

32 巻 (2017) 3 号 p. B-G81_1-13

詳細
PDFをダウンロード (4852K) 発行機関連絡先
抄録

Current crowdsourcing platforms such as Amazon Mechanical Turk provide an attractive solution Crowdsourcing platforms provide an attractive solution for processing numerous tasks at a low cost. However, insufficient quality control remains a major concern. Therefore, we developed a private crowdsourcing system that allows us to devise quality control methods. In the present study, we propose a grade-based training method for workers in order to avoid simple exclusion of low-quality workers and shrinkage of the crowdsourcing market in the near future. Our training method utilizes probabilistic networks to estimate correlations between tasks based on workers’ records for 18.5 million tasks and then allocates pre-learning tasks to the workers to raise the accuracy of target tasks according to the task correlations. In an experiment, the method automatically allocated 31 pre-learning task categories for 9 target task categories, and after the training of the pre-learning tasks, we confirmed that the accuracy of the target tasks was raised by 7.8 points on average. This result was comparatively higher than those of pre-learning tasks allocated using other methods, such as decision trees. We thus confirmed that the task correlations can be estimated using a large amount of worker records, and that these are useful for the grade-based training of low-quality workers.

著者関連情報
© 人工知能学会 2017
前の記事 次の記事

閲覧履歴
feedback
Top