DYNAMIC AND GOAL-BASED QUALITY MANAGEMENT FOR HUMAN-BASED ELECTRONIC SERVICES

作者：Kern Robert^*; Thies Hans; Zirpins Christian; Satzger Gerhard

来源：International Journal of Cooperative Information Systems, 2012, 21(1): 3-29.

DOI：10.1142/S0218843012400011

• Crowdsourcing
• statistical quality control
• human computation
• eServices
• people services

Crowdsourcing in the form of human-based electronic services (people services) provides a powerful way of outsourcing tasks to a large crowd of remote workers over the Internet. Research has shown that multiple redundant results delivered by different workers can be aggregated in order to achieve a reliable result. However, basic implementations of this approach are rather inefficient as they multiply the effort for task execution and are not able to guarantee a certain quality level. In this paper, we are addressing these challenges by elaborating on a statistical approach for quality management of people services which we had previously proposed. The approach combines elements of statistical quality management with dynamic group decisions. We present a comprehensive statistical model that enhances our original work and makes it more transparent. We also provide an extendible toolkit that implements our model and facilitates its application to real-time experiments as well as to simulations. A quantitative analysis based on an optical character recognition (OCR) scenario confirms the efficiency and reach of our model.

• 出版日期2012-3