Scaling-Up the Crowd: Micro-Task Pricing Schemes for Worker Retention and Latency Improvement
Citations Over TimeTop 10% of 2014 papers
Abstract
Retaining workers on micro-task crowdsourcing platforms is essential in order to guarantee the timely completion of batches of Human Intelligence Tasks (HITs). Worker retention is also a necessary condition for the introduction of SLAs on crowdsourcing platforms. In this paper, we introduce novel pricing schemes aimed at improving the retention rate of workers working on long batches of similar tasks. We show how increasing or decreasing the monetary reward over time influences the number of tasks a worker is willing to complete in a batch, as well as how it influences the overall latency. We compare our new pricing schemes against traditional pricing methods (e.g., constant reward for all the HITs in a batch) and empirically show how certain schemes effectively function as an incentive for workers to keep working longer on a given batch of HITs. Our experimental results show that the best pricing scheme in terms of worker retention is based on punctual bonuses paid whenever the workers reach predefined milestones.
Related Papers
- → Let me choose what I want: The influence of incentive choice flexibility on the quality of crowdsourcing solutions to innovation problems(2022)34 cited
- → Incentive Mechanisms for Crowdsourcing Platforms(2016)32 cited
- → Simulation-Based Modeling and Evaluation of Incentive Schemes in Crowdsourcing Environments(2013)8 cited
- A hybrid crowdsourcing incentive mechanism based on users' preference(2017)
- → Incentive Engineering Framework for Crowdsourcing Systems(2016)1 cited