Understanding Malicious Behavior in Crowdsourcing Platforms
Citations Over TimeTop 1% of 2015 papers
Abstract
Crowdsourcing is increasingly being used as a means to tackle problems requiring human intelligence. With the ever-growing worker base that aims to complete microtasks on crowdsourcing platforms in exchange for financial gains, there is a need for stringent mechanisms to prevent exploitation of deployed tasks. Quality control mechanisms need to accommodate a diverse pool of workers, exhibiting a wide range of behavior. A pivotal step towards fraud-proof task design is understanding the behavioral patterns of microtask workers. In this paper, we analyze the prevalent malicious activity on crowdsourcing platforms and study the behavior exhibited by trustworthy and untrustworthy workers, particularly on crowdsourced surveys. Based on our analysis of the typical malicious activity, we define and identify different types of workers in the crowd, propose a method to measure malicious activity, and finally present guidelines for the efficient design of crowdsourced surveys.
Related Papers
- → Two's company, three's a crowd: a case study of crowdsourcing software development(2014)207 cited
- → Collaborative Software Development Platforms for Crowdsourcing(2014)75 cited
- → Stimulating Skill Evolution in Market-Based Crowdsourcing(2011)36 cited
- → Application of crowdsourcing in software development(2016)9 cited
- → An agent-based approach for crowdsourcing software design(2016)4 cited