Motivation of Workers on Microtask Crowdsourcing Platforms (eBook)

Acknowledgements 6
Contents 8
Acronyms 10
Abstract 12
Zusammenfassung 14
1 Introduction 16
1.1 Crowdsourcing Microtask 17
1.1.1 Platforms 17
1.1.2 Tasks 19
1.2 Scope and Research Questions 20
2 Theoretical Background on Motivation 22
2.1 Taxonomy 22
2.1.1 Motivation 22
2.1.2 Influencing Factors 26
2.1.3 Outcomes 27
2.2 Other Motivational Theories 28
2.3 Motivation in Crowdsourcing 29
2.4 Chapter Summary 31
3 Who are the Crowdworkers? 32
3.1 Method 33
3.2 Data Collection 34
3.3 Results 35
3.3.1 Demographics 36
3.3.2 Socioeconomic Status 37
3.3.3 Crowdwork Conditions 40
3.4 Chapter Discussion and Summary 41
4 How to Measure Motivation? 43
4.1 Initial Item Set 43
4.2 Study 4.1: Construction of the CWMS Questionnaire 44
4.2.1 Method 44
4.2.2 Factorial Structure of the Questionnaire 47
4.3 Validation of the Questionnaire 53
4.4 Chapter Discussion and Summary 53
5 What Determines Task Selection Strategies? 59
5.1 Study 5.1: What are the Influencing Factors? 59
5.1.1 Method 59
5.1.2 Results 60
5.1.3 Discussion 61
5.2 Study 5.2: How to Measure the Task-Related Factors? 62
5.2.1 Method 64
5.2.2 Results 66
5.2.3 Discussion 69
5.3 Study 5.3: Is the Task-Selection Behavior of Workers Predictable? 69
5.3.1 Method 70
5.3.2 Results 72
5.3.3 Discussion 77
5.4 Study 5.4: What is the Relative Importance … 79
5.4.1 Method 80
5.4.2 Results 83
5.4.3 Discussion 86
5.5 Study 5.5: Is the Expected Workload Predictable? 87
5.5.1 Method 87
5.5.2 Results 90
5.5.3 Discussion 91
5.6 Chapter Discussion and Summary 92
6 What Influences Workers' Performance? 95
6.1 Motivation 95
6.1.1 Survey Task 95
6.1.2 Study 6.1: Algorithmic and Heuristic Tasks 97
6.1.3 Discussion 99
6.2 Task Design 100
6.2.1 Study 6.2: Effect of Being Observed on the Reliability of Responses 100
6.2.2 Study 6.3: Effect of Trapping Questions on the Performance of Crowdworkers 103
6.3 Chapter Discussion and Summary 109
7 Conclusion and Outlook 111
7.1 Conclusion 111
7.2 Future Work 113
7.2.1 General Motivation 113
7.2.2 Task-Specific Motivation 114
7.2.3 Performance 114
Appendix A Features and the Model for Predicting Expected Workload 116
A.1 Features 116
A.1.1 Syntax Based Features 116
A.1.2 Semantic Based Features 117
A.1.3 Visual Features 117
A.2 Prediction Model 118
References 120