The Practice of Crowdsourcing

Omar Alonso is a Principal Data Scientist Lead at Microsoft in Silicon Valley where he works on the intersection of social media, information retrieval, knowledge graphs, and human computation. He holds a Ph.D. from the University of California at Davis and an undergraduate degree from UNICEN, Argentina. Gary Marchionini is the Cary C. Boshamer Professor of Information Science in the School of Information and Library Science at the University of North Carolina at Chapel Hill. His Ph.D. is from Wayne State University in mathematics education with an emphasis on educational computing. His research interests are in information seeking in electronic environments, digital libraries, human-computer interaction, digital government and information technology policy. He has had grants or contracts from the National Science Foundation, the U.S. Department of Education, the Council on Library Resources, the National Library of Medicine, the Library of Congress, the Kellogg Foundation, and NASA, among others. He was the Conference Chair for the 1996 ACM Digital Library Conference and program chair for the 2002 ACM-IEEE Joint Conference on Digital Libraries. He is editor-in-chief for ACM Transactions on Information Systems and serves on the editorial boards of a dozen scholarly journals. He has published more than 150 articles, chapters, and conference papers in the information science, computer science, and education literatures. He founded the Interaction Design Laboratory at UNC-CH.

Preface
Acknowledgments
Introduction
Designing and Developing Microtasks
Quality Assurance
Algorithms and Techniques for Quality Control
The Human Side of Human Computation
Putting All Things Together
Systems and Data Pipelines
Looking Ahead
Bibliography
Author's Biography