Handbook of Research Methods in Industrial and Organizational Psychology

Dr. Steven G. Rogelberg (Associate Professor, Psychology and Adjunct Associate Professor, Business Administration) is Director of the Industrial and Organizational Psychology Program at UNC Charlotte. He has over 45 publications and 25 invited addresses/colloquiums addressing issues such as organizational research methods, team effectiveness, health and employee well-being, meetings at work, and organizational development. He is the Editor-in-Chief of the two-volume Encyclopedia of Industrial and Organizational Psychology (in progress). Recent honors include being named Chair of Education and Training for the Society of Industrial and Organizational Psychology (SIOP), serving as a SIOP Executive Board Member, serving as Guest Editor for Organizational Research Methods, receiving the 2001 Bowling Green State University (BGSU) Psi Chi Professor of the Year Award, and receiving the BGSU Master Teacher Award. Prior to his recent tenure at UNCC, Rogelberg was an Associate Professor of Psychology in the Industrial and Organizational Psychology area at BGSU. Before completing his Ph.D. in Industrial/Organizational Psychology at the University of Connecticut in 1994, he received his undergraduate B.Sc. degree from Tufts University in 1989.

List of Contributors x

Preface xii

Acknowledgments xiii

Part I Foundations 1

1 History of Research Methods in Industrial and Organizational Psychology: Measurement, Design, Analysis 3
James T. Austin, Charles A. Scherbaum, and Robert A. Mahlman

2 Ethics in Research 34
Herman Aguinis and Christine A. Henle

3 Validity and Reliability 57
Robert M. Guion

4 The Relative Validity and Usefulness of Various Empirical Research Designs 77
Eugene F. Stone-Romero

5 An Introduction to Qualitative Research: Its Potential for Industrial and Organizational Psychology 99
Karen Locke and Karen Golden-Biddle

6 Using Power Analysis to Evaluate and Improve Research 119
Kevin Murphy

Part II Data Collection Procedures and Approaches 139

7 Organizational Survey Research 141
Steven G. Rogelberg, Allan H. Church, Janine Waclawski, and Jeffrey M. Stanton

8 Qualitative Data Collection and Analysis 161
Peter D. Bachiochi and Sara P. Weiner

9 Computational Modeling 184
Michael J. Zickar and Jerel E. Slaughter

10 Research Perspectives on Meta-Analysis 198
Allen I. Huffcutt

11 Methodological Issues In Cross-Cultural Organizational Research 216
Michele J. Gelfand, Jana L. Raver, and Karen Holcombe Ehrhart

12 Issues in Multilevel Research: Theory Development, Measurement, and Analysis 247
David A. Hofmann

13 Beyond Online Surveys: Internet Research Opportunities for Industrial-Organizational Psychology 275
Jeffrey M. Stanton and Steven G. Rogelberg

Part III Data Investigation 295

14 Outliers and Influential Cases: Handling those Discordant Contaminated Maverick Rogues 297
Philip L. Roth and Fred S. Switzer III

15 Coping With Missing Data 310
Fred S. Switzer III and Philip L. Roth

16 Item Analysis: Theory and Practice Using Classical and Modern Test Theory 324
Barbara B. Ellis and Alan D. Mead

17 Method Variance and Method Bias in Industrial and Organizational Psychology 344
James M. Conway

18 Basic and Advanced Measurement Models for Confirmatory Factor Analysis 366
Larry J. Williams, Lucy R. Ford, and Nhung Nguyen

19 Modeling Complex Data Structures: The General Linear Model and Beyond 390
Richard P. DeShon and Scott B. Morris

20 Longitudinal Modeling 412
David Chan

21 Modeling Nonlinear Relationships: Neural Networks and Catastrophe Analysis 431
Paul J. Hanges, Robert G. Lord, Ellen G. Godfrey, and Jana L. Raver

Part IV Concluding Thoughts 457

22 Writing Research Articles: Update on the Article Review Checklist 459
Erica I. Desrosiers, Kathryn Sherony, Eduardo Barros, Gary A. Ballinger, Sinem Senol, and Michael A. Campion

23 Securing our Collective Future: Challenges Facing Those Designing and Doing Research in Industrial and Organizational Psychology 479
Steven G. Rogelberg and Margaret E. Brooks-Laber

Name Index 486

Subject Index 506