Handbook of Research Methods in Industrial and Organizational Psychology

"This one volume covers both traditional design and measurement issues as well as a host of cutting-edge topics. At last a readable and comprehensive review of research methodology for the organizational scientist!" Robert L. Dipboye, Rice University "This handbook is 'must-reading' for all graduate students in I/O psychology as well as for the more experienced I/O researcher and practitioner who will benefit from a review, an update, and the opportunity to learn new approaches." Sheldon Zedeck, University of California at Berkeley "Rogelberg's handbook is a Rosetta Stone for researchers." Milton D. Hakel, Bowling Green State University "A handbook that brings together the best researchers and thinkers in the areas of social science methodology and data analysis. This informative collection is a 'must-read' for all those interested in method-related issues." Wally Borman, University of South Florida "This volume provides a comprehensive and cutting-edge examination of research and statistical methods that are used in the field. It will be an invaluable resource for faculty and students. I have no doubt that the book will easily meet its goal of helping to improve research quality." James L. Farr, Pennsylvania State University "Excellent coverage of key issues and packed with useful ideas." Peter Warr, University of Sheffield "The topics are well chosen and the chapters are written in an accessible style. The handbook is an indispensable reference for those interested in this important area." Nik Chmiel, Queen's University, Belfast

Dr. Steven G. Rogelberg (Associate Professor, Psychology and Adjunct Associate Professor, Business Administration) is Director of the Industrial and Organizational Psychology Program at UNC Charlotte. He has over 45 publications and 25 invited addresses/colloquiums addressing issues such as organizational research methods, team effectiveness, health and employee well-being, meetings at work, and organizational development. He is the Editor-in-Chief of the two-volume Encyclopedia of Industrial and Organizational Psychology (in progress). Recent honors include being named Chair of Education and Training for the Society of Industrial and Organizational Psychology (SIOP), serving as a SIOP Executive Board Member, serving as Guest Editor for Organizational Research Methods, receiving the 2001 Bowling Green State University (BGSU) Psi Chi Professor of the Year Award, and receiving the BGSU Master Teacher Award. Prior to his recent tenure at UNCC, Rogelberg was an Associate Professor of Psychology in the Industrial and Organizational Psychology area at BGSU. Before completing his Ph.D. in Industrial/Organizational Psychology at the University of Connecticut in 1994, he received his undergraduate B.Sc. degree from Tufts University in 1989.

List of Contributors x Preface xii Acknowledgments xiii Part I Foundations 1 1 History of Research Methods in Industrial and Organizational Psychology: Measurement, Design, Analysis 3 James T. Austin, Charles A. Scherbaum, and Robert A. Mahlman 2 Ethics in Research 34 Herman Aguinis and Christine A. Henle 3 Validity and Reliability 57 Robert M. Guion 4 The Relative Validity and Usefulness of Various Empirical Research Designs 77 Eugene F. Stone-Romero 5 An Introduction to Qualitative Research: Its Potential for Industrial and Organizational Psychology 99 Karen Locke and Karen Golden-Biddle 6 Using Power Analysis to Evaluate and Improve Research 119 Kevin Murphy Part II Data Collection Procedures and Approaches 139 7 Organizational Survey Research 141 Steven G. Rogelberg, Allan H. Church, Janine Waclawski, and Jeffrey M. Stanton 8 Qualitative Data Collection and Analysis 161 Peter D. Bachiochi and Sara P. Weiner 9 Computational Modeling 184 Michael J. Zickar and Jerel E. Slaughter 10 Research Perspectives on Meta-Analysis 198 Allen I. Huffcutt 11 Methodological Issues In Cross-Cultural Organizational Research 216 Michele J. Gelfand, Jana L. Raver, and Karen Holcombe Ehrhart 12 Issues in Multilevel Research: Theory Development, Measurement, and Analysis 247 David A. Hofmann 13 Beyond Online Surveys: Internet Research Opportunities for Industrial-Organizational Psychology 275 Jeffrey M. Stanton and Steven G. Rogelberg Part III Data Investigation 295 14 Outliers and Influential Cases: Handling those Discordant Contaminated Maverick Rogues 297 Philip L. Roth and Fred S. Switzer III 15 Coping With Missing Data 310 Fred S. Switzer III and Philip L. Roth 16 Item Analysis: Theory and Practice Using Classical and Modern Test Theory 324 Barbara B. Ellis and Alan D. Mead 17 Method Variance and Method Bias in Industrial and Organizational Psychology 344 James M. Conway 18 Basic and Advanced Measurement Models for Confirmatory Factor Analysis 366 Larry J. Williams, Lucy R. Ford, and Nhung Nguyen 19 Modeling Complex Data Structures: The General Linear Model and Beyond 390 Richard P. DeShon and Scott B. Morris 20 Longitudinal Modeling 412 David Chan 21 Modeling Nonlinear Relationships: Neural Networks and Catastrophe Analysis 431 Paul J. Hanges, Robert G. Lord, Ellen G. Godfrey, and Jana L. Raver Part IV Concluding Thoughts 457 22 Writing Research Articles: Update on the Article Review Checklist 459 Erica I. Desrosiers, Kathryn Sherony, Eduardo Barros, Gary A. Ballinger, Sinem Senol, and Michael A. Campion 23 Securing our Collective Future: Challenges Facing Those Designing and Doing Research in Industrial and Organizational Psychology 479 Steven G. Rogelberg and Margaret E. Brooks-Laber Name Index 486 Subject Index 506