Wiley Handbook of Cognition and Assessment

André A. Rupp is Research Director at Educational Testing Service (ETS) in Princeton, NJ, where he works with teams that conduct comprehensive evaluation work for mature and emerging automated scoring systems. His research has focused on applications of principled assessment design frameworks in innovative assessment contexts as well as translating the statistical complexities of diagnostic measurement models into practical guidelines for applied specialists. Through dissemination and professional development efforts he is deeply dedicated to helping interdisciplinary teams navigate the complicated trade-offs between scientific, educational, political, and financial drivers of decision-making in order to help shape best methodological practices for evidentiary reasoning for complex assessment design and deployment lifecycles. He is co-author of Diagnostic Measurement: Theory, Methods, and Applications (2010).Jacqueline P. Leighton is Professor and Chair of Educational Psychology at the University of Alberta, Canada. She is past Director of the University of Alberta's Centre for Research in Applied Measurement and Evaluation (CRAME). As a registered psychologist with the College of Alberta Psychologists, her research is focused on measuring the cognitive and socio-emotional processes underlying learning and assessment outcomes, including cognitive diagnostic assessment and feedback delivery and uptake. She has published in a variety of educational measurement journals and is past editor of Educational Measurement: Issues and Practice. She is co-author of The Learning Sciences in Educational Assessment (2011) and Cognitive Diagnostic Assessment for Education: Theory and Applications (2007) and co-editor of The Nature of Reasoning (2004).

• Notes on Contributors ixForeword xixAcknowledgements xxi1 Introduction to Handbook 1André A. Rupp and Jacqueline P. LeightonPart I Frameworks 132 The Role of Theories of Learning and Cognition in Assessment Design and Development 15Paul D. Nichols, Jennifer L. Kobrin, Emily Lai, and James Koepfler3 Principled Approaches to Assessment Design, Development, and Implementation 41Steve Ferrara, Emily Lai, Amy Reilly, and Paul D. Nichols4 Developing and Validating Cognitive Models in Assessment 75Madeleine Keehner, Joanna S. Gorin, Gary Feng, and Irvin R. Katz5 An Integrative Framework for Construct Validity 102Susan Embretson6 The Role of Cognitive Models in Automatic Item Generation 124Mark J. Gierl and Hollis Lai7 Social Models of Learning and Assessment 146William R. Penuel and Lorrie A. Shepard8 Socio‐emotional and Self‐management Variables in Learning and Assessment 174Patrick C. Kyllonen9 Understanding and Improving Accessibility for Special Populations 198Leanne R. Ketterlin‐Geller10 Automated Scoring with Validity in Mind 226Isaac I. Bejar, Robert J. Mislevy, and Mo ZhangPart II Methodologies 24711 Explanatory Item Response Models 249Paul De Boeck, Sun‐Joo Cho, and Mark Wilson12 Longitudinal Models for Repeated Measures Data 267Jeffrey R. Harring and Ari Houser13 Diagnostic Classification Models 297Laine Bradshaw14 Bayesian Networks 328José P. González‐Brenes, John T. Behrens, Robert J. Mislevy, Roy Levy,and Kristen E. DiCerbo15 The Rule Space and Attribute Hierarchy Methods 354Ying Cui, Mark J. Gierl, and Qi Guo16 Educational Data Mining and Learning Analytics 379Ryan S. Baker, Taylor Martin, and Lisa M. RossiPart III Applications 39717 Large‐Scale Standards‐Based Assessments of Educational Achievement 399Kristen Huff, Zachary Warner, and Jason Schweid18 Educational Survey Assessments 427Andreas Oranje, Madeleine Keehner, Hilary Persky, Gabrielle Cayton‐Hodges, and Gary Feng19 Professional Certification and Licensure Examinations 446Richard M. Luecht20 The In‐Task Assessment Framework for Behavioral Data 472Deirdre Kerr, Jessica J. Andrews, and Robert J. Mislevy21 Digital Assessment Environments for Scientific Inquiry Practices 508Janice D. Gobert and Michael A. Sao Pedro22 Assessing and Supporting Hard‐to‐Measure Constructs in Video Games 535Valerie Shute and Lubin Wang23 Conversation‐Based Assessment 563G. Tanner Jackson and Diego Zapata‐Rivera24 Conclusion to Handbook 580Jacqueline P. Leighton and André A. RuppGlossary 588Index 603