James A. Wollack - Böcker

High stakes tests are the gatekeepers to many educational and professional goals. As such, the incentive to cheat is high. This Handbook is the first to offer insights from experts within the testing community, psychometricians, and policymakers to identify and develop best practice guidelines for the design of test security systems for a variety of testing genres. Until now this information was scattered and often resided inside testing companies. As a result, rather than being able to learn from each other’s experiences, each testing entity was left to re-create their own test security wheel. As a whole the book provides invaluable insight into the prevalence of cheating and “best practices” for designing security plans, training personnel, and detecting and investigating misconduct, to help develop more secure testing systems and reduce the likelihood of future security breaches. Actual case studies from a variety of settings bring to life how security systems really work. Examples from both domestic and international programs are provided. Highlights of coverage include:• Best practices for designing secure tests• Analysis of security vulnerabilities for all genres of testing• Practical cheating prevention and detection strategies• Lessons learned in actual security violations in high profile testing programs. Part I focuses on how tests are delivered for paper-and-pencil, technology-based, and classroom testing and writing assessment. Each chapter addresses the prevalence of the problem and threats to security, prevention, and detection. Part II addresses issues essential to maintaining a secure testing program such as planning and monitoring, physical security, the detection of group-based cheating, investigating misconduct, and communicating about security-related issues. Part III examines actual examples of cheating-- how the cheating was done, how it was detected, and the lessons learned. Part III provides insight into security issues within each of the Association of Test Publishers’ four divisions: certification/licensure, clinical, educational, and industrial/organizational testing. Part III’s conclusion revisits the issues addressed in the case studies and identifies common themes. Intended for organizations, professionals, educators, policy makers, researchers, and advanced students that design, develop, or use high stakes tests, this book is also ideal for graduate level courses on test development, educational measurement, or educational policy.

High stakes tests are the gatekeepers to many educational and professional goals. As such, the incentive to cheat is high. This Handbook is the first to offer insights from experts within the testing community, psychometricians, and policymakers to identify and develop best practice guidelines for the design of test security systems for a variety of testing genres. Until now this information was scattered and often resided inside testing companies. As a result, rather than being able to learn from each other’s experiences, each testing entity was left to re-create their own test security wheel. As a whole the book provides invaluable insight into the prevalence of cheating and “best practices” for designing security plans, training personnel, and detecting and investigating misconduct, to help develop more secure testing systems and reduce the likelihood of future security breaches. Actual case studies from a variety of settings bring to life how security systems really work. Examples from both domestic and international programs are provided. Highlights of coverage include:• Best practices for designing secure tests• Analysis of security vulnerabilities for all genres of testing• Practical cheating prevention and detection strategies• Lessons learned in actual security violations in high profile testing programs. Part I focuses on how tests are delivered for paper-and-pencil, technology-based, and classroom testing and writing assessment. Each chapter addresses the prevalence of the problem and threats to security, prevention, and detection. Part II addresses issues essential to maintaining a secure testing program such as planning and monitoring, physical security, the detection of group-based cheating, investigating misconduct, and communicating about security-related issues. Part III examines actual examples of cheating-- how the cheating was done, how it was detected, and the lessons learned. Part III provides insight into security issues within each of the Association of Test Publishers’ four divisions: certification/licensure, clinical, educational, and industrial/organizational testing. Part III’s conclusion revisits the issues addressed in the case studies and identifies common themes. Intended for organizations, professionals, educators, policy makers, researchers, and advanced students that design, develop, or use high stakes tests, this book is also ideal for graduate level courses on test development, educational measurement, or educational policy.

The rising reliance on testing in American education and for licensure and certification has been accompanied by an escalation in cheating on tests at all levels. Edited by two of the foremost experts on the subject, the Handbook of Quantitative Methods for Detecting Cheating on Tests offers a comprehensive compendium of increasingly sophisticated data forensics used to investigate whether or not cheating has occurred. Written for practitioners, testing professionals, and scholars in testing, measurement, and assessment, this volume builds on the claim that statistical evidence often requires less of an inferential leap to conclude that cheating has taken place than do other, more common sources of evidence.This handbook is organized into sections that roughly correspond to the kinds of threats to fair testing represented by different forms of cheating. In Section I, the editors outline the fundamentals and significance of cheating, and they introduce the common datasets to which chapter authors' cheating detection methods were applied. Contributors describe, in Section II, methods for identifying cheating in terms of improbable similarity in test responses, preknowledge and compromised test content, and test tampering. Chapters in Section III concentrate on policy and practical implications of using quantitative detection methods. Synthesis across methodological chapters as well as an overall summary, conclusions, and next steps for the field are the key aspects of the final section.