John J. Fremer - Böcker

High stakes tests are the gatekeepers to many educational and professional goals. As such, the incentive to cheat is high. This Handbook is the first to offer insights from experts within the testing community, psychometricians, and policymakers to identify and develop best practice guidelines for the design of test security systems for a variety of testing genres. Until now this information was scattered and often resided inside testing companies. As a result, rather than being able to learn from each other’s experiences, each testing entity was left to re-create their own test security wheel. As a whole the book provides invaluable insight into the prevalence of cheating and “best practices” for designing security plans, training personnel, and detecting and investigating misconduct, to help develop more secure testing systems and reduce the likelihood of future security breaches. Actual case studies from a variety of settings bring to life how security systems really work. Examples from both domestic and international programs are provided. Highlights of coverage include:• Best practices for designing secure tests• Analysis of security vulnerabilities for all genres of testing• Practical cheating prevention and detection strategies• Lessons learned in actual security violations in high profile testing programs. Part I focuses on how tests are delivered for paper-and-pencil, technology-based, and classroom testing and writing assessment. Each chapter addresses the prevalence of the problem and threats to security, prevention, and detection. Part II addresses issues essential to maintaining a secure testing program such as planning and monitoring, physical security, the detection of group-based cheating, investigating misconduct, and communicating about security-related issues. Part III examines actual examples of cheating-- how the cheating was done, how it was detected, and the lessons learned. Part III provides insight into security issues within each of the Association of Test Publishers’ four divisions: certification/licensure, clinical, educational, and industrial/organizational testing. Part III’s conclusion revisits the issues addressed in the case studies and identifies common themes. Intended for organizations, professionals, educators, policy makers, researchers, and advanced students that design, develop, or use high stakes tests, this book is also ideal for graduate level courses on test development, educational measurement, or educational policy.

High stakes tests are the gatekeepers to many educational and professional goals. As such, the incentive to cheat is high. This Handbook is the first to offer insights from experts within the testing community, psychometricians, and policymakers to identify and develop best practice guidelines for the design of test security systems for a variety of testing genres. Until now this information was scattered and often resided inside testing companies. As a result, rather than being able to learn from each other’s experiences, each testing entity was left to re-create their own test security wheel. As a whole the book provides invaluable insight into the prevalence of cheating and “best practices” for designing security plans, training personnel, and detecting and investigating misconduct, to help develop more secure testing systems and reduce the likelihood of future security breaches. Actual case studies from a variety of settings bring to life how security systems really work. Examples from both domestic and international programs are provided. Highlights of coverage include:• Best practices for designing secure tests• Analysis of security vulnerabilities for all genres of testing• Practical cheating prevention and detection strategies• Lessons learned in actual security violations in high profile testing programs. Part I focuses on how tests are delivered for paper-and-pencil, technology-based, and classroom testing and writing assessment. Each chapter addresses the prevalence of the problem and threats to security, prevention, and detection. Part II addresses issues essential to maintaining a secure testing program such as planning and monitoring, physical security, the detection of group-based cheating, investigating misconduct, and communicating about security-related issues. Part III examines actual examples of cheating-- how the cheating was done, how it was detected, and the lessons learned. Part III provides insight into security issues within each of the Association of Test Publishers’ four divisions: certification/licensure, clinical, educational, and industrial/organizational testing. Part III’s conclusion revisits the issues addressed in the case studies and identifies common themes. Intended for organizations, professionals, educators, policy makers, researchers, and advanced students that design, develop, or use high stakes tests, this book is also ideal for graduate level courses on test development, educational measurement, or educational policy.

Although computer-based tests (CBT) have been administered for many years, improvements in the speed and power of computers coupled with reductions in their cost have made large-scale computer delivery of tests increasingly feasible. CBT is now a common form of test delivery for licensure, certification, and admissions tests. Many large-scale, high-stakes testing programs have introduced CBT either as an option or as the sole means of test delivery. Although this movement to CBT has, to a great extent, been successful, it has not been without problems. Advances in psychometrics are required to ensure that those who rely on test results can have at least the same confidence in CBTs as they have in traditional forms of assessment. This volume stems from an ETS-sponsored colloquium in which more than 200 measurement professionals from eight countries and 29 states convened to assess the current and future status of CBT. The formal agenda for the colloquium was divided into three major segments: Test Models, Test Administration, and Test Analysis and Scoring. Each segment consisted of several presentations followed by comments from noted psychometricians and a break-out session in which presenters and discussants identified important issues and established priorities for a CBT research agenda. This volume contains the papers presented at the colloquium, the discussant remarks based on those papers, and the research agenda that was generated from the break-out sessions. Computer-Based Testing: Building the Foundation for Future Assessments is must reading for professionals, scholars, and advanced students working in the testing field, as well as people in the information technology field who have an interest in testing.