Test Fraud

Neal Kingston is the Director of the Achievement and Assessment Institute, Co-Director of the Center for Educational Testing and Evaluation, and Professor of Educational Psychology at the University of Kansas. He has managed all aspects of the educational testing process for both general and alternate assessments, including as an Executive Director at Educational Testing Service, Associate Commissioner for Curriculum and Assessment at the Kentucky Department of Education, Senior Vice President at Measured Progress, Vice President and General Manager at CTB/McGraw-Hill, and Director of CETE at the University of Kansas. He has published and presented more than 100 articles, papers, and book chapters on assessment.Amy Clark is a Research Associate in psychometrics at the Center for Educational Testing and Evaluation at the University of Kansas. She began her career as a classroom teacher and received both her M.S and Ph.D. in Educational Psychology from the University of Kansas specializing in Research, Evaluation, Measurement, and Statistics. Her research interests include exploring potential threats to validity, accountability issues, and diagnostic assessment.

"A very solid review of statistical methods to detect cheating on tests. Kingston has built on his quite successful cheating detection conference and provided those of us who want to keep up with developments in the field a useful resource." – Gregory Cizek, University of North Carolina - Chapel Hill, USA"This book addresses a current and future critical need by bringing together in one place the methods used to analyze test results for a variety of types of test fraud. Given the obvious epidemic of cheating in high-stakes testing programs, in the world today, from education to the workplace, its publication could not have come at a better time." – David Foster, CEO, Caveon Test Security

• 1. Introduction Neal Kingston and Amy Clark 2. A Brief History of Research on Test Fraud Detection and Prevention Amy Clark and Neal Kingston 3. Cheating: Some Ways to Detect it Badly Howard Wainer Part 1: Similarities in Responses 4. Relationships of Examinee Pair Characteristics and Item Response Similarity Jeff Allen 5. A Parametric Approach to Detect a Disproportionate Number of Identical Item Responses on a Test Leonardo S. Sotaridona, Arianto Wibowo, and Irene Hendrawan 6. Detection of Non-Independent Test Taking by Similarity Analysis Dennis Maynes Part 2: Macro Level Cheating 7. Local Outlier Detection in Data Forensics: Data Mining Approach to Flag Unusual Schools Mayuko Simon 8. Macro Level Systems of Statistical Evidence Indicative of Cheating Michael Chajewski, YoungKoung Kim, Judit Antal, and Kevin Sweeney 9. A Bayesian Hierarchical Linear Modeling Approach for Detecting Cheating and Aberrance William Skorupski and Karla Egan Part 3: Answer Changing Behavior 10. Patterns of Erasure Behavior for a Large-Scale Assessment Andrew A. Mroch, Yang Lu, Chi-Yu Huang, and Deborah J. Harris 11. AYP consequences and Erasure Behavior Vincent Primoli 12. An Exploration of Answer Changing Behavior on a Computer-Based High-Stakes Achievement Test Gail C. Tiemann and Neal M. Kingston Part 4: Detection of Aberrant Responses 13. Identifying Non-Effortful Student Behavior on Adaptive Tests: Implications for Test Fraud Detection Steven L. Wise, Lingling Ma, and Robert A. Theaker 14. A Method for Measuring Performance Inconsistency by Using Score Differences Dennis Maynes Part 5: Multiple Methods 15. Data Forensics: A Compare-and-Contrast Analysis of Multiple Methods Christie Plackner and Vincent Primoli 16. Using Multiple Methods to Detect Aberrant Data Karla Egan and Jessalyn Smith 17. Test Security for Multistage Tests: A Quality Control Perspective Charles Lewis, Yi-Hsuan Lee and Alina A. von Davier