Handbook on Measurement, Assessment, and Evaluation in Higher Education

Charles Secolsky is on the faculty at Rockland Community College and County College of Morris, USA.D. Brian Denison is Institutional Research Analyst in the Director of Studies’ Office for Champlain Regional College, Quebec, Canada.

"This updated edition of the Handbook on Measurement, Assessment, and Evaluation in Higher Education draws on a veritable ‘Who’s Who’ of experts in higher education assessment and evaluation to explain everything from terminology to technique. This comprehensive volume will be a constant desk companion of mine in the decades to come."—Peter T. Ewell, President Emeritus, National Center for Higher Education Management Systems (NCHEMS) and Senior Fellow, National Institute for Learning Outcomes Assessment (NILOA), USA"This is the most extensive collection of research on measurement, evaluation, and assessment in higher education available. Covering a broad range of theoretical and practical topics addressed by the most knowledgeable professionals in the field, this book is essential reading for anyone working in higher education who is interested in making evidence based decisions that will benefit students and institutions."—Linda Cook, past President, National Council on Measurement in Education, USA "This handbook is a must-have for faculty, staff, and administrators who lead assessment efforts or are involved with faculty development on their campus. The editors have brought together stellar contributors who, together, balance the practical, theoretical, and technical aspects of measurement, evaluation, and learning assessment in ways that are immediately useful." —Monica Stitt-Bergh, President, Association for the Assessment of Learning in Higher Education, USA

• List of FiguresList of TablesForewordEdward J. YawPreface: Improving Institutional Decision-Making through Educational Measurement, Assessment, and EvaluationCharles Secolsky and D. Brian DenisonAcknowledgementsPart I Measurement, Assessment, and Evaluation in Higher Education: Past, Present, and FutureIntroduction to Part I1. The Failure of Higher Education to Follow the Standards It has Established in Methodology and EvaluationMichael Scriven2. On Measurement in Educational AssessmentRobert J. MislevyPart II Assessment and Evaluation in Higher EducationIntroduction to Part II3. Assessing the Quality of a University, Particularly Its TeachingRobert E. Stake, Gloria Contreras, and Isabel Arbesú4. Validity Issues in Measuring Student SuccessDwight L. Smith III5. Course-Embedded Assessment: Aligning Pedagogical Practices to Enhance Student LearningKathryne Drezek McConnell and Peter E. Doolittle6. Implementing Undergraduate Student Learning Outcomes Assessment at the Program and Institutional LevelsThomas Judd and Bruce Keith7. The Perennial Challenges of AccountabilityJames C. Palmer8. Talking About Data: The Faculty Discourse on Practice, Student Learning, and Evaluative ProcessesWilliam H. Rickards9. Benchmarking in Community CollegesLou A. Guthrie and Jeffrey A. Seybert10. Mixed-Methods Specialists in Action: Linking Mixed-Methods Research to Learning and Classroom AssessmentDelwyn L. Harnisch, John W. Creswell, and Timothy C. GuettermanPart III Theoretical Foundations of Educational MeasurementIntroduction to Part III11. The Validation of Tests in Higher EducationKurt F. Geisinger, Leslie R. Hawley, and Carina McCormick12. ReliabilityBruce Thompson and Tammi Vacha-Haase13. Using Classical Test Theory in Higher EducationDavid A. G. Berg, Elizabeth Schaughency, Jacques van der Meer, and Jeffrey K. Smith 14. Item Response Theory in Measurement, Assessment, and Evaluation for Higher EducationSteven J. Osterlind and Ze Wang15. Generalizability Theory in Assessment ContextsNoreen M. Webb, Richard J. Shavelson, and Jeffrey T. SteedlePart IV Testing and Assessment: Implications for Decision-MakingIntroduction to Part IV16. Scaling, Norming, and EquatingMichael J. Kolen and Amy B. Hendrickson17. Setting and Validating Cut Scores for TestsMary J. Pitoniak and Deanna L. Morgan18. College Placement Testing of Entering StudentsDeanna L. Morgan19. Admissions Testing in College and Graduate EducationRebecca Zwick20. Closing the Accommodation Gap: New Thinking on Accessibility and Accommodations for Secondary and Postsecondary Students with Disabilities Manju Banerjee and Martha L. ThurlowPart V Test Construction and DevelopmentIntroduction to Part V21. Evidence-Centered Design and Postsecondary Assessment Geneva D. Haertel and Reina Fujii22. Building Content and Statistical Test SpecificationsTawnya Knupp and Deborah J. Harris23. Item Analysis for Classroom Assessments in Higher EducationJerome C. Clauser and Ronald K. Hambleton24. Computer-Based Testing in Higher EducationRobert P. Dolan and Kelly S. BurlingPart VI Statistical Approaches in Higher Education Measurement, Assessment, and EvaluationIntroduction to Part VI25. Issues in the Analysis of ChangeD. Betsy McCoach and Karen Rambo-Hernandez26. Multilevel Linear Modeling in Higher Education ContextsYing Lu, Sharon L. Weinberg, and Marc A. Scott27. Statistical Modeling in Educational ResearchZe Wang and Steven J. Osterlind28. An Introduction to Bayesian Statistics with Applications for Higher Education AssessmentGuili ZhangPart VII Approaches to Evaluation in Higher EducationIntroduction to Part VIIThomas E. Grayson29. Program Evaluation, Performance Measures, and Evaluability Assessment in Higher EducationThomas E. Grayson30. Naturalistic EvaluationDavid A. Erlandson31. Responsive EvaluationKelly E. Godfrey and Doreen B. Finkelstein32. Case StudiesEdith J. Cisneros-Cohernour33. Survey Use in Academic Contexts: Considerations and GuidelinesDaphna Harel and Ellen Wentland34. Empowerment Evaluation: Linking Theories, Principles, and Concepts to Practical StepsDavid M. FettermanPart VIII Approaches to Assessment in Higher EducationIntroduction to Part VIII35. Rubric DevelopmentLinda Suskie36. New Learning About Learning: An Introduction to ePortfolio AssessmentSusan Kahn37. The Role of Faculty Grading Processes in Program and General-Education AssessmentBarbara E. Walvoord38. Postsecondary Writing AssessmentPeggy O’Neill and Sandra Murphy39. Testing and Evaluation of English-Language Learners in Higher EducationYoung Yee Kim, James Hart, Jamal Abedi, and Alan Vanneman40. Evaluation and Assessment in an Online Setting: The Case of Asynchronous Online DiscussionAmir Hedayati Mehdiabadi and Wenhao David HuangPart IX Issues in Assessment and Evaluation in Higher EducationIntroduction to Part IX 41. Cognitive Flexibility Theory and the Assessment of 21st-Century SkillsRand J. Spiro, Hannah A. Klautke, Cui Cheng, and Aric Gaunt42. Reporting Assessment Results in Higher EducationApril L. Zenisky and Jerold S. Laguilles43. Presenting Learning Outcomes Assessment Results to Foster UseStaci J. Provezis and Natasha A. Jankowski44. Revisiting Reliability and Validity in Higher Education Research and Program EvaluationMargaret D. LeCompte and Dorothy E. Aguilera-Black Bear45. Assessment of Learning Outcomes in Higher Education: International Comparisons and PerspectivesOlga Zlatkin‐Troitschanskaia, Richard J. Shavelson, and Hans Anand Pant46. Ethical Assessment and Institutional Advancement: Connecting Good Practice with the Need to Move Campuses ForwardAshley FinleyAbout the Contributors