Evaluation Handbook

Debra J. Rog, PhD, is CEO and Founder of Evaluation Thought Partners, providing strategic and design help to a range of clients. She retired as Vice President for Social Policy and Economics Research at Westat in 2025. Throughout her career, Dr. Rog has directed numerous evaluation studies of homeless and housing interventions and systems, mental health and substance abuse interventions, public health programs and initiatives, and criminal justice initiatives, among other areas. She is a recognized expert in evaluation practice and applied research design. Dr. Rog is Associate Director for Faculty Affairs at The Evaluators’ Institute and past president of the American Evaluation Association (AEA). She has been recognized for her evaluation work by the National Institute of Mental Health, the AEA, the Eastern Evaluation Research Society, and the Knowledge Utilization Society.Leonard Bickman, PhD, is Professor Emeritus of Psychology at Vanderbilt University and former Director of the Center for Evaluation and Program Improvement at Peabody College. Dr. Bickman is a nationally recognized leader in program evaluation and mental health services research on children and adolescents. He is past president of the American Evaluation Association (AEA) and the Society for the Psychological Study of Social Issues. Dr. Bickman's contributions have been recognized with the Outstanding Evaluation Award from the AEA, the Award for Distinguished Contributions to Research in Public Policy from the American Psychological Association, and the Secretary's Award for Distinguished Service from the U.S. Department of Health and Human Services, among other honors.

"This is the kind of book that I wish had existed when I was new to evaluation. It masterfully covers major concepts in the field, with an eye toward the practical. Many of the easy-to-understand chapters offer examples, tools, or checklists to help put the ideas into practice. This book will be a valuable addition to the required reading for students in our certificate, master’s, and doctoral programs. It lives up to its promise as an evaluator’s companion."--Bianca Montrosse-Moorhead, PhD, Neag School of Education, University of Connecticut"This handbook will be essential reading for all my graduate students in evaluation and applied research! Each chapter is written by well-respected evaluation legends, who offer many practical tools, insights, and proven strategies for enhancing the professional practice of evaluation. Whether you're a beginner or seasoned professional, this resource will elevate your work and thinking about evaluation."--Tiffany Berry, PhD, Dean and Professor, School of Social Science, Policy, and Evaluation, Claremont Graduate University"Framed by the American Evaluation Association's Evaluator Competencies, this comprehensive handbook unpacks key components, responsibilities, and issues that are unique to the practice of evaluation. Students, emerging evaluators, and instructors will appreciate the concrete examples, detailed illustrations, and practical advice that bring each foundational topic to life and provide expert guidance for practice across varying contexts."--Rebecca M. Teasdale, PhD, Department of Educational Psychology, University of Illinois at Chicago-

• I. Foundation for the Volume1. Setting the Stage: Supporting the Diverse Knowledge and Skills Evaluators Need in an Ever-Changing Context, Debra J. Rog & Leonard Bickman2. Competencies for Program Evaluators, Jean A. KingII. Evaluation Theories, Foundations, Principles, and Purpose3. Evaluative Thinking: Understanding and Applying the Foundations of Evaluation, Thomas Archibald, Jane Buckley, & Guy O’Grady Sharrock4. Evaluation Theories: Guidance to Evaluating in Various Circumstances, Melvin M. Mark5. Valuing in Evaluation, Emily F. Gates & Thomas A. Schwandt6. Equity in Evaluation, Donna Durant Atkinson7. Ethical Challenges, Michael Morris8. Fostering Evaluation Use, Marvin C. Alkin & Anne T. Vo9. Illuminating Evaluation's Kaleidoscope: Beautiful, Diverse, Ever-Changing Manifestations, Michael Quinn PattonIII. Answering Evaluation Questions: Designs, Methods, and Analyses10. Collaborative, Participatory, and Empowerment Evaluation: From Community Consultation to Community Control, David Fetterman, Liliana Rodríguez-Campos, & Ann Zukoski11. Making the Most of Evaluations: Strategies for Assessing Program Evaluability and Evaluation Feasibility, Debra J. Rog12. Monitoring Program Implementation, Byron J. Powell, Leonard Bickman, & Kimberly E. Hoagwood13. Examining Outcomes and Impacts: Designs and Strategies in Theory and Practice, Laura R. Peck & R. Bradley Snyder14. Combining Costs and Results: Designs, Strategies, and Analysis, Robert Shand, A. Brooks Bowden, & Henry Levin15. Evaluation as Storytelling: Using a Qualitative Design, Sharon Rallis & Janet Usinger16. Planning, Data Collection, and Data Preparation for Quantitative Analysis, Erica Harbatkin, Gary T. Henry, & Lam D. Pham17. Conducting a Quantitative Analysis, Lam D. Pham, Gary T. Henry, & Erica Harbatkin18. Mixed Methods Design, Tarek Azzam & Natalie JonesIV. Planning, Managing, and Implementing Evaluations19. Designing and Planning an Evaluation: Beyond Methods, Darlene F. Russ-Eft20. Logic Models and Program Theory, Joy Frechtling21. Resource Planning, Leonard Bickman22. The Role of an Internal Evaluator, Arnold Love23. The Independent Consultant: An Insider’s Guide to a Consulting Career, Gail Vallance Barrington24. Conducting Evaluations under Budget, Time, and Data Constraints: An International Perspective, Michael BambergerV. Crosscutting Issues25. Communicating with Stakeholders, Glenn O’Neil26. Information Visualization and Evaluation, Tarek Azzam, Sarah Douville, Ciara Knight, Piper Grandjean Targos, & Natalie Jones27. Exemplary Evaluations in a Multicultural World, Stewart I. DonaldsonGlossaryAuthor IndexSubject IndexContributors