Evaluation and Society – serie

This volume seeks to address select questions drawn from the matrix of the complex issues related to culturally responsive evaluation. We ask, should evaluation be culturally responsive? Is the field heading in the right direction in its attempt to become more culturally responsive? We ask, what is culturally responsive evaluation today and what might it become tomorrow? This edited volume does not promise to deliver answers to all, most, or even many of the complex answers facing the evaluation community regarding the role of culture and cultural context in evaluative theory and practice. This is not a scientific undertaking. We are not ready for concerns with prediction, explanation or control. We are ready for serious explorations, however. Even if the evaluation community cannot articulate the necessary and sufficient conditions for a culturally relevant evaluation it does know several of the desiderata. Our concern and the direction of this volume has been reflections of evaluation theory, history, and practice within the context of culture with illustrative examples.

This volume seeks to address select questions drawn from the matrix of the complex issues related to culturally responsive evaluation. We ask, should evaluation be culturally responsive? Is the field heading in the right direction in its attempt to become more culturally responsive? We ask, what is culturally responsive evaluation today and what might it become tomorrow? This edited volume does not promise to deliver answers to all, most, or even many of the complex answers facing the evaluation community regarding the role of culture and cultural context in evaluative theory and practice. This is not a scientific undertaking. We are not ready for concerns with prediction, explanation or control. We are ready for serious explorations, however. Even if the evaluation community cannot articulate the necessary and sufficient conditions for a culturally relevant evaluation it does know several of the desiderata. Our concern and the direction of this volume has been reflections of evaluation theory, history, and practice within the context of culture with illustrative examples.

Empiricism provides the backbone of knowledge creation within social science disciplines (e.g., psychology, sociology) and applied domains of study (e.g., education, administration) alike. Yet, relative to such domains of inquiry, comparatively little empirical research on evaluation has occurred, and the research knowledge base been infrequently synthesized and integrated to influence theory and practice. The proposed book aims to fill this void with regard to participatory evaluation, a set of collaborative approaches to evaluation that is receiving considerable attention of late, including a growing body of empirical studies. The authors begin in Part 1 with the delineation of a widely known and familiar conceptual framework for participatory evaluation. They then use the framework in Part 2 as a guide to conducting an extensive review of the extant empirical knowledge base in participatory evaluation, culminating in a thematic analysis of what we know about the approach. In Part 3 the authors focus on methodological considerations of doing research on participatory evaluation through a critique of existing studies and an explication of design choices drawn from their own research program. The book concludes in Part 4 with implications for moving the field forward in terms of important research questions, methodological direction and evaluation practice.This book will be of central interest to evaluation theorists and to those who choose to conduct research on evaluation; appeal will be conceptual and methodological. It will provide excellent supplementary reading for graduate students, many of whom seek to develop empirical studies on evaluation as part of their graduate programs. Rife with examples of participatory evaluation in practice, and practical implications, the book will also benefit evaluation practitioners with an interest in evaluation capacity building and participatory and collaborative approaches to practice.

Empiricism provides the backbone of knowledge creation within social science disciplines (e.g., psychology, sociology) and applied domains of study (e.g., education, administration) alike. Yet, relative to such domains of inquiry, comparatively little empirical research on evaluation has occurred, and the research knowledge base been infrequently synthesized and integrated to influence theory and practice. The proposed book aims to fill this void with regard to participatory evaluation, a set of collaborative approaches to evaluation that is receiving considerable attention of late, including a growing body of empirical studies. The authors begin in Part 1 with the delineation of a widely known and familiar conceptual framework for participatory evaluation. They then use the framework in Part 2 as a guide to conducting an extensive review of the extant empirical knowledge base in participatory evaluation, culminating in a thematic analysis of what we know about the approach. In Part 3 the authors focus on methodological considerations of doing research on participatory evaluation through a critique of existing studies and an explication of design choices drawn from their own research program. The book concludes in Part 4 with implications for moving the field forward in terms of important research questions, methodological direction and evaluation practice.This book will be of central interest to evaluation theorists and to those who choose to conduct research on evaluation; appeal will be conceptual and methodological. It will provide excellent supplementary reading for graduate students, many of whom seek to develop empirical studies on evaluation as part of their graduate programs. Rife with examples of participatory evaluation in practice, and practical implications, the book will also benefit evaluation practitioners with an interest in evaluation capacity building and participatory and collaborative approaches to practice.

The impetus for this volume comes from reflecting on many years of experience, successes and failures in development evaluation in Asia and Africa, and from recent work supported by the Rockefeller Foundation on Rethinking, Reshaping, and Reforming Evaluation. The concepts, frameworks and ideas presented in this volume are a useful contribution to the ongoing efforts at rethinking, reforming and reshaping international development evaluation. They come from leading thinkers and practitioners in development, evaluation, research and academia who have recognized that development evaluation must evolve if it is to respond to the challenges of the 21st Century and play a meaningful role in social and economic transformation. This volume will be of great interest to evaluation scholars, practitioners, and students, particularly to those interested in international development projects, programs, and policies. This book will be appropriate for a wide range of courses, included Introduction to Evaluation, International Development Evaluation, Program Evaluation, Policy Evaluation, and evaluation courses in International Development, International Relations, Public Policy, Public Health, Human Services, Sociology, and Psychology.

The impetus for this volume comes from reflecting on many years of experience, successes and failures in development evaluation in Asia and Africa, and from recent work supported by the Rockefeller Foundation on Rethinking, Reshaping, and Reforming Evaluation. The concepts, frameworks and ideas presented in this volume are a useful contribution to the ongoing efforts at rethinking, reforming and reshaping international development evaluation. They come from leading thinkers and practitioners in development, evaluation, research and academia who have recognized that development evaluation must evolve if it is to respond to the challenges of the 21st Century and play a meaningful role in social and economic transformation. This volume will be of great interest to evaluation scholars, practitioners, and students, particularly to those interested in international development projects, programs, and policies. This book will be appropriate for a wide range of courses, included Introduction to Evaluation, International Development Evaluation, Program Evaluation, Policy Evaluation, and evaluation courses in International Development, International Relations, Public Policy, Public Health, Human Services, Sociology, and Psychology.

The impetus for this volume lives in a rich and vibrant past. It is organized to honor one of the founders and most prolific contributors to the profession and transdiscipline of evaluation -- Professor Michael Scriven, and to illuminate the future of evaluation in society. Professor Scriven often shares stories of his meetings with Albert Einsten and the frame-breaking evaluation revolution he has led against the value free doctrine of the social sciences. Both his wide eyed graduate students and the more grizzled evaluation veterans in his professional development workshops quickly learn that Scriven is well traveled and has exchanged some of the boldest ideas and visions with the most brilliant thinkers of his time. Scriven insisted that the 2011 Stauffer Symposium and this volume be organized in that genre. He urged us to invite the most thoughtful and influential evaluation theorists and practitioners we could find to join him in a conversation about the future of evaluation in society.Scriven challenges us to examine the five great paradigm shifts that have revolutionized the foundations of evaluation, and that he believes will form the basis for a much brighter future for evaluation in society. Scriven’s revolutionary ideas are followed and challenged by a group of thought leaders in evaluation who do not necessarily shared his views on evaluation, but who have earned his deepest respect and whose evaluation work he admires including Michael Quinn Patton, Ernest House, Daniel Stufflebeam, Robert Stake, Jennifer Greene, Karen Kirkhart, Melvin Mark, Rodney Hopson, and Christina Christie. However, despite his insistence that his colleagues stay focused on the future of evaluation, you will find that many have recounted their adventures, exchanges, and debates with him over the years, as well as pointed out the many contributions that he has made to the development of evaluation and to the improvement of society through his amazing portfolio of evaluation contributions.The Future of Evaluation in Society: A Tribute to Michael Scriven will be of great interest to evaluation scholars, practitioners, and students of evaluation. It will be appropriate for use in a wide range of evaluation courses including Introduction to Evaluation, Evaluation Theory, and Evaluation Practice courses.

The impetus for this volume lives in a rich and vibrant past. It is organized to honor one of the founders and most prolific contributors to the profession and transdiscipline of evaluation -- Professor Michael Scriven, and to illuminate the future of evaluation in society. Professor Scriven often shares stories of his meetings with Albert Einsten and the frame-breaking evaluation revolution he has led against the value free doctrine of the social sciences. Both his wide eyed graduate students and the more grizzled evaluation veterans in his professional development workshops quickly learn that Scriven is well traveled and has exchanged some of the boldest ideas and visions with the most brilliant thinkers of his time. Scriven insisted that the 2011 Stauffer Symposium and this volume be organized in that genre. He urged us to invite the most thoughtful and influential evaluation theorists and practitioners we could find to join him in a conversation about the future of evaluation in society.Scriven challenges us to examine the five great paradigm shifts that have revolutionized the foundations of evaluation, and that he believes will form the basis for a much brighter future for evaluation in society. Scriven’s revolutionary ideas are followed and challenged by a group of thought leaders in evaluation who do not necessarily shared his views on evaluation, but who have earned his deepest respect and whose evaluation work he admires including Michael Quinn Patton, Ernest House, Daniel Stufflebeam, Robert Stake, Jennifer Greene, Karen Kirkhart, Melvin Mark, Rodney Hopson, and Christina Christie. However, despite his insistence that his colleagues stay focused on the future of evaluation, you will find that many have recounted their adventures, exchanges, and debates with him over the years, as well as pointed out the many contributions that he has made to the development of evaluation and to the improvement of society through his amazing portfolio of evaluation contributions.The Future of Evaluation in Society: A Tribute to Michael Scriven will be of great interest to evaluation scholars, practitioners, and students of evaluation. It will be appropriate for use in a wide range of evaluation courses including Introduction to Evaluation, Evaluation Theory, and Evaluation Practice courses.

In this book, Ernie House reframes how we think about evaluation by reconsidering three key concepts of values, biases, and practical wisdom. The first part of the book reconstructs core evaluation concepts, with a focus on the origins of our values and biases. The second part explores how we handle values and biases in practice, and the third shows how we learn practical wisdom and use it in evaluations.Value is the central concept in this volume, yet it’s a fuzzy concept. In Part I, Ernie clarifies the concept of value by addressing basic questions: What are values? Where do they come from? Why do we have them? Why is our conception so confused? How do we handle values in evaluations?In Part II, another central concept is added, that of biases. Prominent evaluation frameworks have focused on biases, including Campbell and Stanley’s (1963) framework for validating causal inferences and Scriven’s (1972) conception of objectivity, which is achieved by correcting for biases in general. In addition, research on thought processes has made progress by focusing on cognitive biases (Kahneman, 2011). Even so, through a case example, Ernie demonstrates that the concept of biases is under-appreciated and not well engaged in evaluation practice.The third important concept, featured in Part III, is practical wisdom, which is the knowledge that evaluators acquire through experience. Practical wisdom informs what we do, possibly as much as theory. Experienced evaluators often conduct evaluations in similar ways, regardless of their theory, because practical wisdom determines much of what they do. Ernie provides concrete examples of practical wisdom and how we employ it. Throughout the book, he draws on the empirical research on thinking processes, especially Kahneman’s Thinking Fast and Slow (2011).This book will be of interest and relevance to all evaluation scholars and practitioners, as it thoughtfully engages core constructs of the field. The book can also well serve as a supplementary text in multiple evaluation courses, as it offers valuable conceptual and practical perspectives on our craft.

In this book, Ernie House reframes how we think about evaluation by reconsidering three key concepts of values, biases, and practical wisdom. The first part of the book reconstructs core evaluation concepts, with a focus on the origins of our values and biases. The second part explores how we handle values and biases in practice, and the third shows how we learn practical wisdom and use it in evaluations.Value is the central concept in this volume, yet it’s a fuzzy concept. In Part I, Ernie clarifies the concept of value by addressing basic questions: What are values? Where do they come from? Why do we have them? Why is our conception so confused? How do we handle values in evaluations?In Part II, another central concept is added, that of biases. Prominent evaluation frameworks have focused on biases, including Campbell and Stanley’s (1963) framework for validating causal inferences and Scriven’s (1972) conception of objectivity, which is achieved by correcting for biases in general. In addition, research on thought processes has made progress by focusing on cognitive biases (Kahneman, 2011). Even so, through a case example, Ernie demonstrates that the concept of biases is under-appreciated and not well engaged in evaluation practice.The third important concept, featured in Part III, is practical wisdom, which is the knowledge that evaluators acquire through experience. Practical wisdom informs what we do, possibly as much as theory. Experienced evaluators often conduct evaluations in similar ways, regardless of their theory, because practical wisdom determines much of what they do. Ernie provides concrete examples of practical wisdom and how we employ it. Throughout the book, he draws on the empirical research on thinking processes, especially Kahneman’s Thinking Fast and Slow (2011).This book will be of interest and relevance to all evaluation scholars and practitioners, as it thoughtfully engages core constructs of the field. The book can also well serve as a supplementary text in multiple evaluation courses, as it offers valuable conceptual and practical perspectives on our craft.

Racial, ethnic, linguistic, and cultural diversity has become of global importance in places where many never would have imagined. Increasing diversity in the U.S., Europe, Africa, New Zealand, and Asia strongly suggests that a homogeneity- based focus is rapidly becoming an historical artifact. This book highlights that culturally responsive evaluation (CRE) should no longer be viewed as a luxury or an option in our work as evaluators and this perspective requires a distinct shift from "simple" linear cause-effect models and reductionist thinking to include more holistic and culturally responsive approaches.This book expands on Culturally Responsive Evaluation, exploring theory and practice globally. It highlights indigenous perspectives from North America and New Zealand while examining immigrant and Roma experiences in Europe, emphasizing its growing international relevance.

Racial, ethnic, linguistic, and cultural diversity has become of global importance in places where many never would have imagined. Increasing diversity in the U.S., Europe, Africa, New Zealand, and Asia strongly suggests that a homogeneity- based focus is rapidly becoming an historical artifact. This book highlights that culturally responsive evaluation (CRE) should no longer be viewed as a luxury or an option in our work as evaluators and this perspective requires a distinct shift from "simple" linear cause-effect models and reductionist thinking to include more holistic and culturally responsive approaches.This book expands on Culturally Responsive Evaluation, exploring theory and practice globally. It highlights indigenous perspectives from North America and New Zealand while examining immigrant and Roma experiences in Europe, emphasizing its growing international relevance.

This book highlights views on responsive, participatory and democratic approaches to evaluation from an ethos of care. It critically scrutinizes and discusses the invisibility of care in our contemporary Western societies and evaluation practices that aim to measure practices by external standards. Alternatively, the book proposes several foci for evaluators who work from a care perspective or wish to encourage a caring society. This is a society that sees evaluation and care as a continuously unfolding relational practice of moral-political learning contributing to life-sustaining webs.‘At one level is the evaluator’s immediately responsive and interpersonal encounter with the personal troubles of social actors, most visible, as Mills originally pointed out, in an individual’s biography and in those social settings directly open to the individual’s lived experience. (...) At another level, the sociological and political level, the evaluator operates at what Mills called the arena of public issues where immediate personal troubles are seen not only as problems encountered by individuals but as the result of structural and political arrangements in society (...) evaluation for a caring society is thought to operate at both levels’ (Thomas A. Schwandt, Professor Emeritus, University of Illinois at Urbana-Champaign).‘The intricate relationship between evaluation and care is hardly addressed by evaluators or caregivers. This book fills a gap, as it focuses on the relationship between evaluation and care and provides a multitude of examples of evaluation as a caring practice (...) the book can serve as an antidote to the present-day haste in social practices, and contribute, in form and content, to developing an evaluation practice which may foster a caring society’ (Guy Widdershoven, Professor of Philosophy and Ethics of Medicine and head of the Department of Medical Humanities at VU University Medical Center, VU University Amsterdam).

This book highlights views on responsive, participatory and democratic approaches to evaluation from an ethos of care. It critically scrutinizes and discusses the invisibility of care in our contemporary Western societies and evaluation practices that aim to measure practices by external standards. Alternatively, the book proposes several foci for evaluators who work from a care perspective or wish to encourage a caring society. This is a society that sees evaluation and care as a continuously unfolding relational practice of moral-political learning contributing to life-sustaining webs.‘At one level is the evaluator’s immediately responsive and interpersonal encounter with the personal troubles of social actors, most visible, as Mills originally pointed out, in an individual’s biography and in those social settings directly open to the individual’s lived experience. (...) At another level, the sociological and political level, the evaluator operates at what Mills called the arena of public issues where immediate personal troubles are seen not only as problems encountered by individuals but as the result of structural and political arrangements in society (...) evaluation for a caring society is thought to operate at both levels’ (Thomas A. Schwandt, Professor Emeritus, University of Illinois at Urbana-Champaign).‘The intricate relationship between evaluation and care is hardly addressed by evaluators or caregivers. This book fills a gap, as it focuses on the relationship between evaluation and care and provides a multitude of examples of evaluation as a caring practice (...) the book can serve as an antidote to the present-day haste in social practices, and contribute, in form and content, to developing an evaluation practice which may foster a caring society’ (Guy Widdershoven, Professor of Philosophy and Ethics of Medicine and head of the Department of Medical Humanities at VU University Medical Center, VU University Amsterdam).

Are you a grant maker, manager or evaluator who must assess your work to improve as well as be accountable for the use of resources and results? Does the project, program or organization you fund, manage or evaluate contend with substantial uncertainty about what to do and what will be the results? Do you thus experience constant change and unexpected and unforeseeable actors and factors in your intervention? Do you need to know what you are achieving and how in real time? And therefore, do you seek an alternative to conventional monitoring and evaluation of social change results? If yes, then you are the audience for this book.Beginning in 2002, working closely with co-evaluators and commissioners of evaluations, the author developed Outcome Harvesting to enable evaluators, grant makers, and managers to identify, formulate, verify, and make sense of changes that interventions have influenced in a broad range of cutting–edge innovation and development projects and programs around the world. Over these years, he led Outcome Harvesting evaluative exercises involving almost 500 non-governmental organizations, networks, government agencies, funding agencies, community-based organizations, research institutes and university programs. In over fifty evaluations, with forty co-evaluators he has harvested thousands of outcomes on six continents.Outcome Harvesting has proven useful in evaluations of a great diversity of initiatives: human rights advocacy, political, economic and environmental advocacy, arts and culture, health systems, information and communication technology, conflict and peace, water and sanitation, taxonomy for development, violence against women, rural development, organic agriculture, participatory democracy, waste management, public sector reform, good governance, eLearning, social accountability, and business competition, amongst others.In this book, the author explains the steps of Outcome Harvesting and how to customize them according to the nine underlying principles. He shares his experience and gives practical advice on how to work with Outcome Harvesting and remain true to its essential features.

Are you a grant maker, manager or evaluator who must assess your work to improve as well as be accountable for the use of resources and results? Does the project, program or organization you fund, manage or evaluate contend with substantial uncertainty about what to do and what will be the results? Do you thus experience constant change and unexpected and unforeseeable actors and factors in your intervention? Do you need to know what you are achieving and how in real time? And therefore, do you seek an alternative to conventional monitoring and evaluation of social change results? If yes, then you are the audience for this book.Beginning in 2002, working closely with co-evaluators and commissioners of evaluations, the author developed Outcome Harvesting to enable evaluators, grant makers, and managers to identify, formulate, verify, and make sense of changes that interventions have influenced in a broad range of cutting–edge innovation and development projects and programs around the world. Over these years, he led Outcome Harvesting evaluative exercises involving almost 500 non-governmental organizations, networks, government agencies, funding agencies, community-based organizations, research institutes and university programs. In over fifty evaluations, with forty co-evaluators he has harvested thousands of outcomes on six continents.Outcome Harvesting has proven useful in evaluations of a great diversity of initiatives: human rights advocacy, political, economic and environmental advocacy, arts and culture, health systems, information and communication technology, conflict and peace, water and sanitation, taxonomy for development, violence against women, rural development, organic agriculture, participatory democracy, waste management, public sector reform, good governance, eLearning, social accountability, and business competition, amongst others.In this book, the author explains the steps of Outcome Harvesting and how to customize them according to the nine underlying principles. He shares his experience and gives practical advice on how to work with Outcome Harvesting and remain true to its essential features.

Evaluation use was identified by Henry and Mark (2003) as being the single most studied area in the field of evaluation. They refer with a sense of nostalgia to the ‘golden age’ of research on use perhaps almost implying that it came and went. Professor J. Bradley Cousins has had a longstanding and continuing commitment to advancing theory and practice regarding use through empirical research on evaluation, and through the professional development of students and practitioners within North America and internationally. The important influence and impact of the contributions of Cousins and associates is the focus of this edited book.This book brings together a distinguished, international group of authors, to reflect on the areas of contribution of Professor Cousins, and situate his work within contemporary areas of evaluation research and practice. Each chapter describes how the study and practice of evaluation has weaved its way through our understanding of organizational learning, participatory evaluation, and evaluation capacity building. The book concludes with a reflection by Professor Cousins himself on what these insights mean for the field of evaluation, and what future areas of research and contribution can be planned for and anticipated.

Evaluation use was identified by Henry and Mark (2003) as being the single most studied area in the field of evaluation. They refer with a sense of nostalgia to the ‘golden age’ of research on use perhaps almost implying that it came and went. Professor J. Bradley Cousins has had a longstanding and continuing commitment to advancing theory and practice regarding use through empirical research on evaluation, and through the professional development of students and practitioners within North America and internationally. The important influence and impact of the contributions of Cousins and associates is the focus of this edited book.This book brings together a distinguished, international group of authors, to reflect on the areas of contribution of Professor Cousins, and situate his work within contemporary areas of evaluation research and practice. Each chapter describes how the study and practice of evaluation has weaved its way through our understanding of organizational learning, participatory evaluation, and evaluation capacity building. The book concludes with a reflection by Professor Cousins himself on what these insights mean for the field of evaluation, and what future areas of research and contribution can be planned for and anticipated.

Take a journey to 2030 where Visionary Evaluatives abound and link with one another in actively bringing about a sustainable, equitable future. Utilizing a creative storytelling approach, Visionary Evaluation for a Sustainable, Equitable Future brings forward the centrality of values in conjunction with the role of evaluation in building a future of well-being for people, nature, and planet.Visionary Evaluatives are guided by six principles. Those principles highlight a commitment to equity and the sustainability of nature as core values. They emphasize an orientation of humility, compassion, and transparency as Visionary Evaluatives engage with others in a world of living, entangled systems with both obvious and hidden intersectionalities. They require Visionary Evaluatives to engage in deep praxis—mindful and challenging reflection on what is being learned through the intersection of values, iterative action and inquiry, theory, outcomes, and vision. A diverse group of chapter authors share their wisdom through envisioning 2030 and what it might mean to move in the world applying aspects of the Visionary Evaluative Principles.Through Visionary Evaluation for a Sustainable, Equitable Future, you will learn about how you can contribute to a sustainable, equitable future not only in evaluations, as either users or practitioners, but also in your daily actions and lives.

Take a journey to 2030 where Visionary Evaluatives abound and link with one another in actively bringing about a sustainable, equitable future. Utilizing a creative storytelling approach, Visionary Evaluation for a Sustainable, Equitable Future brings forward the centrality of values in conjunction with the role of evaluation in building a future of well-being for people, nature, and planet.Visionary Evaluatives are guided by six principles. Those principles highlight a commitment to equity and the sustainability of nature as core values. They emphasize an orientation of humility, compassion, and transparency as Visionary Evaluatives engage with others in a world of living, entangled systems with both obvious and hidden intersectionalities. They require Visionary Evaluatives to engage in deep praxis—mindful and challenging reflection on what is being learned through the intersection of values, iterative action and inquiry, theory, outcomes, and vision. A diverse group of chapter authors share their wisdom through envisioning 2030 and what it might mean to move in the world applying aspects of the Visionary Evaluative Principles.Through Visionary Evaluation for a Sustainable, Equitable Future, you will learn about how you can contribute to a sustainable, equitable future not only in evaluations, as either users or practitioners, but also in your daily actions and lives.

This volume addresses a fundamental and highly debated issue in the evaluation field – the use of evaluation information for decision-making. Chapter authors honor the contributions of Professor Marvin C. Alkin to the evaluation use literature and advance our thinking on the topic by exploring a wide range of issues related to the theoretical and practical challenges of using evaluation information to make informed, evidence-based decisions. Readers will come away from this volume with a new and clearer understanding of the theoretical, contextual, methodological, and political dimensions of use and with direction for practice. Chapters are written by leading evaluation scholars, including Ernest House; Stewart Donaldson and Tarek Azzam; Eric Barela; Richard D. Nunneley, Jr., Jean A. King, Kelli Johnson, and Laura Pejsa; Eleanor Chelimsky; Michael Quinn Patton; and Wanda D. Casillas, Rodney K. Hopson and Ricardo L. Gomez.Evaluation Use and Decision-Making in Society: A Tribute to Marvin C. Alkin will be of great interest to evaluation students, scholars and practitioners. This volume has scholarly application for those who desire a state-of-the-art resource for the latest insights and perspectives on one of the most pressing issues that the evaluation field faces today, while also serving as a useful guide for both novice and experienced evaluation practitioners. It is appropriate for use in a variety of evaluation courses including Introduction to Evaluation and Procedural Issues in Evaluation as well as topical seminars such as Evaluation Use and Decision-Making.

This volume addresses a fundamental and highly debated issue in the evaluation field – the use of evaluation information for decision-making. Chapter authors honor the contributions of Professor Marvin C. Alkin to the evaluation use literature and advance our thinking on the topic by exploring a wide range of issues related to the theoretical and practical challenges of using evaluation information to make informed, evidence-based decisions. Readers will come away from this volume with a new and clearer understanding of the theoretical, contextual, methodological, and political dimensions of use and with direction for practice. Chapters are written by leading evaluation scholars, including Ernest House; Stewart Donaldson and Tarek Azzam; Eric Barela; Richard D. Nunneley, Jr., Jean A. King, Kelli Johnson, and Laura Pejsa; Eleanor Chelimsky; Michael Quinn Patton; and Wanda D. Casillas, Rodney K. Hopson and Ricardo L. Gomez.Evaluation Use and Decision-Making in Society: A Tribute to Marvin C. Alkin will be of great interest to evaluation students, scholars and practitioners. This volume has scholarly application for those who desire a state-of-the-art resource for the latest insights and perspectives on one of the most pressing issues that the evaluation field faces today, while also serving as a useful guide for both novice and experienced evaluation practitioners. It is appropriate for use in a variety of evaluation courses including Introduction to Evaluation and Procedural Issues in Evaluation as well as topical seminars such as Evaluation Use and Decision-Making.

Governments and organizations of all shapes and sizes espouse values of equity and social justice. Yet, there are many examples of unfair social arrangements and employment conditions, dysfunctional government practices, and growing income inequality in both developed and developing countries worldwide. The profession and transdiscipline of evaluation is well equipped to address issues of inequality and social injustice, but until recently has been much more focused on primary stakeholder and donor satisfaction (being as useful as possible to funders of interventions and evaluations) and accountability concerns.The authors in this volume challenge the field of evaluation to become more concerned about using evaluation to develop more equitable organizations, governments, and societies. Leading evaluation theorists and practitioners including Michael Scriven, Jennifer Greene, Thomas Schwandt, Emily Gates, Sandra Mathison, Karen Kirkhart, Saville Kushner, Lois-Ellin Datta, Ernest House, Robert Stake, Patricia Rogers, Robert Picciotto and Stewart Donaldson, provide a range of visions for how evaluation can play a much larger role in facilitating social justice across the globe.Evaluation for an Equitable Society will be of great interest to evaluation practitioners, students and scholars. It will be of interest to those teaching and taking introductory evaluation courses, as well as advanced courses focused on improving evaluation theory and practice.

Governments and organizations of all shapes and sizes espouse values of equity and social justice. Yet, there are many examples of unfair social arrangements and employment conditions, dysfunctional government practices, and growing income inequality in both developed and developing countries worldwide. The profession and transdiscipline of evaluation is well equipped to address issues of inequality and social injustice, but until recently has been much more focused on primary stakeholder and donor satisfaction (being as useful as possible to funders of interventions and evaluations) and accountability concerns.The authors in this volume challenge the field of evaluation to become more concerned about using evaluation to develop more equitable organizations, governments, and societies. Leading evaluation theorists and practitioners including Michael Scriven, Jennifer Greene, Thomas Schwandt, Emily Gates, Sandra Mathison, Karen Kirkhart, Saville Kushner, Lois-Ellin Datta, Ernest House, Robert Stake, Patricia Rogers, Robert Picciotto and Stewart Donaldson, provide a range of visions for how evaluation can play a much larger role in facilitating social justice across the globe.Evaluation for an Equitable Society will be of great interest to evaluation practitioners, students and scholars. It will be of interest to those teaching and taking introductory evaluation courses, as well as advanced courses focused on improving evaluation theory and practice.

How do research students and their supervisors respond in a world of ‘fake news’, the destabilisation of public institutions and the rise of populism? The very foundations of our liberal democracies seem to be under threat, and this implicates social inquiry. Postgraduate research remains one of the few information spaces which are still free of politicisation and committed to validation.This book focuses on democracy in inquiry, and on the role of inquiry in a democracy – how research helps us to deliberate over what counts as of public value. It is a research methods book, but methods shaped by political and ethical purposes, and by the challenge of making judgements about what, in the public sphere, is worthy. We may be looking at a police training program, the siting of a clean energy project, a new school curriculum, maternal health program or an environmental adaptation project – in each case and in others like them we have to negotiate perspectives and claims, forge and justify a consensus, support competing stakeholders with the best information and analyses possible.And we have to make our work defensible – undeniable in the forum of public debate and exchange, examination and accountability. This book, full of examples from contemporary research projects, is designed to help navigate our way through the complexities of social research which focuses on judgements about public action.The book was written with research students and includes examples of their work. It recognises that supervisors often struggle as much as students in meeting the challenges of inquiry that involves some element of evaluative judgement – inquiry that potentially carries consequences. Where there are no quick-and-ready recipes, check-lists or theoretical frameworks – where we confront the particularities of the context in which the research takes place, we are all forced back onto good methodological thinking, and this is the pedagogical framing of the book.

How do research students and their supervisors respond in a world of ‘fake news’, the destabilisation of public institutions and the rise of populism? The very foundations of our liberal democracies seem to be under threat, and this implicates social inquiry. Postgraduate research remains one of the few information spaces which are still free of politicisation and committed to validation.This book focuses on democracy in inquiry, and on the role of inquiry in a democracy – how research helps us to deliberate over what counts as of public value. It is a research methods book, but methods shaped by political and ethical purposes, and by the challenge of making judgements about what, in the public sphere, is worthy. We may be looking at a police training program, the siting of a clean energy project, a new school curriculum, maternal health program or an environmental adaptation project – in each case and in others like them we have to negotiate perspectives and claims, forge and justify a consensus, support competing stakeholders with the best information and analyses possible.And we have to make our work defensible – undeniable in the forum of public debate and exchange, examination and accountability. This book, full of examples from contemporary research projects, is designed to help navigate our way through the complexities of social research which focuses on judgements about public action.The book was written with research students and includes examples of their work. It recognises that supervisors often struggle as much as students in meeting the challenges of inquiry that involves some element of evaluative judgement – inquiry that potentially carries consequences. Where there are no quick-and-ready recipes, check-lists or theoretical frameworks – where we confront the particularities of the context in which the research takes place, we are all forced back onto good methodological thinking, and this is the pedagogical framing of the book.

Democratic evaluation brings a way of thinking about evaluation’s role in society and in particular, its role in strengthening social justice. Yet the reality of applying it, and what happens when it is applied particularly outside the West, is unclear. Set in South Africa, a newly formed democracy in Southern Africa, the book affords an in-depth journey that immerses a reader into the realities of evaluation and its relation to democracy. The book starts with the broader introductory chapters that set the scene for more detailed ones which bring thorough insights into national government, local government, and civil societies’ experience of evaluation, democratic evaluation and their understanding of how it contributes to strengthening democracy (or not). A teaching case, the book concludes by providing guiding questions that encourage reflection, discussion and learning that ultimately aims to inform practice and theory.

Democratic evaluation brings a way of thinking about evaluation’s role in society and in particular, its role in strengthening social justice. Yet the reality of applying it, and what happens when it is applied particularly outside the West, is unclear. Set in South Africa, a newly formed democracy in Southern Africa, the book affords an in-depth journey that immerses a reader into the realities of evaluation and its relation to democracy. The book starts with the broader introductory chapters that set the scene for more detailed ones which bring thorough insights into national government, local government, and civil societies’ experience of evaluation, democratic evaluation and their understanding of how it contributes to strengthening democracy (or not). A teaching case, the book concludes by providing guiding questions that encourage reflection, discussion and learning that ultimately aims to inform practice and theory.

Assumptions: Complexity, Practice and Values delves into the empirical and theoretical aspects of assumptions in evaluation, offering methodologies to identify and categorize them, and exploring how they influence evaluations and each other. It provides practical guidance for evaluators to help stakeholders identify priorities and plan effective programs, while also presenting conceptual insights into the nature of assumptions and their impact on both programs and evaluations. The chapters push the boundaries of our understanding of assumptions in the field and propose a research agenda to deepen our knowledge and improve evaluation practices. Addressing assumptions is a cornerstone of evaluative thinking, crucial for uncovering the beliefs that guide stakeholders' decisions and actions. This book emphasizes how these assumptions shape the evaluation process, determining the questions asked and the answers sought. By examining these underlying beliefs, evaluators can conduct more meaningful evaluations that truly reflect the needs and realities of the programs they assess. This book also equips methodologists with the tools to design evaluations that yield actionable insights for decision-makers. Practitioners will learn to monitor their own and their stakeholders' assumptions to avoid biases and leverage deeper understanding in their work. Program funders and designers will gain the knowledge to implement more effective programs and avoid unintended consequences. Evaluation educators will find valuable content to enhance their teaching, and researchers will discover new directions for their studies. Ultimately, Assumptions aims to enrich evaluators' ability to reveal and prioritize the most consequential assumptions in their work.