Advances in Evaluation & Development – serie

Written by a team of expert practitioners at the Independent Office of Evaluation of IFAD, this book gives an overview of evaluation practice at IFAD.It looks at how evaluation practice has evolved to reflect, respond to and inform changing expectations of development assistance. It reveals how evaluation products and methodologies have benefited from key reviews, revisions and lessons learned, and also how they have progressively strengthened IFAD’s capacity to assess its operations and better understand its results. The book concludes with reflections on some of the challenges that lie ahead, including how the independent evaluation function can continue to evolve to meet future challenges and enhance the impact of development initiatives on people’s lives.This valuable insight into practice will be of interest to researchers, practitioners and policymakers in development economics, development studies and rural studies.

Among development assistance agencies, the World Bank has led the way in policies to mitigate the impact of large-scale engineering projects on local populations, particularly in the building of dams. Since the 1980s the Bank has implemented guidelines for policies with respect to displacement, social infrastructure and services, environmental effects, resettlement, compensation, and the restoration of income for those affected. Having learned from the failures of past resettlement programs, the Bank has endeavored to function as a responsible and caring agency. This volume builds upon earlier studies and field work to offer a broad look at dam-building projects in six countries and to review the outcomes of Bank policy, learn from experience, and assess outside criticism.The book covers representative dam projects in India, Thailand, Togo, China, Indonesia, and Brazil. Each project was undertaken after Bank resettlement guidelines had been implemented. The widely ranging results in each country are assessed. In the areas of compensation for acquired land, relocation, infrastructure and services, the contributors note satisfactory levels of improvement or positive trends. Governments are moving towards acceptance of the idea that displaced families should be paid the real value of their lost assets. Relocation processes are now keeping pace with water movement caused by dam building, and health, education, utilities, and roads are better than before the resettlement.Other results have been less positive. The impact on incomes of those involuntarily resettled has been harsh in some locations. Resettler dissatisfaction has been intense, notably in those countries where the national economies are not experiencing strong growth. The Bank's performance itself has been uneven. There have been lapses in appraisal and monitoring during the projects and insufficient follow-through support for resettlement operations after the completion of loan and credit disbursements.In addition to its case by case analysis of countries and projects, the book includes detailed lessons and recommendations to strengthen resettlement policy and practice. Involuntary Resettlement will be of interest to economists, sociologists, and professionals working in regional development policy.Robert Picciotto is director general of Operations Evaluation at the World Bank. Warren van Wicklin is task manager and evaluator at the Operations Evaluation department of the World Bank.

In his foreword, the president of the World Bank, James D. Wolfensohn, states plainly and precisely the rationale for this volume. "Evaluation is a central aspect of any poverty reduction endeavor. Evaluation implies that we have adopted a methodology that allows us to look in an effective way at the results of what we are doing so that we can, in turn, adapt our future actions toward the effective achievement of our goals. Evaluation adds value if we can learn something useful from it. It is not just a scorecard. It is something that helps us change our behavior or influence the behavior of others."This high powered collection of papers illustrates this statement. The network of world class scholars and development practitioners covers the gamut from methodological issues to policy concerns with respect to participatory evaluation, poverty reducing growth, macro and micro levels of intervention, health, nutrition and population programs, social inclusion and the changing role of the civil society. The participants include major figures, including a Nobel Laureate as well as cutting edge policy makers. Poverty reduction is examined in innovative ways-utilizing state of the art techniques of the social and economic sciences.The editors and contributors emphasize "what works" in poverty reduction programs. They point to making interventions context specific with a holistic vision of the problem. Contributors emphasize social funds and safety nets, social services, crisis prevention, informal social security and insurance systems, anti-corruption programs, mobilization of the poor, and ultimately, the creation, where none existed in the past, of a workable civil society. In short, this volume lies at the intersection of development economics and political economy. It seeks to promote development effectiveness through social learning and problem solving.The volume is unabashedly focussed on pro-poor growth. It has its roots in a conference sponsored by the Operations Evaluation Department, an independent unit within the World Bank. The goals of evaluation are to learn from experience, to provide an objective basis for assessing the results of the Bank's work, and to provide accountability in the achievement of its objectives.Osvaldo N. Feinstein is a manager, and Robert Picciotto, director general of the Operations Evaluation Department. The World Bank is located in Washington, D.C. with offices throughout the developing world.

Worldwide, the number of poor people increased during the past decade, despite technological improvements, more open trade, and improved policy frameworks in developing countries. Regional conflicts, adverse shifts in terms of trade, and marginalization of poor countries in the new global economy explain this outcome. This highlights the need to reform development assistance and improve its effectiveness.Making Development Work examines the four key principles of the Comprehensive-Development Framework, a World Bank initiative currently being piloted in twelve developing counties. The initiative promotes a holistic long-term vision of development, domestic ownership of development programs, and focus on results; and stronger partnership between government, the private sector, and the civil society. The first section of the volume describes the evolution in development thinking that culminated in this new consensus. The second focuses on country ownership of development policies and programs. Based on empirical evidence, it proposes a new view of the aid relationship as a mutual-learning process. The third section focuses on results and on the ways aid agencies might enhance development impact of their operations. It concludes with a preliminary assessment of strategies for scaling up from specific projects to sector and programmatic approaches, and suggests ways to adapt them to counter conditions. The experience of a bilateral aid agency, U.S. Agency for International Development (USAID), is examined in this context. The fourth section focuses on partnership, emphasizing that aid agencies must be explicit about the kinds of partnerships they seek with countries and the kinds of strategic selectivity they will exercise. The final chapter pulls together the lessons of development experience at various levels of operation. It outlines key tensions between comprehensiveness and selectivity, ownership and conditionality, speed and broad-based ownership, focus on results and poor local evaluation capacity, and enhanced country focus and globalization. Promising approaches to manage these tensions are put forward to replace one-size-fits-all prescriptions with client empowerment and social learning.Making Development Work offers rich lessons on improving the effectiveness of aid. It will be of particular interest to development practitioners, students and professors of development economics studies.Nagy Hanna is a lead corporate strategist and evaluation officer at the World Bank. He has published extensively on development, management, and knowledge.Robert Picciotto is director-general of Operations Evaluation at the World Bank.

The rapid loss of tropical forests, particularly in the developing world, has been a global concern since the late 1980s and has prompted a variety of international initiatives to save the forests. In 1991, the World Bank responded to global concerns and to criticism by nongovernmental organizations by forming a conservation-oriented forest strategy. Managing a Global Resource is an outgrowth of the independent evaluation conducted by the World Bank's Operations Evaluation Department and discusses how effectively that strategy was implemented. In this detailed investigation, Uma J. Lele explores why the loss of forests and biodiversity has been so rapid in some developing countries (Brazil, Indonesia, and Cameroon) and not in others (China, India, and Costa Rica). She assesses future prospects for conservation in these six countries by critically examining their policies, institutional arrangements, and emerging national and international instruments to conserve forests and biodiversity. Together these six countries account for 25 percent of the world's forest cover and 44 percent of the world's population. Managing a Global Resource presents case studies of the forest sectors of each country in the context of overall development policies, interest groups, and governance issues. Lele's investigation finds a fundamental divergence in forest-rich countries between the global objectives of conservation and the local objectives of development and private profit. In some forest-poor countries, in contrast, natural resource loss has led the countries on their own accord to adopt a variety of conservation-oriented policies and programs. Despite the greater congruence between the global and national objectives in these forest-poor countries, competing demands on their resources and the constraints on their policies, institutions, and human capital make it difficult for them to affect forest and biodiversity conservation. This volume makes it clear that without substantial international financial transfers and knowledge of appropriate, location-specific solutions, much of the world's tropical forests will be lost. Even with substantial financial resources the prospects for conservation depend on a complex and dynamic set of country-specific factors. Managing a Global Resource offers unusually rich insights into the global/national interactions and lessons for future strategies. It will be of interest to conservationists and environmentalists concerned with the future of conservation in a changing environment.

Partnership is of growing importance in development work. Partnerships among state, private business, and civil society organizations are increasingly used to deliver the goods and services required for balanced growth and poverty reduction. Aid activities have shifted from a project focus to a more strategic and holistic focus on programs, sectors, and policies. With this new orientation, partnerships are often essential to deal with the added complexity and the larger number of agencies, groups, and stakeholders involved.The Partnership Dimension takes on the issues in a series of chapters divided into two general parts: Part 1, "Foundations of Partnership and Their Evaluation," covers the types of development partnership and critical issues involved, and Part 2, "Partnerships in Practice," then illustrates the aspects and lessons of partnership experience through a series of case studies. Many of the studies focus on the benefits of partnerships between institutions of government and civil society. Benefits include effective knowledge transfer, greater cross-national cooperation, the creation of new networks and capacity, and penetration of new markets. Private firms use partnerships with competitors to learn or reduce risk.There is much to learn about when, where, and how best to use partnerships, and, in particular, partnerships that involve less traditional combinations of actors, such as global partnerships for public policy, country-focused aid partnerships, private sector partnerships for knowledge creation, and partnerships for community development involving business, nongovernmental organizations, and government.Relatively little is known about the costs and benefits, and the risks and rewards, of different types of partnerships, or about how best to conduct partnerships for different purposes. This is why the current volume in the World Bank series is relevant for both development practitioners and policy analysts.

This study illustrates the social and political principal that institutions matter. It explores not only how to get institutions to work efficiently, but also how to assess the proper relationship between institutions and development challenges through evaluative techniques.

Among development assistance agencies, the World Bank has led the way in policies to mitigate the impact of large-scale engineering projects on local populations, particularly in the building of dams. Since the 1980s the Bank has implemented guidelines for policies with respect to displacement, social infrastructure and services, environmental effects, resettlement, compensation, and the restoration of income for those affected. Having learned from the failures of past resettlement programs, the Bank has endeavored to function as a responsible and caring agency. This volume builds upon earlier studies and field work to offer a broad look at dam-building projects in six countries and to review the outcomes of Bank policy, learn from experience, and assess outside criticism.The book covers representative dam projects in India, Thailand, Togo, China, Indonesia, and Brazil. Each project was undertaken after Bank resettlement guidelines had been implemented. The widely ranging results in each country are assessed. In the areas of compensation for acquired land, relocation, infrastructure and services, the contributors note satisfactory levels of improvement or positive trends. Governments are moving towards acceptance of the idea that displaced families should be paid the real value of their lost assets. Relocation processes are now keeping pace with water movement caused by dam building, and health, education, utilities, and roads are better than before the resettlement.Other results have been less positive. The impact on incomes of those involuntarily resettled has been harsh in some locations. Resettler dissatisfaction has been intense, notably in those countries where the national economies are not experiencing strong growth. The Bank's performance itself has been uneven. There have been lapses in appraisal and monitoring during the projects and insufficient follow-through support for resettlement operations after the completion of loan and credit disbursements.In addition to its case by case analysis of countries and projects, the book includes detailed lessons and recommendations to strengthen resettlement policy and practice. Involuntary Resettlement will be of interest to economists, sociologists, and professionals working in regional development policy.Robert Picciotto is director general of Operations Evaluation at the World Bank. Warren van Wicklin is task manager and evaluator at the Operations Evaluation department of the World Bank.

In his foreword, the president of the World Bank, James D. Wolfensohn, states plainly and precisely the rationale for this volume. "Evaluation is a central aspect of any poverty reduction endeavor. Evaluation implies that we have adopted a methodology that allows us to look in an effective way at the results of what we are doing so that we can, in turn, adapt our future actions toward the effective achievement of our goals. Evaluation adds value if we can learn something useful from it. It is not just a scorecard. It is something that helps us change our behavior or influence the behavior of others."This high powered collection of papers illustrates this statement. The network of world class scholars and development practitioners covers the gamut from methodological issues to policy concerns with respect to participatory evaluation, poverty reducing growth, macro and micro levels of intervention, health, nutrition and population programs, social inclusion and the changing role of the civil society. The participants include major figures, including a Nobel Laureate as well as cutting edge policy makers. Poverty reduction is examined in innovative ways-utilizing state of the art techniques of the social and economic sciences.The editors and contributors emphasize "what works" in poverty reduction programs. They point to making interventions context specific with a holistic vision of the problem. Contributors emphasize social funds and safety nets, social services, crisis prevention, informal social security and insurance systems, anti-corruption programs, mobilization of the poor, and ultimately, the creation, where none existed in the past, of a workable civil society. In short, this volume lies at the intersection of development economics and political economy. It seeks to promote development effectiveness through social learning and problem solving.The volume is unabashedly focussed on pro-poor growth. It has its roots in a conference sponsored by the Operations Evaluation Department, an independent unit within the World Bank. The goals of evaluation are to learn from experience, to provide an objective basis for assessing the results of the Bank's work, and to provide accountability in the achievement of its objectives.Osvaldo N. Feinstein is a manager, and Robert Picciotto, director general of the Operations Evaluation Department. The World Bank is located in Washington, D.C. with offices throughout the developing world.

Worldwide, the number of poor people increased during the past decade, despite technological improvements, more open trade, and improved policy frameworks in developing countries. Regional conflicts, adverse shifts in terms of trade, and marginalization of poor countries in the new global economy explain this outcome. This highlights the need to reform development assistance and improve its effectiveness.Making Development Work examines the four key principles of the Comprehensive-Development Framework, a World Bank initiative currently being piloted in twelve developing counties. The initiative promotes a holistic long-term vision of development, domestic ownership of development programs, and focus on results; and stronger partnership between government, the private sector, and the civil society. The first section of the volume describes the evolution in development thinking that culminated in this new consensus. The second focuses on country ownership of development policies and programs. Based on empirical evidence, it proposes a new view of the aid relationship as a mutual-learning process. The third section focuses on results and on the ways aid agencies might enhance development impact of their operations. It concludes with a preliminary assessment of strategies for scaling up from specific projects to sector and programmatic approaches, and suggests ways to adapt them to counter conditions. The experience of a bilateral aid agency, U.S. Agency for International Development (USAID), is examined in this context. The fourth section focuses on partnership, emphasizing that aid agencies must be explicit about the kinds of partnerships they seek with countries and the kinds of strategic selectivity they will exercise. The final chapter pulls together the lessons of development experience at various levels of operation. It outlines key tensions between comprehensiveness and selectivity, ownership and conditionality, speed and broad-based ownership, focus on results and poor local evaluation capacity, and enhanced country focus and globalization. Promising approaches to manage these tensions are put forward to replace one-size-fits-all prescriptions with client empowerment and social learning.Making Development Work offers rich lessons on improving the effectiveness of aid. It will be of particular interest to development practitioners, students and professors of development economics studies.Nagy Hanna is a lead corporate strategist and evaluation officer at the World Bank. He has published extensively on development, management, and knowledge.Robert Picciotto is director-general of Operations Evaluation at the World Bank.

The rapid loss of tropical forests, particularly in the developing world, has been a global concern since the late 1980s and has prompted a variety of international initiatives to save the forests. In 1991, the World Bank responded to global concerns and to criticism by nongovernmental organizations by forming a conservation-oriented forest strategy. Managing a Global Resource is an outgrowth of the independent evaluation conducted by the World Bank's Operations Evaluation Department and discusses how effectively that strategy was implemented. In this detailed investigation, Uma J. Lele explores why the loss of forests and biodiversity has been so rapid in some developing countries (Brazil, Indonesia, and Cameroon) and not in others (China, India, and Costa Rica). She assesses future prospects for conservation in these six countries by critically examining their policies, institutional arrangements, and emerging national and international instruments to conserve forests and biodiversity. Together these six countries account for 25 percent of the world's forest cover and 44 percent of the world's population. Managing a Global Resource presents case studies of the forest sectors of each country in the context of overall development policies, interest groups, and governance issues. Lele's investigation finds a fundamental divergence in forest-rich countries between the global objectives of conservation and the local objectives of development and private profit. In some forest-poor countries, in contrast, natural resource loss has led the countries on their own accord to adopt a variety of conservation-oriented policies and programs. Despite the greater congruence between the global and national objectives in these forest-poor countries, competing demands on their resources and the constraints on their policies, institutions, and human capital make it difficult for them to affect forest and biodiversity conservation. This volume makes it clear that without substantial international financial transfers and knowledge of appropriate, location-specific solutions, much of the world's tropical forests will be lost. Even with substantial financial resources the prospects for conservation depend on a complex and dynamic set of country-specific factors. Managing a Global Resource offers unusually rich insights into the global/national interactions and lessons for future strategies. It will be of interest to conservationists and environmentalists concerned with the future of conservation in a changing environment.

Partnership is of growing importance in development work. Partnerships among state, private business, and civil society organizations are increasingly used to deliver the goods and services required for balanced growth and poverty reduction. Aid activities have shifted from a project focus to a more strategic and holistic focus on programs, sectors, and policies. With this new orientation, partnerships are often essential to deal with the added complexity and the larger number of agencies, groups, and stakeholders involved.The Partnership Dimension takes on the issues in a series of chapters divided into two general parts: Part 1, "Foundations of Partnership and Their Evaluation," covers the types of development partnership and critical issues involved, and Part 2, "Partnerships in Practice," then illustrates the aspects and lessons of partnership experience through a series of case studies. Many of the studies focus on the benefits of partnerships between institutions of government and civil society. Benefits include effective knowledge transfer, greater cross-national cooperation, the creation of new networks and capacity, and penetration of new markets. Private firms use partnerships with competitors to learn or reduce risk.There is much to learn about when, where, and how best to use partnerships, and, in particular, partnerships that involve less traditional combinations of actors, such as global partnerships for public policy, country-focused aid partnerships, private sector partnerships for knowledge creation, and partnerships for community development involving business, nongovernmental organizations, and government.Relatively little is known about the costs and benefits, and the risks and rewards, of different types of partnerships, or about how best to conduct partnerships for different purposes. This is why the current volume in the World Bank series is relevant for both development practitioners and policy analysts.

Evaluation is increasingly important for finding sustainable solutions for the people and the planet, based on a systematic analysis of what works, for whom, and under what circumstances, and to contribute to the achievement of the Sustainable Development Goals, as they pertain to the environment.This book explores why the Global Environment Facility (GEF) invests in evaluation for accountability and learning to inform its decision-making on programming priorities, and how this leads to wiser funding decisions and better program performance on the ground. The book is based on real-life experiences of how to make evaluation count for international environmental action. Drawing upon comprehensive evaluations of the GEF, it provides unique insights from authors responsible for designing, implementing, and disseminating the findings of the evaluations. No other multilateral development or environment agency places evaluation fully at the center of their decision-making. The book outlines the trends in the global environment and the changing landscape of international environmental finance. It defines the role of the GEF and explains its institutional framework and the unique partnership that involves donor and recipient countries, multilateral development banks, UN agencies, nongovernmental organizations (NGOs), and national agencies in the developing countries. Further, it provides useful pointers to other organizations wishing to enhance evidence-based decision-making for improving their relevance, performance, and impact.The book will be most suitable for graduate-level, specialized study in a variety of disciplines such as environmental and development economics, political science, international relations, geography, sociology, and social anthropology.The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.

Evaluation is increasingly important for finding sustainable solutions for the people and the planet, based on a systematic analysis of what works, for whom, and under what circumstances, and to contribute to the achievement of the Sustainable Development Goals, as they pertain to the environment.This book explores why the Global Environment Facility (GEF) invests in evaluation for accountability and learning to inform its decision-making on programming priorities, and how this leads to wiser funding decisions and better program performance on the ground. The book is based on real-life experiences of how to make evaluation count for international environmental action. Drawing upon comprehensive evaluations of the GEF, it provides unique insights from authors responsible for designing, implementing, and disseminating the findings of the evaluations. No other multilateral development or environment agency places evaluation fully at the center of their decision-making. The book outlines the trends in the global environment and the changing landscape of international environmental finance. It defines the role of the GEF and explains its institutional framework and the unique partnership that involves donor and recipient countries, multilateral development banks, UN agencies, nongovernmental organizations (NGOs), and national agencies in the developing countries. Further, it provides useful pointers to other organizations wishing to enhance evidence-based decision-making for improving their relevance, performance, and impact.The book will be most suitable for graduate-level, specialized study in a variety of disciplines such as environmental and development economics, political science, international relations, geography, sociology, and social anthropology.The Open Access version of this book, available at http://www.taylorfrancis.com, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 4.0 license.

Written by a team of expert practitioners at the Independent Office of Evaluation of IFAD, this book gives an overview of evaluation practice at IFAD.It looks at how evaluation practice has evolved to reflect, respond to and inform changing expectations of development assistance. It reveals how evaluation products and methodologies have benefited from key reviews, revisions and lessons learned, and also how they have progressively strengthened IFAD’s capacity to assess its operations and better understand its results. The book concludes with reflections on some of the challenges that lie ahead, including how the independent evaluation function can continue to evolve to meet future challenges and enhance the impact of development initiatives on people’s lives.This valuable insight into practice will be of interest to researchers, practitioners and policymakers in development economics, development studies and rural studies.

Climate change has become one of the most important global issues of our time, with far-reaching natural, socio-economic, and political effects. To address climate change and development issues from the perspective of evaluation, an international conference was held in Alexandria, Egypt. This book distills the essence of that timely conference, building on the experiences of more than 400 reports and studies presented.Developing countries may be particularly vulnerable to the expected onslaught of higher temperatures, rising sea levels, changing waterfall patterns, and increasing natural disasters. All societies will have to reduce their vulnerability to these changes, and this book describes how vulnerabilities may be addressed in a systematic manner so that governments and local communities may better understand what is happening. Different approaches are also discussed, including the use of human security as a criterion for evaluation as well as ways to deal with risk and uncertainty. Evaluating Climate Change and Development presents a rich variety of methods to assess adaptation through monitoring and evaluation.The volume deals with climate change, development, and evaluation; challenges and lessons learned from evaluations; mitigation of climate change; adaptation to climate change; vulnerability, risks and climate change; and presents a concluding chapter on the road ahead. Collectively the authors offer a set of approaches and techniques for the monitoring and evaluation of climate change.

Climate change has become one of the most important global issues of our time, with far-reaching natural, socio-economic, and political effects. To address climate change and development issues from the perspective of evaluation, an international conference was held in Alexandria, Egypt. This book distills the essence of that timely conference, building on the experiences of more than 400 reports and studies presented.Developing countries may be particularly vulnerable to the expected onslaught of higher temperatures, rising sea levels, changing waterfall patterns, and increasing natural disasters. All societies will have to reduce their vulnerability to these changes, and this book describes how vulnerabilities may be addressed in a systematic manner so that governments and local communities may better understand what is happening. Different approaches are also discussed, including the use of human security as a criterion for evaluation as well as ways to deal with risk and uncertainty. Evaluating Climate Change and Development presents a rich variety of methods to assess adaptation through monitoring and evaluation.The volume deals with climate change, development, and evaluation; challenges and lessons learned from evaluations; mitigation of climate change; adaptation to climate change; vulnerability, risks and climate change; and presents a concluding chapter on the road ahead. Collectively the authors offer a set of approaches and techniques for the monitoring and evaluation of climate change.