Are We Making a Difference?

About the EditorsStacey L. Connaughton is professor in the Brian Lamb School of Communication and the director of the Purdue Policy Research Institute at Purdue University.Jasmine R. Linabary is assistant professor in the Department of Public and Applied Humanities at the University of Arizona and an evaluation consultant.ContributorsTiwalade Adekunle, Isabel Aguilar Umaña, Susan H. Allen, Tanya Ansahta Garnett, Marcel Arsenault, Yara M. Asi, Allyson Bachta, Nell Bolton, Caroline Brooks, Stacey L. Connaughton, Alice Coulibaly, Alexa Courtney, Bijaya Dahal, Soledad Granada, Melanie Greenberg, Bob Groelsema, Fadi Hallisso, Thomas Hill, Kristina Hook, Rick Jones, Scarlett Kassimatis, Michael L. Kent, Ilam Khan, Dimitri Kotsiras, Elizabeth Laruni, Adrienne Lemon, Jasmine R. Linabary, Jenna J. Lindeke, Camila Linneman, Stuart Moir, Michael Papa, Jeffrey Pugh, Jason Quinn, Meghana Rawat, Megan Renoir, Karen Ross, Conor Seyle, Zahid Shahab Ahmed, Steve Sheamer, Katerina Siira, Ruth Simpson, Nicole Stoumen, Michael Sweigart, Margarita Tadevosyan, Maureen Taylor, Zach Tilton, Khan Zeb

Are We Making a Difference is a remarkable undertaking in aim, scope, and possibilities for the future. Are We Making a Difference takes on the responsibility of interrogating the myriad tensions involved in ascertaining effectiveness in peacekeeping to record initiatives and provide a foundation for further (re)considerations of what effectiveness means and how it can be measured and activated for the good of the communities it serves. This collection offers a stunning and provocative array of chapters representing local and globe efforts from experts who are scholars, donors, policy-makers, and/or practitioners. By dismantling peacebuilding myths and grappling with seemingly unsurmountable challenges, Are We Making a Difference inspires readers to hope for peace.

• Preface - Melanie GreenbergHow Do We Measure Peace?Whose Peace Are We Measuring?Introduction - Stacey L. Connaughton and Jasmine R. LinabaryInterrogating “Peacebuilding Effectiveness”Defining PeacebuildingUnderstanding Peacebuilding “Effectiveness”Our ApproachWhat is Effectiveness? Effectiveness for Whom?Lessons LearnedArguments and InnovationsConclusionReferencesSection I: What is Effectiveness? Effectiveness for Whom?Chapter 1: The Greatest Myth of Peacebuilding Ineffectiveness - Jason QuinnAbstractTracing the Origins of the MythMeasuring the Effectiveness of Final Peace AgreementsFull Agreements (Uppsala Conflict Data Program)AbrogationArmed Conflict RecurrenceComprehensive Peace Agreements (Peace Accord Matrix Project)AbrogationArmed Conflict RecurrenceKreutz’s Conflict Termination DatasetWhat Lessons Can We Learn from the Myth of Peace Agreement Ineffectiveness?Future DirectionsLessons LearnedReflection QuestionsReferencesChapter 2: An Ecofeminist Approach to Peacebuilding Effectiveness: An Example from Colombia's Peace Process - Soledad GranadaEffectiveness of Peacebuilding from an Ecofeminist Perspective: Tools and ConceptsPeacebuilding Effectiveness in Colombia from an Ecofeminist PerspectiveSocial Organization: Intersection of the Social Movement around PeaceDealing with the Past and Working for the Future: Historical Memory and Legal ActivismImproving Human-Nature Relationships: The Development and Security NexusConclusionsLessons LearnedReflection QuestionsReferencesChapter 3: A Socio-Economic Approach to Reducing Violence Against Women and Girls in Rural Tajikistan - Stuart Moir and Elizabeth LaruniAbstractPeacebuilding and SGBVLiving In Dignity: An Effective Approach to Reducing SGBV Committed Within the Family the ProjectThe Importance of Evidence in Designing an Effective InterventionThe ZS MethodologyThe ResultsLessons LearnedReflection QuestionsReferencesChapter 4: Whose Peace? Prioritizing Local Perspectives to Inform our Understanding of Peacebuilding Effectiveness - Megan Renoir, Scarlett Kassimatis, Alice Coulibaly, and Dimitri KotsirasAbstractBest Practice in Defining Peacebuilding EffectivenessReimagining Peacebuilding EffectivenessFrom Peace Writ Little to Peace Writ Large: Foundation ChireziConclusionLessons LearnedReflection QuestionsReferencesChapter 5: Locally Useful Evidence: Re-Centering Knowledge Creation for Local Peace Work - Michael Sweigart, Kristina Hook, Margarita Tadevosyan, and Susan H. AllenAbstractMaking Sense of Existing LiteratureMethodological ApproachPower Imbalance in Shaping the Peacebuilding Evidence BaseDisconnect Between Donors’ Requirements and Local Priorities on EvaluationEmphasis on the Value of Qualitative DataContextual Knowledge and SensitivityPromotion of Local Thematic ExpertiseApplied Implications for Convening OrganizationsFuture Research DirectionsLessons LearnedReflection QuestionsReferencesChapter 6: Are Peacebuilding Evaluators Making a Difference? Towards a Meta-Evaluative Agenda for Research on Peacebuilding Evaluation - Zach TiltonAbstractBackgroundKey Concepts DefinedWhy Meta-Evaluative Research on Peacebuilding Evaluation?Research on Evaluation Conceptual FrameworksToward an Agenda for Research on Peacebuilding EvaluationPeacebuilding Evaluation TheoryPeacebuilding Evaluation PracticePeacebuilding Evaluation ConsequencesConclusionLessons LearnedReflection QuestionsReferencesSection II: Lessons LearnedChapter 7: Illustrating Intended and Unintended Consequences of Peacebuilding in Locally Led Peacebuilding: The Role of Focus Group Methods in Participatory Evaluation - Meghana Rawat and Tiwalade AdekunleAbstractParticipatory Approaches to Evaluation in PeacebuildingThe Case of the Purdue Peace Project2016: Pre-Election Focus GroupsFear of Poverty Due to ViolenceFear of Domestic Despair Due to ViolenceConcern about Illegal Voting and MisinformationConcern about the Changing Sociocultural Fabric of the Community2017: Post-Election Focus GroupsImprovement in Household PeaceImprovement in Election PracticesImprovement in Community RelationshipsConclusionLessons LearnedReflection QuestionsReferencesChapter 8: Assessing Peacebuilding Effectiveness: The Carter Center in Sudan and Uganda - Michael PapaAbstractObjectives of the Principals: TCC, Uganda, and SudanData AnalysisSuccesses of TCC’s Peacebuilding ActivitiesRestoration of Diplomatic RelationsTrade RelationsRepatriating Abducted Children, Prisoners of War, IDPs, and RefugeesGuinea Worm Disease EradicationEnding Civil War in SudanFailures of TCC’s Peacebuilding ActivitiesViolent Sudanese-Ugandan Offensive Operations against the LRAEmergence of Civil War in DarfurEvaluation of Peacebuilding EffectivenessLessons LearnedExpectations of Conflicting PartiesInvolving All Key Players in NegotiationsInternational Mediators Teaming up with LocalsConclusionReflection QuestionsReferencesChapter 9: Post-Conflict Rehabilitation of Ex-Combatants: Assessing Effectiveness of Rehabilitation Programs in Nepal and District Swat, Pakistan, and Nepal - Ilam Khan and Bijaya Dahal AbstractRehabilitation Program in Swat, PakistanSketching Out the Rehabilitation Centers in SwatUnderstanding the Process of RehabilitationPost-Rehabilitation AssessmentRehabilitation and Reintegration Program in NepalChallenges of Social IntegrationConclusionLessons LearnedReflection QuestionsReferencesChapter 10: Is Peacebuilding Education Making a Difference? Peace Education Interventions and their Impact in Lebanon - Caroline Brooks, Fadi Hallisso, and Ruth SimpsonAbstractWhat Is Peace Education?Basmeh and Zeitooneh’s Approach to Peace EducationEvaluation TechniquesContext OverviewTripoliShatila CampBekkaEvaluation FindingsEvaluation FindingsSustainable Outcomes Are Difficult to Identify Because of the Short Timeframe of Implementation and Limited Longer-Term Follow-up with ParticipantsThere is Some Evidence of the Peacebuilding Impact on the Wider Community, but it is Limited Compared to Individual ImpactCritical Reflections on Peace Education ProgrammingLessons LearnedReflection QuestionsReferencesChapter 11: Woman, You Are Not Alone! An Effective Approach to Address Violence Against Women - Isabel Aguilar Umaña and Rick JonesAbstractThe Social Dimensions of VAWWoman, You Are Not Alone! Women’s Self Help Groups Methodology-EvidenceReduced Physical, Emotional, and Sexual ViolenceWell-beingRelationshipsMethodologiesEffectivenessConclusionsLessons LearnedReflection QuestionsReferencesChapter 12: The Challenges of Assessing Peacebuilding in Pakistan - Zahid Shahab Ahmed and Khan ZebAbstractTheorizing Peacebuilding and EffectivenessThe Need for Peacebuilding in PakistanResults and DiscussionThe Access IssueMethodological IssuesTime LimitationsEthical DilemmasFundingTheory of ChangeConclusionLessons LearnedReflection QuestionsReferencesChapter 13: Coordination for Effective Peacebuilding: One NGO's Approach - Marcel Arsenault and Conor SeyleAbstractWhat Do We Know about Peacebuilding?Recognized But Not MaterializedWhat Can NGO Do about This?OEF’s ModelWhat Lessons Might There Be for the Larger System?Lessons LearnedReflection QuestionsReferencesChapter 14: Are We Making a Difference or Doing Harm? Practical Strategies for Assessing Peacebuilding Effectiveness to Drive Adaptation and Improvement - Tanya Ansahta Garnett and Camila LinnemanAbstractWhat Is the CLA Framework?How Is the CLA Framework Useful for Evaluating Peacebuilding?CLA in Action: Case Study ExamplesInvesting in National Discourse on Post-Conflict Development Priorities in LiberiaRe-Envisioning Who Sets the Development Agenda in UgandaRapid, Cost-Friendly, and Collaborative Evaluation Strategies in LiberiaLearning and Adapting to Build Resilience in South SudanInfusing “Do No Harm” Principles in Interventions in LiberiaConclusionLessons LearnedReflection QuestionsReferencesSection III: Arguments and InnovationsChapter 15: Using Event Data to Address Positive Bias in Evaluations - Steve Sheamer, Alexa Courtney, and Jenna J. LindekeAbstractData ChallengesData AvailabilityPerceptions of Peace Versus Levels of ViolenceProposed ApproachPolitical Event DataMethodsMeasuring Effectiveness with Political Event DataResults and DiscussionContextual ApplicationsImplications1. Program Suitability2. Geographic Specificity3. Key Metrics4. Mixed-Methods5. Building EvidenceFuture DirectionsLessons LearnedReflection QuestionsReferencesChapter 16: The Most Significant Change Approach for Evaluating Peace Impacts - Maureen TaylorAbstractBackground on the Most Significant Change (MSC) ApproachHow to Implement MSCStep 1: Raising Interest and Gaining Buy-inStep 2: Defining Domains of ChangeStep 3: Defining the Reporting PeriodStep 4: Collecting MSC StoriesStep 5: Selecting the Most Significant of the StoriesStep 6: Feeding Back the Results of the Selection ProcessStep 7: Verification of StoriesStep 8: QuantificationStep 9: Secondary Analysis and Meta-MonitoringStep 10: Revising the SystemApplication of MSC to Peacebuilding in LiberiaLessons Learned and Best PracticesReflection QuestionsReferencesChapter 17: The Delphi Method as a Tool in Peacebuilding Assessment - Michael L. KentAbstractHistory and Background of the Delphi MethodThe Delphi Method as a Peacebuilding ToolOverview of the Delphi MethodologyRepeated IterationsSelecting ParticipantsInviting ParticipantsCritical Points and Potential PitfallsMethodological ComplicationsStep-by-Step Instructions for Conducting a Delphi StudyPreliminary PreparationConclusionLessons LearnedReflection QuestionsReferencesChapter 18: Participatory Action Research: Mutual Inquiry for Effective Local Peacebuilding - Thomas Hill, Katerina Siira, and Nicole StoumenAbstractThe Importance of Participatory Action ResearchLocally Led Peacebuilding: Participatory Action Research Case Studies in Libya and ColombiaLibyaColombiaConclusionLessons LearnedReflection QuestionsReferencesChapter 19: Gauging Harmony: Applying the Social Cohesion Barometer to Assess and Advance Peacebuilding - Bob Groelsema and Nell BoltonAbstractSocial Cohesion as Construct, Aspiration and Lived RealityOrigins and Composition of the Mini-Social Cohesion BarometerOriginsCompositionApplications of the BarometerThe Barometer as a Baseline and Endline Indicator in CARThe Barometer as a Tool for Context Analysis in the Lake Chad BasinDiscussion and LessonsLessons LearnedReflection QuestionsReferencesChapter 20: From Education to Peacebuilding: Exploring the Role of Networks in Peacebuilding Work - Allyson Bachta, Karen Ross, and Jeffrey PughAbstractWhat We KnowOur ProjectThe Potential of Social NetworksCase 1: Regional Institute on Nonviolent Action in the Americas, EcuadorCase 2: Jewish-Palestinian Encounter Participation, IsraelConclusionsLessons LearnedReflection QuestionsReferencesChapter 21: To Help Measure Peace, Measure Health - Yara M. AsiAbstractHealth and PeaceHealth and PeaceWhen Health Becomes a Target: The Case of SyriaWatching a Society Recover: Health in RwandaThe Benefits of Measuring Peace with HealthWhich Health Measures Best Reflect Peace?Which Health Measures Best Reflect Peace?ConclusionLessons LearnedReflection QuestionsReferencesChapter 22: A Global Framework to Measure Peace - Adrienne LemonAbstractCreating Better Evidence on PeaceAn Inclusive Way to Understand ImpactA Global Framework for Understanding Peace and Conflict: Three PillarsLived ExperienceWhat is this Pillar?Why Does it Matter?Aligned Measures for PeaceWhat Is This Pillar?Why Does It Matter?Shared Reflection and AdaptationWhat Is This Pillar?Why Does It Matter?The Cases: Piloting the FrameworkPractitioner Teams: Lessons from Africa, the Middle East, and Central AsiaSetting up Systems: Resources to Make Measuring Peace AccessibleA Vision for Better EvidenceAligning our Field without Constraining ItShifting the Paradox of Power and Authority in Peace MeasurementPutting the Global Impact Framework to UseLessons LearnedReflection QuestionsReferencesConclusion: Peacebuilding Effectiveness: The What, Who, How, and Why It All Matters - Stacey L. Connaughton and Jasmine R. LinabaryKey Reflections: Questions on Peacebuilding EffectivenessWhat is “Effectiveness” in Peacebuilding?Is Effectiveness the Absence of Violence or the Presence of Positive Relations? Both?Is it about Effectiveness in the Short Term or the Longer Term?Are We Seeking Program-Level Change or Contributing to Peace Writ Large?Who Gets to Decide What Effectiveness Means? Who Is It For?Who Gets to Decide What Effectiveness Means?Who Is It For?How Do We Know We Have Achieved Peacebuilding Effectiveness?What Evidence Has Value?What is Practical and Ethical to Collect?Lessons LearnedEmbrace a Both/And Mentality on Peacebuilding EffectivenessAdopt Both Structure and Flexibility When Assessing Peacebuilding EffectivenessAsk the “Who” Questions and Interrogate Power DynamicsLimitations and Future DirectionsConclusionReferencesAppendix AAppendix B: Materials shared with IREX Partners at the MSC WorkshopStep 1: Generating the Most Significant Change StoriesStep 2: Selecting and Documenting the Best Stories to Represent Your Organization’s ImpactStep 3: Submit the Stories to IREXAppendix C: Template for Story SubmissionAppendix D: Global Impact Framework DiagramStep 1: Design for ImpactStep 2: Create a Learning LoopStep 3: Adapt Strategies to Transform ConflictStep 4: Share and RepeatIndexAbout the EditorsAbout the Contributors