MonitoringandEvaluation for NGO New Comer to learn self-study

Monitoring and Evaluation

1. Monitoring & Evaluation Monitoring & Evaluation
in World Bank Agriculture and in World Bank Agriculture and
Rural Development OperationsRural Development Operations
SASAR Monitoring & Evaluation WorkshopSASAR Monitoring & Evaluation Workshop
New Delhi; June 20, 2006New Delhi; June 20, 2006

2. Purposes of M&EPurposes of M&E

Improve design or implementation during Improve design or implementation during
projectproject

Planning and allocating resourcesPlanning and allocating resources

Measure and demonstrate resultsMeasure and demonstrate results

Inform future decision-making and Inform future decision-making and
project designsproject designs

3. What Is M&E?What Is M&E?
There is a difference between M and E!There is a difference between M and E!
Monitoring:Monitoring:
The gathering of evidence to show what progress has
been made in the implementation of programs. Focuses
on inputs and outputs.
Evaluation:Evaluation:
Measuring changes in outcomes and evaluating the
impact of specific interventions on those outcomes.

4. Complementary Roles for Complementary Roles for
Monitoring and EvaluationMonitoring and Evaluation
MonitoringMonitoring

Routine collection of Routine collection of
informationinformation

Tracking Tracking
implementation implementation
progressprogress

Measuring efficiencyMeasuring efficiency
““Is the project doing things Is the project doing things
right ?”right ?”
EvaluationEvaluation

Analyzing informationAnalyzing information

Ex-post assessment of Ex-post assessment of
effectiveness and effectiveness and
impactimpact

Confirming project Confirming project
expectationsexpectations

Measuring impactsMeasuring impacts
““Is the project doing the right Is the project doing the right
things?”things?”

5. Steps to Design a M&E SystemSteps to Design a M&E System

Plan for M&EPlan for M&E

Developing the Results FrameworkDeveloping the Results Framework

Determine information sources and designDetermine information sources and design

Plan to analyze and use resultsPlan to analyze and use results

Complete and test the systemComplete and test the system

Annual self-assessments and periodic external Annual self-assessments and periodic external
evaluationevaluation

6. The M&E PlanThe M&E Plan

What? What?

Type of information and data to be consolidatedType of information and data to be consolidated

How? How?

Procedures and approaches including methods for Procedures and approaches including methods for
data collection and analysisdata collection and analysis

Why? Why?

How the collected data will support monitoring and How the collected data will support monitoring and
project managementproject management

7. The M&E PlanThe M&E Plan

When?When?

Frequency of data collection and reporting Frequency of data collection and reporting

Who? Who?

Focal points and resource persons. Responsibilities Focal points and resource persons. Responsibilities
and capacities.and capacities.

8. Institutional and Human Capacity Institutional and Human Capacity
RequirementsRequirements

Establishing an M&E UnitEstablishing an M&E Unit

Centralized/project specificCentralized/project specific

Collaboration across co-implementing institutions Collaboration across co-implementing institutions

Institutionalizing and Harmonizing M&E Institutionalizing and Harmonizing M&E
systemssystems

Facilitates sector wide planning, development of Facilitates sector wide planning, development of
policies and knowledge sharingpolicies and knowledge sharing

Allocate sufficient time and resourcesAllocate sufficient time and resources

9. Data Collection & AnalysisData Collection & Analysis

Prior to project start Prior to project start

Baseline data: at an absolute minimum baseline data Baseline data: at an absolute minimum baseline data
are required on each outcome indicator and results are required on each outcome indicator and results
indicator.indicator.

During the course of the projectDuring the course of the project

Data on implementation, physical and financial Data on implementation, physical and financial
progress.progress.

At critical junctures and project completionAt critical junctures and project completion

Data for assessing achievements and impacts.Data for assessing achievements and impacts.

10. Some Data Collection MethodsSome Data Collection Methods

Formal SurveysFormal Surveys

Household SurveysHousehold Surveys

Core Welfare Indicators Questionnaire (CWIQ)Core Welfare Indicators Questionnaire (CWIQ)

Client Satisfaction (or Service Delivery) SurveysClient Satisfaction (or Service Delivery) Surveys

Citizen Report CardsCitizen Report Cards

Participatory MethodsParticipatory Methods

Participatory M&EParticipatory M&E

Public Expenditure Tracking SurveysPublic Expenditure Tracking Surveys

Remote SensingRemote Sensing

11. Project Management Information Project Management Information
SystemSystem
What is it? What is it?

System for collection, analysis, storing and System for collection, analysis, storing and
dissemination of project informationdissemination of project information

Supports management in making timely and effective Supports management in making timely and effective
decisions for planning, monitoring and managing a decisions for planning, monitoring and managing a
project/programproject/program

Generally consists of accounting software and a Generally consists of accounting software and a
database management systemdatabase management system

12. M&E in the Project CycleM&E in the Project Cycle

PreparationPreparation

M&E planning, Results Framework, baseline survey, M&E planning, Results Framework, baseline survey,
resource allocation, reporting formats, capacity resource allocation, reporting formats, capacity
assessmentassessment

AppraisalAppraisal

Development of detailed M&E plan, manual of Development of detailed M&E plan, manual of
procedures, preparation of ToRs, M&E training procedures, preparation of ToRs, M&E training
program, agree on Results Frameworkprogram, agree on Results Framework

13. M&E in the Project CycleM&E in the Project Cycle

Between end-of-negotiations and project Between end-of-negotiations and project
effectivenesseffectiveness

M&E unit established M&E unit established

Baseline completedBaseline completed

Implementation & SupervisionImplementation & Supervision

ISRISR

Mid-term ReviewMid-term Review

Implementation and CompletionImplementation and Completion

ICRICR

Sustainability of M&E systemsSustainability of M&E systems

14. Necessities for Successful M&ENecessities for Successful M&E

M&E must have strong ownership and support from leadersM&E must have strong ownership and support from leaders

M&E requires expert supportM&E requires expert support

M&E needs broad stakeholder consultation in defining and M&E needs broad stakeholder consultation in defining and
setting target indicatorssetting target indicators

M&E training is essential for successM&E training is essential for success

M&E systems have to be user-friendlyM&E systems have to be user-friendly